Data Engineer (1546)

 | $85/hr (W2) | 12 Months San Francisco, California

Description:

W2 Role

Note:
A candidate who does not require any sponsorship in the future will be highly preferred for this role
Locals are strongly preferred.

Qualifications:
The AWS developer is responsible for developing, testing, implementing, debugging, and supporting computer software used to create data warehouse applications. This includes data design, database architecture, metadata and repository creation, identification and resolution of information flow, content issues, and transformation of business requirements, troubleshooting problems and tuning existing warehouse applications.

We are looking for the AWS developer to be customer focused, drive for success, put an emphasis on teamwork, effective communication, innovation and flexibility and adaptability. The AWS developer is responsible for detailed technical design, development, and support of software applications using the AWS platform. They formulate concepts and develop solutions using defined user requirements and are able to interpret requirements and work with the customer to clarify requirements as needed. They design, code, test, and document enhancements to existing systems of high complexity and scope, working with common application designs and specifications, utilizing industry and System standard procedures, products and methodologies, and execute performance and stress testing, as necessary.

Essential Job Responsibilities (include but are not limited to the following):
• Develop software from user requirements
• Solution Architecture
• Data modeling
• High-Level data movement (staging and processing)
• Research data sources
• Profile/Analyze source data
• Staging and Dimensional table creation
• Security modeling
• Develop ETL
• Code, in the ETL tool, the extraction, transformation and loading of data from source systems to the data warehouse
• data visualization
• Translate creative design into code
• Work with Analyst Role as needed for Preliminary Use Cases
• Expand/Implement Requirements
• Create prototypes
• Code software following standard design patterns.

Responsibilities:
Skills:
• Understanding of core AWS services, uses, and basic AWS architecture best practices (S3, DMS, Glue, Lambda)
• Development/modeling experience with Amazon Redshift
• Experience with visualization tools (Tableau)
• Experience with ETL tools (Informatica)
• Proficiency in developing, deploying, and debugging cloud-based applications using AWS
• Ability to use the AWS service APIs, AWS CLI, and SDKs to write applications
• Ability to identify key features of AWS services
• Understanding of the AWS shared responsibility model
• Understanding of application lifecycle management
• Ability to use a CI/CD pipeline to deploy applications on AWS (GitLab, terraform)
• Ability to use or interact with AWS services
• Ability to apply a basic understanding of cloud-native applications to write code
• Ability to write code using AWS security best practices (e.g., not using secret and access keys in the code, instead using IAM roles)
• Ability to author, maintain, and debug code modules on AWS
• Proficiency writing code for serverless applications
• Understanding of the use of containers in the development process Professional Experience/Education
• 5-6 years of experience working with AWS
• Degree in computer science or related field