Job Description

Job Description

Data Engineer (AWS Cloud)
Location: REMOTE

We are seeking a highly skilled Data Engineer (AWS Cloud) with a minimum of 7 years' experience to join our team and support the Agile-based implementation of a data management environment for a government client.

Position Description

As a Data Engineer (AWS Cloud), you will play a critical role in ingesting, transforming, and managing data using AWS Cloud Services and Python Programming. The candidate will also have to work directly with other senior data engineers and product owners to deliver data products in a collaborative and agile environment. They will also need to be able to integrate code into a cloud production environment.

Key Responsibilities

• • Must be able to collaborate with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL, AWS Glue and/or Informatica for big data technologies.
• • Work with on-prem database and warehouse solutions such as Oracle or SQL Server or Cloud based solutions.
• • Collaborate on data engineering coding principles, standards, designs, frameworks, and chaos testing.
• • Develop data engineering solutions using Python and/or Java.
• • Seek to continuously develop deep AWS engineering skills that optimize code quality and performance.
• • Excellent verbal and written communication skills for expressing technical software requirements and designs.
• • Build data pipelines and other custom automated solutions to speed the ingestion, analysis, and visualization of large volumes of data.
• • Develop data transformation pipelines to clean, enrich, and structure the ingested data for storage in AWS Redshift platform services and storage services.
• • Integrate data from disparate sources to enable seamless data access and analysis within the data management environment.
• • Design and maintain data models within and implement data quality checks and validation processes to ensure data accuracy and integrity.
• • Ensure data security and compliance with government regulations and industry standards.
• • Optimize data pipelines and queries for efficient data processing and retrieval.
• • Work closely with business analysts, data scientists, and other stakeholders to understand data requirements and deliver data solutions that meet business needs.

• • Participate in Agile development Sprints (2-week cycles) including design, development, unit testing and peer review.

  • • Provide domain expertise for user stories, including descriptions, acceptance criteria and pointing.
  • • Prepare comprehensive documentation for data pipelines, data models, and data processes.

Required Qualifications

* * Must be a U.S. Citizen or Green Card Holder as required by our government client. 

* * 7+ years of experience in data engineering, with a focus on data integration, data transformation, and data warehousing. 

* * 7+ years Cloud Development (AWS Cloud) for data processing including experience doing ETL processes. 

* * 7+ years in a technical management capacity for a large enterprise with a high performing technical team. 

* * 7+ years’ experience with AWS Glue, AWS Data Brew, NoSQL server, SQL Server query experience, AWS Informatica for Relational Database Service (RDS) and the Cloud. 

* * 7+ years of experience in designing and developing Data Pipelines for Data Ingestion or Transformation using AWS technologies.