Benefits:

Hybrid

Long Term

Opportunity for advancement

Senior Data Engineer Location: Dallas, TX (Hybrid—3 days onsite)

Duration: Long-term Project

Interview: In-person

Data Engineer L3 Role

Roles and Responsibilities:

Migrate data from On-prem to AWS Redshift with zero data loss.

Build batch and real-time data pipelines using Python .

Set up and manage Kafka on AWS for streaming data.

Automate ETL workflows using AWS Glue and store data in S3.

Design data solutions in Redshift for fast querying.

Create reusable frameworks to reduce development time and improve code.

Build dashboards and reports for client data insights.

Use GitLab CI/CD for testing and deployments.

Work with AWS tools like Lambda, SQS, SNS, Glue, DynamoDB, OpenSearch, and more.

Develop tools to generate mock data (JSON, CSV, XML).

Deploy containerized apps using Kubernetes.

Follow best practices to ensure data security and compliance.

Qualifications:

Strong experience in Python and cloud technologies - AWS.

Good understanding of Kafka, ETL, and data warehouses.

Familiarity with CI/CD, boto3, and Kubernetes is a big plus.

Flexible work from home options available.