Azure Data Engineer

Softthink Solutions Inc

Azure Data Engineer

Herndon, VA
Full Time
Paid
  • Responsibilities

    About the Role:

    We seek a skilled Data Engineer to support multiple International organization projects. The consultant will work with a multidisciplinary team, delivering data solutions using cutting-edge technologies in a highly collaborative environment.

    Key Responsibilities:

    Design and implement data solutions using Microsoft Azure (preferred), AWS, or Google Cloud.

    Develop and optimize ETL/ELT processes using Azure Data Factory, Databricks, PySpark, SQL Server, and SSIS.

    Manage and optimize Data Lakes/Delta Lakes and complex data transformations.

    Build and maintain CI/CD pipelines using Azure DevOps.

    Migrate legacy data systems to modern platforms.

    Required Skills & Experience:

    5+ years as a Data Engineer.

    Expertise in Microsoft Azure Data Services (Data Factory, Logic Apps, Azure Functions, Databricks, Synapse, DevOps).

    Strong SQL (T-SQL, Spark SQL) and Python/PySpark experience.

    Proven experience with Data Lakes, Delta Lakes, and ETL pipelines.

    Experience with CI/CD, PowerShell, and Bash scripting.

    Strong communication, collaboration, and problem-solving skills.

    Preferred:

    AI/ML and Business Intelligence (BI) knowledge is a plus.

    Experience in Agile methodologies (SCRUM, PMP, PRINCE2).

    Certifications: Azure Data Engineer Associate, DP-500, or related.

    This is a remote position.