Cloud Data Engineer (Azure)

D

DATAMAXIS

Cloud Data Engineer (Azure)

Dearborn, MI
Full Time
Paid
  • Responsibilities

    Cloud Data Engineer will be responsible for developing on the data lake platform and all applications on Azure cloud. Good data Engineering, data modeling is a must with Python programming background. The Data Engineer will be responsible for providing design and development solutions for applications in the cloud.

    Essential Job Functions:

    • Understand requirements and engage with team to design and deliver projects.
    • Design and implement data lake house projects within azure.
    • Design and develop application lifecycle utilizing Microsoft Azure technologies
    • Participate in design and planning and necessary documentation
    • Participate in Agile ceremonies including daily standups, scrum, retrospectives,demos, code reviews.
    • Hands on with Python development and Azure data pipelines
    • Engage with team to develop and deliver cross functional products
    • Postgres SQL knowledge is a plus

    Minimum Qualifications and Job Requirements:

    • Bachelor's degree in CS.
    • 7 years of hands-on experience in designing and developing distributed data pipelines.
    • 5 years of hands-on experience in Azure data service technologies.
    • 5 years of hands-on experience in Python, SQL, Object oriented programming, ETL and unit testing
    • Experience with data integration with APIs, Web services, Queues
    • Experience with Azure DevOps and CI/CD as well as agile tools and processes including JIRA, confluence.
    • Working experience with writing SQL queries from scratch

    Key Skills

    a. Data Engineering and SQL

    b. Python

    c. PySpark

    d. Azure Data lake and ADF

    Other Responsibilities:

    • Document and maintain project artifacts.
    • Maintain comprehensive knowledge of industry standards, methodologies, processes, and best practices.
    • Complete training as required for Privacy, Code of Conduct etc.
    • Promptly report any known or suspected loss, theft or unauthorized disclosure or use of PI to the General Counsel/Chief Compliance Officer or Chief Information Officer.
    • Adhere to the company's compliance program.
    • Safeguard the company's intellectual property, information, and assets.