SG2 Recruiting is supporting their client, Trend Health Partners, in their search for a Data Engineer II. A Data Engineer II is responsible for designing, developing, and maintaining optimal data pipelines and workflows. They provide technical guidance on architectural design, work with stakeholders to address data-related technical issues, perform data integration, transformation, and cleaning, and translate business requirements into technical specifications and finished products.
They collaborate with Data Engineer IIIs to contribute to the overall product strategy, conduct code reviews, mentor Data Engineer Is, and share knowledge with the team. Additionally, they develop and maintain documentation for data engineering processes, systems, and data models, and ensure compliance with healthcare data-related privacy and security regulations.
ROLE AND RESPONSIBILITIES
• Design, develop, and maintain optimal data pipelines and workflows.
• Provide technical guidance on architecture design and collaborate with Data Engineers for implementation.
• Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs.
• Perform data integration, transformation, and cleaning to create insightful and actionable data for the business.
• Translate business requirements into technical specifications and finished products.
• Participate in code reviews and contribute to team knowledge sharing.
• Lead the development and maintenance of documentation for data engineering processes and systems.
• Create ad-hoc reports requested by internal and external partners.
• Work as a team to support and troubleshoot errors for 100+ data pipelines.
• Work closely with the application development team to update data and data structures.
• Provide analysis, recommendations, and feedback to business process owners, leadership team, and the Information Technology department.
• Propose automated solutions to repeated development tasks.
REQUIRED QUALIFICATIONS
• Bachelor’s degree with major coursework in Computer Science or Business Administration/related field required. Equivalent work experience in a similar position may be substituted for educational requirements.
• 3+ years of experience in data engineering or a related field.
• Strong proficiency in Python, T-SQL, SSMS, Databricks, and Azure Data Factory.
• Experience with data integration, transformation, and data warehousing.
• Strong understanding of data privacy and security regulations.
• Ability to translate business requirements into technical specifications and finished products.
• Proficiency in compiling data, creating reports, and presenting information.
• Proven experience working in a fast-paced environment supporting multiple concurrent projects.
• Strong written, verbal, and customer service skills.
PREFERRED QUALIFICATIONS
• Ability to manage multiple tasks and projects simultaneously.
• Experience in mentoring junior developers or a desire to take on a mentoring role.
• Knowledge of healthcare data and related privacy and security regulations.
• Experience with cloud-based services like Azure.
• Strong problem-solving skills and attention to detail.
• Experience with healthcare data.
• Experience using agile framework.
• Experience with software development life cycle tools such as Red-Gate, Bitbucket, or JIRA.
MENTAL AND PHYSICAL DEMANDS
• This position will be exposed mainly to an indoor office environment and will be expected to work in or around computers and printers.
• The nature of the work is sedentary, and the employee will be sitting most of the time.
• Essential physical functions of the job include typing and repetitive motions to utilize the computer software and hardware continuously throughout the day.
• Essential mental functions of this position include concentrating on analytical tasks, reading information, and verbal/written communication to others continuously throughout the day.
RELATED DUTIES AS ASSIGNED
• This job description documents the general nature and level of work but is not intended to be a comprehensive list of activities, duties, or responsibilities required for this position.
• Consequently, employees may be asked to perform other duties as required.
• Employees may also be asked to complete certain compliance requirements set forth by our Business Partners in the performance of their jobs, including but not limited to requests for background and drug screenings and disclosures of personal health information or personally identifiable information. Exemptions as provided under the ADA and TITLE VII of the Civil Rights Act will be observed and followed.
• Reasonable accommodations may be made to enable individuals with disabilities to perform the functions outlined above.