Data Engineer

IQ Clarity

Data Engineer

Chicago, IL
Full Time
Paid
  • Responsibilities

    Data Engineer

    We’re looking for a Data Engineer to support large-scale data initiatives in a highly regulated environment. This role centers on building and improving scalable data systems that enable reporting, analytics, and advanced data use cases across the organization.

    Key Responsibilities:

    • Design, build, and maintain scalable data pipelines using modern distributed processing frameworks and Python-based tooling

    • Develop and enhance ETL/ELT workflows within a cloud-based data platform

    • Implement data models aligned with contemporary lakehouse design patterns

    • Ensure reliability, accuracy, and performance across all stages of the data lifecycle

    • Partner with cross-functional teams to translate business and data requirements into technical solutions

    • Create reusable, modular components for data transformation and processing

    • Support automated deployment pipelines using CI/CD and DevOps practices

    • Monitor, troubleshoot, and optimize data workflows for efficiency and scalability

    • Contribute to data governance, security, and compliance standards in a regulated setting

    Required Experience:

    • Hands-on experience with modern data platforms and integration tools (e.g., distributed compute engines, ingestion frameworks, or comparable technologies)

    • Strong background in data architecture, data integration, and data warehousing concepts

    • Experience developing and deploying custom processing logic in distributed environments

    • Proficiency in SQL and experience with relational database systems (cloud-hosted or on-prem)

    • Solid programming skills in Python and experience with large-scale data processing frameworks

    • Experience building and optimizing data pipelines in cloud environments

    • Familiarity with both batch and streaming data processing patterns

    Core Competencies:

    • Strong analytical and problem-solving abilities

    • Comfortable working across cross-functional and distributed teams

    • Ability to clearly communicate technical concepts to non-technical audiences

    • Self-starter with a strong sense of ownership and accountability

    • Focus on delivering reliable, high-quality data solutions