Data Integration Engineer

C

Charlie's Produce

Data Integration Engineer

Seattle, WA
Full Time
Paid
  • Responsibilities

    Job Description

    The Data Integration Engineer will own and scale our data ingestion layer using Fivetran / CData or similar tools / CData and Databricks / MS Fabric or similar technologies.This role focuses on integrating legacy enterprise applications, SaaS enterprise applications, databases, APIs, and file-based sources into a cloud-native analytics platform. You will ensure data is reliable, complete, secure, and delivered on time to support analytics, reporting, and downstream data products. This role sits at the intersection of source systems, data engineering, and platform operations. This role is integral to driving the company's data strategy and ensuring that data initiatives align with business objectives.

    ** Key Responsibilities** :

    • Data Ingestion & Integrations * Design, implement, and maintain data integrations using Fivetran / CData or similar tools (managed and custom connectors) * Integrate data from ERP platforms (Financials, Supply Chain, Warehouse Management, Transportation Management) both on-prem and Cloud, SaaS platforms, operational databases, APIs, and flat files * Build and maintain Fivetran / CData or similar tools / custom connectors where off-the-shelf connectors do not meet requirements * Partner with application owners to understand source system schemas, SLAs, and change patterns
    • Databricks & Landing Zone Engineering * Land raw data into Databricks Delta Lake (Bronze layer) with appropriate partitioning and metadata * Validate source data completeness, freshness, and schema consistency * Support incremental loads, CDC, and historical backfills * Build lightweight Databricks jobs for ingestion validation and reconciliation
    • Data Quality, Monitoring & Reliability * Monitor Fivetran / CData or similar tools: syncs, alerts, and failures; troubleshoot root causes * Implement ingestion-level data quality checks and reconciliation logic * Manage schema drift, breaking changes, and connector upgrades * Document data sources, refresh schedules, and known limitations
    • Security, Access & Compliance * Configure secure connectivity (networking, secrets, service accounts) * Apply least-privilege access controls to source systems and landing tables * Support PII handling, retention, and regulatory requirements * Partner with security and platform teams on audits and reviews
  • Qualifications

    Qualifications

    • Technical Skills * 5+ years of experience in data integration, ETL/ELT, or data engineering integrating various enterprise applications including ERPs (Financials, Supply Chain, Warehouse Management, Transportation Management) both on-prem and cloud. * Hands-on experience with Fivetran / CData or similar tools (including connector configuration and monitoring) * Experience with Databricks and Delta Lake * Strong SQL skills; working knowledge of PySpark or Python * Experience integrating APIs (REST/JSON), relational databases, and SaaS tools * Familiarity with CDC concepts (log-based replication, timestamps, soft deletes) * Git-based development and documentation practices
    • Operational & Collaboration Skills * Strong troubleshooting and root-cause analysis skills * Ability to work with application owners and non-data teams * Comfortable operating production data pipelines with SLAs
    • Education : * Bachelor's degree in Computer Science, Engineering, or equivalent experience.

    Additional Information

    All your information will be kept confidential according to EEO guidelines.

    This is a safety-sensitive position.

    This employer participates in E-Verify and will provide the Social Security Administration and if necessary, the Department of Homeland Security with information from each new employee's Form I-9 to confirm work authorization.

    We do not provide H1-B sponsorships at this time.

    Please note that the pay range provided is a good faith estimate for the position at the time of posting. Actual compensation will be dependent on factors, including but not limited to, the individual’s qualifications, experience, knowledge, skills, and abilities as well as physical work location within the state .

    For additional protected privacy information please visit: Privacy Policy | Charlie's Produce (charliesproduce.com)

    Charlie's Produce is an Equal Opportunity Employer

    Visit our Employment Page for more details or to view our privacy center: https://www.charliesproduce.com/careers/

    Recruiters - DO NOT CONTACT!