Benefits:

401(k)

Senior Data Platform Engineer

Onsite Austin, TX

Job Description

We are hiring a Senior Data Platform Engineer for an onsite role in Phoenix, AZ.

This role requires strong hands-on experience building and operating data pipelines on Google Cloud Platform.

Key Responsibilities:

Design and maintain Airflow DAGs for production data workflows

Develop and optimize Spark / PySpark jobs on Dataproc

Build and optimize complex SQL transformations

Develop REST APIs using FastAPI Python to support data services

Implement robust data quality and validation frameworks

Monitor pipeline performance, retries, and SLA compliance

Required Skills:

6+ years of data engineering experience

Strong Python programming skills

Production experience with Apache Spark PySpark

Experience with Airflow DAG development

Hands-on experience with GCP (Dataproc, BigQuery, Cloud Storage preferred)

Experience building APIs using FastAPI

Strong SQL and data modeling knowledge

Experience implementing data quality checks (schema validation, row count checks, anomaly detection)