Senior Data Engineer to support its Crude Data Exchange project, part of a broader effort to modernize the WONA Data Warehouse using Azure cloud technology. This role focuses on aligning and transforming data across the T&S Crude business, with a long-term goal of migrating the NA ODW into the same platform.
The ideal candidate is a technology expert with deep experience in data engineering and cloud solutions. This role requires strong technical design skills, hands-on development capabilities, and the ability to work closely with both IT and business stakeholders. Senior-level experience and the ability to mentor junior team members are critical.
Key Responsibilities:
- Design and implement scalable data architecture using Azure, AWS, and SAP platforms.
- Lead ELT development and end-to-end data engineering efforts to support global trading data integration.
- Support alignment and standardization of data between WONA and NA regions.
- Work closely with business stakeholders and IT to roll out data strategy and initiatives.
- Serve as a subject matter expert in Data Engineering, Data Modeling, and Integration.
- Provide technical guidance and mentorship to junior engineers.
- Support change management, incident resolution, and continuous improvement initiatives.
- Present technical findings to stakeholders and contribute to knowledge-sharing efforts across teams.
Required Skills:
- Azure, AWS, SAP – Expert level
- ELT Development – Expert level
- Data Modeling – Expert level
- Data Integration & Ingestion – Proficient
- Data Manipulation and Processing – Proficient
- GitHub, GitHub Actions, Azure DevOps – Proficient
Hands-on experience with the following tools/platforms:
- Data Factory
- Databricks
- SQL DB
- Synapse
- Stream Analytics
- Glue
- Airflow
- Kinesis
- Redshift
- SonarQube
- PyTest
Preferred Skills:
- Experience managing or running a Scrum team
- Familiarity with Planning/BPC systems
- Exposure to external technical ecosystems
- Experience with MKDocs or similar documentation tools