Job Description
MW Partners is currently seeking a Data Engineer to work for our client who is a global leader in multimedia and creativity software products.
RESPONSIBILITIES AND DUTIES:
- Architect, build, and maintain scalable, automated, and reliable data pipelines from the ground up. Be an expert at maintaining data quality while stitching data from many different data sources
- Work with data ingestion, data platform, product, and machine learning teams to deeply understand and validate instrumentation, data flow, and processes
- Utilize solid software engineering principles and tools for the pipelines you create, own the data engineering lifecycle end to end, develop new features and improve integrations for data sources
- Support regular ad-hoc data querying and analysis to diagnose issues, understand customer behavior, and support maintenance
REQUIREMENTS:
- Bachelor’s degree in Computer Science, Information Systems or a related field is required, master’s preferred
- 3-6 years of experience building and maintaining data pipelines at scale utilizing technologies like Apache Hadoop, Apache Kafka, SQL, Hive, and Presto/Trino
- Strong proficiency with software engineering tools like Git, Docker, Jenkins or Apache Airflow
- Programming experience in Python or a similar language
- Strong capacity to manage numerous simultaneous projects with a geographically distributed team
- Passion for creating intelligent, fault-tolerant, and redundant data pipelines at scale
- Solid attention to detail, be a self-starter, able to diagnose and resolve problems with production grade systems at scale
For a confidential discussion or to find out more, contact Krishna on (949) 593 8496 or apply now.
Company Description
MW Partners is a rapidly growing Women and Minority owned company that provides Professional and IT Staffing Services on a contract, contract to hire and direct hire basis.