Job Description

As a senior data engineer, you will create the architecture and develop the pipelines that transform and process data to deliver insights and business intelligence. That insight enables business leaders to make better decisions founded on real data. You will see the “big picture” and create approaches for software design and implementation to guide the development team. You will also act as a fearless technical leader, ramp up quickly by getting your hands dirty with sophisticated and cutting edge technology, and lead the discussion in a room with other technologists and negotiate the outcome.

AS A SENIOR DATA ENGINEER, YOU WILL:

• Work with customers to define, design, and develop complex data pipelines (stream and batch processing) on cloud platforms (AWS/GCP)
• Work with Data Scientists to design pipelines that improve their productivity and enable them to implement their ideas
• Work hands-on with cloud native services to demonstrate and prototype outcomes in customer/partner environments.
• Gather performance metrics to identify inefficiencies and opportunities to improve scalability and performance
• Provide technical guidance and coaching to other engineers
• Strive to be at the forefront of new modern data analytics technologies
• Work with the engineering team to package best practices and lessons learned into thought leadership and published assets interact with sales, partners, and customer technical stakeholders to manage project scope, priorities, deliverables, risks/issues, and timelines for successful project outcomes.
• Translate business requirements into technical design and architecture
• Develop prototypes and demos quickly
• Function as part of an agile delivery process
• Solve sophisticated data and analytics problems at scale

TECHNICAL REQUIREMENTS:

• Demonstrated experience creating sophisticated data processing pipelines leveraging public cloud platforms
• Demonstrated experience incorporating testing into pipelines, including performance tuning
• Demonstrated expertise with distributed systems development
• Ability to quickly get up to speed with new technologies
• 3+ years experience with streaming systems like MQ, Kafka, Storm, Spark, etc.
• 3+ years experience with data toolchains like Dataflow, BigQuery, Kinesis, Redshift, EMR
• 3+ years experience with business intelligence tools like QuickSight, Looker and Data Studio
• 5+ years experience in design and implementation of big data systems
• 5+ years experience of Java and Python development