Benefits:

401(k)

401(k) matching

Bonus based on performance

Sr Data Engineer Needed with Strong Python and Pyspark Duration: 12 Months+

Sr Data Engineer. Strong Python and Pyspark Good with Data Structures and algorithms

Needed Only Local to bay area

1 day onsite a must

15+yrs experience required

Responsibilities

? Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.

? Collaborate with product and technology teams to design and validate the capabilities of the data platform

? Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability

? Provide technical support and usage guidance to the users of our platform’s services.

? Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services.

Qualifications

? Experience building and optimizing data pipelines in a distributed environment

? Experience supporting and working with cross-functional teams..

? Proficiency working in Linux environment

? working knowledge of SQL, Python, and PySpark

? Git/Bitbucket, Jenkins/CodeBuild, CodePipeline

Thanks & Regards

Bhanu Prakash

DeltaSoft Solutions

bhanu.prakash@deltasoftgroup.com

Flexible work from home options available.