Big Data Developer - Advanced
| 12 Months San Francisco, California
Description:
Principal duties/Roles and responsibilities: Big Data Engineer
Location: Remote is ok during this pandemic situation. Preferred SF Bay area candidate.
We will add more locations as required.
Duration: 12-18 months
The client is looking for a Big Data Engineer to join the Advanced Data and Analytics Capabilities Team. We are a team based out of San Francisco that partners with business lines across the client to deliver big data and advanced analytics products and solutions.
In this role, you will have the opportunity to contribute to several high-quality data solutions and enhance your technical skills across many disciplines.• Design, develop, and maintain end to end data solutions using open-source, modern data lake, and enterprise data warehouse technologies (Hadoop, Spark, Cloud, etc.) • Contribute to multiple data solutions throughout their entire lifecycle (conception to launch) • Partner with business stakeholders to understand and meet their data requirements
Provide ongoing maintenance and enhancements to existing data solutions • Maintain security in accordance with the Client’ security policies • Participate in an Agile development environment.
Required Skills/Must Have:
• Bachelor’s degree in Computer Science, Engineering, or Information Management (or equivalent) • 5+ years of relevant work experience
• Professional experience designing, creating and maintaining scalable data pipelines
• Hands-on experience with a variety of big data technologies (Hadoop / Cloudera, Spark, Cloud, etc.)
• Experience with object-oriented scripting languages: Java (required), Python, etc.
• Advanced knowledge of SQL and experience with relational databases
• Experience with UNIX shell scripts and commands
• Experience with version control (git), issue tracking (jira), and code reviews
• Proficient in agile development practices
• Ability to clearly document operational procedures and solution designs
• Ability to communicate effectively (both verbal and written)
• Ability to work collaboratively in a team environment
• Ability to balance competing priorities and expectations