Spark Developer (Corp-corp can also apply)
Job Description
TITLE : SPARK DEVELOPER
LOCATION : LOS ANGELES, CA
NATURE OF EMPLOYMENT : FULL TIME, PERMANENT POSITION OR CONTRACT (W2 OR CORP-CORP) IS ALSO FINE
JOB DESCRIPTION:
· Should lead and guide a team of Spark developers Implantation of Spark Core, Sparks and Spark Streaming
· Experience on Apache Kafka Integration with Apache Spark Implementing security for Spark Applications
· Solid understanding of big data environments
· Working with Spark in combination Hadoop Ecosystem
· Proven experience processing and aggregating over billions of rows
· Good working knowledge on Hive
· Experience publishing RESTful API s to enable real-time data consumption
· Solid hands-on experience with Spark Core, Spark Streaming, SparkSQL for real-time data processing (at least one year proven experience)
· Developing Hive UDFs in Python or Java and integrating with Spark
· Integrating Spark with RDBMS (at least two mandatory)
· Working with Apache Kafka Should be able to fine tune performance of Spark applications
· Build and maintain performant, fault-tolerant, scalable distributed software systems
· Demonstrated success working with cross-functional teams Well-versed in the development challenges inherent with highly scalable, highly available, and highly resilient systems
Qualifications
SPARK DEVELOPER
Additional Information
All your information will be kept confidential according to EEO guidelines.