Job Description

As a Senior Data Engineer for our leading retail sportswear client, you will work with a variety of talented teammates and be a driving force for building first-class solutions, and working on development projects related to supply chain, commerce, consumer behavior and web analytics among others.

RESPONSIBILITIES FOR A SR. DATA ENGINEER:

•    Design and implement features in collaboration with product owners, data analysts, and business partners using Agile / Scrum methodology •    Contribute to overall architecture, frameworks and patterns for processing and storing large data volumes •    Design and implement distributed data processing pipelines using Spark, Hive, Sqoop, Python, and other tools and languages prevalent in the Hadoop ecosystem •    Build utilities, user defined functions, and frameworks to better enable data flow patterns •    Research, evaluate and utilize new technologies/tools/frameworks centered around high-volume data processing •    Define and apply appropriate data acquisition and consumption strategies for given technical scenarios •    Build and incorporate automated unit tests and participate in integration testing efforts •    Work with architecture/engineering leads and other teams to ensure quality solutions are implemented, and engineering best practices are defined and adhered to. •    Work across teams to resolve operational and performance issues •    Desire to work collaboratively with your teammates to come up with the best solution to a problem •    Demonstrated experience and ability to deliver results on multiple projects in a fast-paced, agile environment

Qualifications

REQUIRED SKILLS FOR A SR. DATA ENGINEER:

• 4+ years of experience in large-scale software development, 2+ years of big data experience
• Strong programming experience, Python preferred
• Extensive experience working with Hadoop and related processing frameworks such as Spark, Hive, Sqoop, etc.
• Experience with RDBMS systems, SQL and SQL Analytical functions
• Experience with workflow orchestration tools like Apache Airflow
• Experience with performance and scalability tuning
• MS/BS in Computer Science, or related technical discipline

NICE TO HAVES: •    Experience with Scala or Java •    Experience working in a public cloud environment, particularly AWS •    Familiarity with cloud warehouse tools like Snowflake •    Experience with messaging/streaming/complex event processing tooling and frameworks such as Kinesis, Kafka, Spark Streaming, Flink, Nifi, etc. •    Experience working with NoSQL data stores such as HBase, DynamoDB, etc. •    Experience building RESTful API’s to enable data consumption •    Familiarity with build tools such as Terraform or CloudFormation and automation tools such as Jenkins or Circle CI •    Familiarity with practices like Continuous Development, Continuous Integration and Automated Testing •    Experience in Agile/Scrum application development

Additional Information

Please note this opportunity is for W2 CANDIDATES only; no C2C.

Aroghia Group provides top market compensation and a great company culture. Please provide your resume, LinkedIn profile address, and phone number when applying. We have established a solid reputation in the marketplace by providing our employees with outstanding opportunities for personal and professional growth. Some additional benefits include (but are not limited to):

• We are a preferred IT vendor for top-notch companies in a wide range of industries across the U.S.
• We offer various compensation structures (hourly, salary) based on qualifications and market demand.
• We provide continuous training and development to ensure our team remains at the forefront of technological advancements.

Open Positions: http://aroghia.com/careers

#IND123