Job Description

JOB DESCRIPTION: DATA ENGINEER

LOCATION: SAN DIEGO, CA / US REMOTE

We are looking for professional who can join our Data Analytics team.

• You will be joining a team of passionate data professionals focused on data engineering and analytics offerings provided to fortune 500 companies.

• You will be working on identifying and analysis of user requirements

• You will build and implement ETL pipelines, EDW or Data Lake solutions

• You need to implement real-time data ingestion and processing solutions

• You need to translate complex business problems into scalable technical solutions

• You will be writing well designed and efficient code in both SQL and No SQL databases.

• Collaborate with a high performing data engineering team and own the end to end solution implementation.

ROLE EXPECTATIONS

• 5 TO 7 YEARS WORKING EXPERIENCE IN DATA INTEGRATION AND PIPELINE DEVELOPMENT WITH DATA WAREHOUSING .
• Experience with AWS Cloud on data integration with Apache Spark, EMR, Glue, Kafka, Kinesis, and Lambda in S3, Redshift, RDS, MongoDB/DynamoDB ecosystems
• Strong real-life experience in python development especially in pySpark in AWS Cloud environment.
• Design, develop test, deploy, maintain and improve data integration pipeline.
• Experience in Python and common python libraries.
• Strong experience with Perl and Unix Scripts.
• Strong analytical experience with database in writing complex queries, query optimization, debugging, user defined functions, views, indexes etc.
• Strong experience with source control systems such as Git, Bitbucket, and Jenkins build and continuous integration tools.
• Experience with continuous deployment(CI/CD)
• Databricks, Airflow and Apache Spark Experience is a plus.
• Experience with databases (Oracle, SQL Server, PostgreSQL, Redshift, MySQL, or similar)
• Strong experience with performance tuning, analytical understanding with business and program.
• Exposure to ETL tools including Informatica and any other

Company Description

CLOUDSUFI is a Silicon Valley-based specialist Data Engineering Cloud Migration player with top-tier clients, favorable revenue mix, strong financial performance. The organization is built to scale with strong external/ internal tech capabilities and robust management and governance standards. Experienced Management Team Led by a distinguished team with average industry experience of & 20 years. Rich experience across reputed organizations such as Microsoft, Capgemini, IBM, Oracle, SAP, JDA software, among others.Sound governance standards. Unique Positioning in the Data Engineering, Monetization & Cloud Migration space Unique Data Analytics & Cloud Migration player with an experienced team.A global talent pool of approximately 350 professionals with data engineering and migration expertise, the largest of its kind globally. The breadth of experience having led and impacted 450+ implementation projects with 60%+ cost and time savings delivered. Recognized by Analyst for its expertise in the data engineering and data monetization domain along with Accenture, Deloitte, E&Y, Capgemini, and PWC. Large and Attractive Market Global Data solutions market is USD 169 Bn in 2019 and expected to grow to USD 274 Bn in 2022, registering 20%+ CAGR in the next five years. Data engineering and Monetization chain are taking center stage as a key differentiator, digital transformation is creating demand for new solutions. The attractive mix of existing customers between Large Enterprises ( size > 2 B) and Mid Market ( size: 0.5-2 B) offering immense penetration opportunities.