Work Location: Woonsocket, RI
Junior Data Engineer The Junior Data Engineer will work with Fortune 100 clients on Data Modernization initiatives.
We seek Data Software Engineers that:
- are skilled at wrangling structured, semi-structured, unstructured for streaming and batch data sources.
- are able to lead proofs-of-concepts and then scale those concepts into production • can serve as an experts in leveraging and implementing emerging data technologies
REQUIREMENTS:
- [Must] Experienced working with enterprise scale solutions - high performance, scalability, & reliability • [Must] Experienced in Azure Cloud Platform. (ADLS, Blob).
- o Good grasp of different data formats like JSON, Avro, Parquet and other prevalent big data file formats • Experience designing, developing, optimizing and troubleshooting complex data-intensive applications using Spark, HDFS and other big data related technologies.
- o [Must] [Expert level] Python Development – focused mainly at data transformation and wrangling.
- o [Must] Spark Development
- o [Must] PySpark Development
- o [Preferred] Experience working tools like Git, Pycharm, Jupyter, Triafacta • [Must] Azure Databricks – Experience in developing data pipelines to transform, aggregate and or process data using Azure Databricks platform.
- [Ideally] Apache Airflow experience
Required Skills
Required Experience