- Developed data architecture diagrams and conducted whiteboarding sessions with stakeholders to confirm business goals and direction
- Created data migration and ETL migration demos using AWS services
- Managed a portfolio of diverse projects simultaneously, coordinating tasks, resources, and timelines to ensure on-time delivery of deliverables
- Developed PySpark and Python scripts to discover data types of manifest files and extracted the metadata into DynamoDB tables utilizing the AWS APIs
- Ingested batch data using AWS Lambda, DataSync, and Glue to store data in Glue Catalogs and S3
- Automated the data ingestion and data standardization of thousands of manifest files using Amazon
- Step Function Workflow
- Replaced a thousand lines of code and reduced manual overhead
- Debugged and created unit tests for data ingestion validation
- Optimized DynamoDB queries shortening the time of each query by over 50% and reducing query
- Communicated and collaborated effectively with data engineers, engagement managers, and sales