- Developed an Azure monitoring dashboard using Azure Monitor, Log Analytics, and Data Factory for real-time incident
- Orchestrated CI/CD pipelines with Azure Pipelines, and Azure DevOps, improving data processing efficiency by 25%, and implemented Spark UI on AWS CloudFormation for real-time job monitoring and optimization
- Modeled a Data Quality Framework with AWS Glue, Athena, and S3, incorporating automated checks to ensure data
Data Engineering Associate
June 2021 - August 2022
K
KPMG
Summer Internship
Mumbai, IN-MH, IN
May 2020 - May 2020
Skills
Agile MethodologyAlgorithmsAlteryxAmazon DynamoDBAmazon RedshiftAmazon S3Amazon Web ServicesApache HadoopApache SparkArduinoAutomationAWS GlueBusiness AnalysisBusiness ContinuityCarrying out AssessmentsCascading Style Sheets (CSS)Cloud ComputingCloudformationContinuous IntegrationC++ (Programming Language)CyclingDashboardsData AnalysisData as a ServicesDatabase DesignDatabasesData IntegrationData IntegrityData MiningData ModelingData PipelinesData ProcessingData QualityData Storage TechnologiesData VisualizationDecision Making SkillsDockerDynamoElectronicsEvent ManagementExtract Transform Load (ETL)GitHardware DesignHTMLInformation EngineeringInformation SystemsJava (Programming Language)JavaScript (Programming Language)JSONKnowledge of EngineeringKnowledge of StatisticsMATLABMicrosoft AzureMicrosoft Certified ProfessionalMicrosoft ExcelMySQLObject-Oriented Software DevelopmentOpenCVPersonalizationPHP (Programming Language)PostgreSQLPower BIProblem SolvingProgramming LanguagesPysparkPython (Programming Language)Quality ControlRegulatory ComplianceRelational DatabasesSafety PrinciplesServicenowSQL DatabasesSQL Server Management StudioSQL Server Management Studio (SSMS)Swing (Java)Systems Development Life CycleTableau (Software)TalendTelecommunicationsWeb Technologies