- Successfully migrated data from traditional database systems to Azure, enhancing scalability and efficiency
- Led the creation of mapping documents, facilitating project collaboration and data integration
- Wrote complex transformation scripts to populate dimension tables, enhancing data processing efficiency
- Developed end-to-end metadata-driven pipelines, ensuring atomicity and re-usability for streaming, batch, and eventdriven
- Designed and implemented metadata models for centralized custom logging and data quality framework, enhancing data
- Created data and analytical models for all zones within the data lake, optimizing data utilization and analysis
- Developed and maintained views, stored procedures, and intricate SQL queries to meet project requirements within tight
- Optimized data processing efficiency through robust pipelines within 8 months
- Engineered seamless integration of Azure Data Factory (ADF) pipelines with various services, ensuring reliable data
- Implemented autointegration between Azure Active Directory and Data Lake, optimizing user access permissions within
- 4 months
- Developed scalable data infrastructure, resulting in a 25% reduction in system downtime within 9 months
- Optimized data storage architecture, reducing storage costs by 20% in under 1 year
I
ICICI Bank
Data Engineer
December 2020 - May 2022
I
ICICI Bank
Data Analyst
December 2018 - November 2020
Skills
AirflowAkka (Toolkit)Amazon Elastic Mapreduce (EMR)Amazon RedshiftAmazon S3Amazon Web ServicesAnalytical ThinkingApache KafkaApache SparkApplication Programming Interfaces (APIs)AWS GlueAzure Active DirectoryAzure Data FactoryBusiness AdministrationBusiness AnalysisBusiness IntelligenceBusiness Process ImprovementBusiness StrategiesClinical ResearchCloud ComputingCollibraCost ReductionC++ (Programming Language)Crypto CurrencyDashboardsData AnalysisDatabasesData GovernanceData InfrastructureData IntegrationData LakesData LoggingData ManagementData PipelinesData ProcessingData QualityData ScienceData Storage TechnologiesData StreamingData VisualizationDecision Making SkillsDevOpsDockerDocument-Oriented DatabasesEmployee RetentionExpress.jsExtract Transform Load (ETL)Filing SkillsGitIBM Cognos Business IntelligenceInformation EngineeringInformation TechnologyJavaScript (Programming Language)JenkinsJSONKey Performance IndicatorsLinuxMachine LearningMasonry and Bricklaying WorkMaster of Business Administration (MBA)MetadataMicrosoft AccessMicrosoft AzureMicrosoft ExcelMicrosoft SQL ServerMicrosoft WindowsMonte Carlo MethodsNode.JsOperational SystemsPortfolio ManagementPostgreSQLPower BIPredictive ModellingPresentationsProcurement ManagementProgramming LanguagesProject CollaborationPython (Programming Language)ReactJSReliabilityRisk AnalysisR (Programming Language)ScalabilitySearch EnginesSimulationsSnowflakeSpark StreamingSQL AzureSQL DatabasesSQL Stored ProceduresStakeholder ManagementStock ControlStorage TechnologiesStrategic ThinkingTableau (Software)TerraformUnixUsability TestingUser Defined FunctionsVisualizationWeb ApplicationsWindows PowerShell