State of Montana Department of Public Health and Human Services
Data Engineer
May 2024 - present
company
State of Montana Department of Public Health and Human Services
title
Data Engineer
overview
- Optimized data pipelines to ingest data into Snowflake with reduction in processing time compared to on-premises solutions
- Established automated data ingestion pipelines using Fivetran to extract data from W data sources and load it into Snowflake
- Developed interactive dashboards in Tableau to visualize key data insights for business stakeholders, leading to improvement in data-driven decision-making
- Implemented data cleansing routines in SSMS to handle missing values and inconsistencies, improving data quality for downstream analytics
M
MetLife FL
Data Engineer
April 2023 - April 2024
Z
Zensar Technologies
Data Engineer
IN
August 2020 - July 2022
Skills
AirflowAlgorithmsAmazon DynamoDBAmazon Elastic Compute CloudAmazon RedshiftAmazon S3Amazon Web ServicesApache FlinkApache HadoopApache HiveApache KafkaApache SparkApache YarnApple Mac SystemsAutomationBatch ProcessingBig DataBusiness InformaticsCloud ComputingCloud Platform SystemContinuous IntegrationDashboardsData AnalysisData ArchitectureDatabasesDatabricksData CleansingData DeduplicationData IngestionData IntegrityData LakesData MiningData PipelinesData ProcessingData QualityData RetrievalData StreamingData SystemsData ValidationData VisualizationData WarehousingDecision Making SkillsEcosystemsElectronicsExtract Transform Load (ETL)GitGithubHadoop Distributed File SystemHealth and Human ServicesIdentity and Access ManagementInformation EngineeringJenkinsJupyter NotebookKinesiologyMatplotlibMicrosoft ExcelMicrosoft SQL ServerMicrosoft WindowsMongoDBMySQLNumPyOperational SystemsPandasParsingPostgreSQLPower BIProgramming LanguagesPublic HealthPysparkPython (Programming Language)Raw DataReal Time DataS3 BucketScikit LearnSnowflakeSoftware Version ControlSpark StreamingSQL DatabasesSQL Server Integration ServicesSQL Server Management Studio (SSMS)SQL Server Reporting ServicesStakeholder ManagementTableau (Software)TelecommunicationsTensorflowTeradata SQLWorkflows