Abhiram venigalla

Location

Charlotte, NC
Education
    Seton Hill University
    March 2023 - April 2024
    degree
    Master's
    major
    Business Administration
    Gokaraju Rangaraju Institute of Engineering and Technology
Work Experience
    CyberGuard Solutions
    ETL/Pyspark Developer Full time
    Indianapolis, IN, US
    January 2022 - present
    company
    CyberGuard Solutions
    title
    ETL/Pyspark Developer Full time
    overview
    - Responsibilities - Spearheaded the Agile development of ETL data pipelines, reducing processing time by 30% through automation and optimization for CSV/JSON and database integrations, utilizing GIT and Jupyter within an Anaconda environment - Innovated a data extraction framework from Splunk to Parquet, boosting data management efficiency by 40%, leveraging - Architected a Python-based automation module for dynamic metadata and SQL query generation from Excel, improving - Elevated data integrity and accuracy post-ETL by 35% through strategic validation processes, championing Agile and Scrum - Focused on optimizing data flow, storage access, operational efficiency, code quality, and application performance - Environments: Experienced with a broad range of technologies including Git, Python, Spark, Hadoop, Jira, JSON, Oracle - MySQL, Redshift, SQL Developer, AWS, and Airflow
    Accenture
    AWS Data Engineer Full time
    Hyderabad, IN-TG, IN
    October 2019 - December 2021
    Praneeth Group
    Bigdata Developer Full time
    Hyderabad, IN-TG, IN
    December 2018 - August 2019
Skills
Acceptance TestingAdaptabilityAgile LeadershipAgile MethodologyAirflowAlgorithmsAmazon DynamoDBAmazon Elastic Compute CloudAmazon RedshiftAmazon S3Amazon Web ServicesAnacondaApache HadoopApache HBaseApache HiveApache KafkaApache OozieApache SparkApplication Performance ManagementAutomationAws Command Line Interface (CLI)AWS GlueBig DataBoto3Business EfficiencyCascading Style Sheets (CSS)CA Workload Automation AeCloud ComputingClouderaCloud ServicesCloudwatchComputer ProgrammingContinuous IntegrationData AnalysisDatabase OptimizationDatabasesData CleansingData IntegrityData ManagementData MappingData MartData MigrationData MiningDataOpsData PipelinesData ProcessingData QualityData StreamingData StructuresData TransformationData VisualizationDecision Making SkillsDelivery of ProjectsEclipse (Software)EcosystemsElectronicsExtract Transform Load (ETL)GitGithubHadoop Distributed File SystemHard Work and DedicationHTMLInformation EngineeringInformation SciencesInfrastructure ManagementInnovationIntelliJ IDEAInternet of ThingsJasperReportsJavaScript (Programming Language)JIRAJSONJupyterJupyter NotebookKnowledge of EngineeringLinuxLog AnalysisMachine LearningMetadataMicrosoft AccessMicrosoft ExcelMicrosoft SQL ServerMicrosoft WindowsMongoDBMySQLOperational Data StoreOperational SystemsOracle ApplicationsPostgreSQLPower BIProgramming LanguagesProgramming ToolsProject ManagementPysparkPython (Programming Language)Query PerformanceRelational DatabasesReliability of SystemsResource ManagementR (Programming Language)Scrum MethodologyShell ScriptSoftware DebuggingSoftware QualitySplunkSQL DatabasesSqoopStreamlineSystem IntegrityTableau (Software)Task ManagementTeam WorkingTelecommunicationsTesting SkillsUnixWeb DevelopmentWorkflows