Big Data Engineer

Throtle

Big Data Engineer

Red Bank, NJ
Full Time
Paid
  • Responsibilities

    Benefits:

    401(k)

    401(k) matching

    Company parties

    Competitive salary

    Dental insurance

    Flexible schedule

    Free food & snacks

    Health insurance

    Paid time off

    Parental leave

    Training & development

    Vision insurance

    Job Summary

    Please consider joining our technology team at Throtle as a Big Data Developer. In this role, you will be part of the team that is responsible for transforming and maintaining several billion records that make Throtle’s data onboarding solution work. You’ll need to be able to evaluate incoming data, perform specialized hygiene, and standardize it for consumption by multiple processes. You’ll be working in a fast-paced, high volume processing environment where quality and attention to the details are paramount.

    Duties/Responsibilities

    Design and implement data pipelines and transformations using big data technologies such as Spark, Hadoop, and related ecosystems

    Develop and maintain complex SQL queries for data extraction and reporting, and optimize query performance and scalability

    Design and develop software components that integrate with our identity graphs, client data, and keying processes

    Participate in capacity monitoring and planning

    Develop and maintain technical documentation

    Ensure data integrity and quality in development process, including conducting data research and analysis to identify trends and patterns

    Work with cross-functional teams to ensure software systems meet business requirements and are scalable for future growth, including developing predictive models and enhancing data quality

    Position will require that the individual understands all regulations and laws applicable to their assigned roles and responsibilities. Additionally, the individual will be responsible for the development, implementation, and regular maintenance of policies and procedures that govern the work of assigned roles and responsibilities, including compliance with the security requirements of ePHI.

    Required Skill and Abilities

    Experience with large-scale data processing and analytics platforms, including Hadoop, Spark,or related ecosystems

    Knowledge of distributed computing concepts and experience with cloud-based infrastructure

    Experience with fuzzy logic matching and tools

    Experience with AWS infrastructure

    Education and Experience

    4+ years of experience working with Big Data technologies, including, Spark, and SQL databases

    Proficiency in programming languages such as Scala, Java, Python, Shell or a combination thereof

    Expertise in data modeling, database design, and development

    Experience in building and maintaining data transformations (ETL) using SQL, Python, Scala, or Java

    Ability to analyze, troubleshoot and performance tune queries

    Ability to identify problems, and effectively communicate solutions to peers and management

    Strong analytical and problem-solving skills to address complex software and data challenges

    Ability to work effectively with cross-functional teams and communicate technical designs and solutions to non-technical stakeholders

    About Throtle:

    Throtle is a leading identity company trusted by the world’s top brands and agencies located in Red Bank, NJ. At Throtle, we empower brands at scale with true individual-based marketing using a data-centric identity and onboarding approach.

    Throtle is a company that truly values its employees and their work-life balance. We offer a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being:

    Competitive compensation.

    Comprehensive benefits include Medical, Dental, and Vision.

    Life insurance.

    Long-Term Disability

    A generous PTO program.

    A 401k plan supported by a company match.

    Half Day Summer Fridays (close at 1 p.m. Memorial Day to Labor Day).

    Early Fridays (office closes at 3 p.m.).

    Hybrid Schedule (Mondays and Fridays WFH)

    The office is closed between Christmas and New Year.

    Company-sponsored lunch at least 1x a month.

    Professional Development Policy!

    And much MORE!

    Throtle is an equal-opportunity employer that is committed to diversity and inclusion in the workplace. We prohibit discrimination and harassment of any kind based on race, color, sex, religion, sexual orientation, national origin, disability, genetic information, pregnancy, or any other protected characteristic as outlined by federal, state, or local laws.

    Flexible work from home options available.