Sorry, this listing is no longer accepting applications. Don’t worry, we have more awesome opportunities and internships for you.

Cloud Data Engineer L4, KRS Data Platform (AWS)

KRS

Cloud Data Engineer L4, KRS Data Platform (AWS)

Boston, MA +6 locations
Full Time
Paid
  • Responsibilities

    Job Description

    DESCRIPTION

    KRS is a national leader in rewards programs and loyalty solutions. We develop business solutions that make retail operators smarter, more profitable and elevates their entire organization to learn how to anticipate the growing needs of their customers. We empower retail operators to build their brands, optimize retail operations and reward their customers with a suite of marketing automation, multichannel campaign, crm, analytics tools and back-office management systems. As a company, we have high expectations of each other and work as a team to develop things we are all proud of. That mindset, along with our world-class execution, has allowed KRS to develop and implement innovative products and grow into the profitable business it is today.

    THE ROLE

    KRS is seeking a strong technical leader who is responsible for designing and developing cloud scale data lakes. This person will have significant experience ingesting disparate data sources, managing dataflows and processing data into a datalakehouse environment with landing, raw, curated and trusted zones. The person we seek is a strong software engineer, excellent at problem-solving, and a good systems thinker who can work with the disparate systems to deliver a quality data lakehouse for our data analysts.

    WHAT YOU WILL BE DOING?

    • Design and build production data pipelines from ingestion to consumption within a big data architecture using AWS tools such as Spark (PySpark), Glue, Hudi, Kinesis, DMS, EMR and Lambdas to process data.
    • Curating a datalake on S3 with landing, raw, trusted and curated zones.
    • Establishing an AWS Redshift / Redshift Spectrum Data LakeHouse.
    • Automating processes and infrastructure using Python CDK.

    REQUIREMENTS

    • Expert in Apache Spark RDDs and building data frames. Create Spark jobs for data transformation and aggregation.
    • Expert in Glue, PySpark, Kinesis, DMS, EMR and Lambdas
    • Expert in Python
    • Expert in Redshift, Redshift Spectrum
    • Expert in Athena
    • Expert in SQL
    • Experience working with various file formats like Hudi, Parquet, Avro, ORC for large volumes of data.
    • Experience with one or more NoSQL databases such as Cassandra, DocumentDB, DynamoDB is a plus.
    • Solid background in data warehousing, data lakes and the data lakehouse concept.
    • Deep understanding of architecture and functioning of Distributed database systems like Redshift
    • Experience working with Git, Gitflow based workflows and CI/CD
    • Strong understanding of engineering best practices and design principles
    • Experience working in agile environment and iterative development
    • Collaborative mindset and ability to work with distributed, cross-functional teams
    • Solid communication skills and the ability to clearly articulate your point of view
    • Should have excellent communication and presentation, strong analytical and problem-solving skills
    • Ideally 8+ years of data engineering experience is a fast paced company that delivers software

    Company Description

    As a national leader in rewards programs and loyalty solutions, KickBack Rewards Systems develops business solutions that make retail operators smarter, more profitable and helps to elevate their entire organization to learn how to anticipate the growing needs of their customers. With more than 20 years of experience, we’re recognized as the market leader in building rewarding customer experiences that generate brand loyalty, build repeat store visits, and increase bottom-line sales. KickBack Rewards Systems recognizes that to succeed in today’s competitive retail environment, businesses must be armed with accurate, reliable, and intelligent data. Working with retail operators of all sizes–and across all retail channels–KickBack Rewards Systems provides powerful business intelligence that is guaranteed to help you grow business. As a company, we have high expectations of each other and work as a team to develop things we are all proud of. That mindset, along with our world-class execution, has allowed KickBack Rewards Systems to develop and implement innovative products and grow into the profitable business it is today.

  • Locations
    Phoenix, AZ • Los Angeles, CA • Atlanta, GA • Chicago, IL • Boston, MA • Minneapolis, MN • Dallas, TX