Senior Software Engineer (Big Data)

Mastercard

Senior Software Engineer (Big Data)

New York, NY +3 locations
Full Time
Paid
  • Responsibilities

    Our Purpose

    Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.

    Title and Summary

    Senior Software Engineer (Big Data)

    Position Overview
    Have you ever wanted to be part of something BIG?
    Now is the time to make an immediate impact at a leading global technology company, Mastercard.

    Mastercard is seeking a Backend Software Engineer to join the AI&DPE Data Engineering platform team, responsible for building and evolving large scale backend data systems, real time and batch pipelines, and AI enabled services that power analytics, decisioning, and automation across the organization.

    This is a Software Engineer backend engineering role, focused on Scala/Python/Java, distributed data platforms (Cloudera/Spark), and cloud based architectures, with a strong emphasis on AI agent creation and intelligent automation. Visualization tools (e.g., Qlik) are consumers of the platform, not the core focus of this role.

    You will work with massive transactional datasets, modern big data and cloud platforms, and AI driven workflows to transform how Mastercard processes, enriches, and operationalizes data at global scale.

    PRIMARY RESPONSIBILITIES
    Software Engineer Backend with Data Platform Engineering

    Design, develop, and maintain backend services and data pipelines using Scala, Python and Java
    Build and optimize batch and streaming workloads on Cloudera Data Platform (CDP) using Spark
    Work with Cloudera Manager to support platform configuration, monitoring, performance tuning, and operational stability
    Design and implement high quality datamarts and curated datasets with strong emphasis on data integrity, performance, and reliability

    AI Agents & Intelligent Automation

    Design, build, and integrate AI powered agents that operate to support:

    Anomaly detection and operational intelligence
    workflow automation

    Apply generative AI driven, or rule based agents to reduce manual effort and improve scalability across backend systems

    Cloud & Modern Data Architecture

    Build and support data and compute workloads in AWS environments
    Leverage Databricks for large scale data processing, advanced analytics
    Contribute to cloud native and hybrid architectures integrating on prem and cloud platforms

    Integration & Downstream Enablement

    Enable downstream consumers (analytics, visualization, reporting tools such as Qlik) through well designed, reliable backend data interfaces
    Partner with analytics, fraud, and business teams to ensure backend systems meet evolving needs without compromising platform stability

    Documentation & Collaboration

    Create clear technical documentation, including architecture diagrams, data flows, and design specifications
    Participate in Agile/Scrum ceremonies and cross functional design reviews
    Mentor and upskill team members in backend engineering, big data, and AI agent concepts

    KNOWLEDGE AND SKILL REQUIREMENTS
    Required

    BS/BA degree in Computer Science, Engineering, Information Systems, or related field/ related experience.
    Strong hands on experience with Scala, Python/Java in backend or data intensive systems
    Experience working with Cloudera Data Platform (CDP) and Spark
    Familiarity with Cloudera Manager for cluster administration, monitoring, or troubleshooting
    Strong understanding of data modeling concepts, distributed systems, and large scale data processing
    Excellent problem solving skills and ability to work independently in complex environments

    GOOD TO HAVE / STRONGLY PREFERRED

    Hands on experience building, integrating, or supporting AI driven agents or intelligent automation solutions
    Experience with Databricks for data engineering or ML workloads
    Experience working in AWS (e.g., S3, EC2, EMR, Glue, Lambda, IAM, or equivalent services)
    Knowledge of streaming and big-data technologies:
    Kafka
    Hadoop ecosystem
    Hive/Impala
    Exposure to model monitoring, or AI platform enablement
    Experience with ETL tools such as Informatica
    Experience working in Agile / Scrum teams within large enterprises

    Mastercard is a merit-based, inclusive, equal opportunity employer that considers applicants without regard to gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law. We hire the most qualified candidate for the role. In the US or Canada, if you require accommodations or assistance to complete the online application process or during the recruitment process, please contact reasonable_accommodation@mastercard.com and identify the type of accommodation or assistance you are requesting. Do not include any medical or health information in this email. The Reasonable Accommodations team will respond to your email promptly.

    Corporate Security Responsibility

    All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:

    • Abide by Mastercard's security policies and practices;

    • Ensure the confidentiality and integrity of the information being accessed;

    • Report any suspected information security violation or breach, and

    • Complete all periodic mandatory security trainings in accordance with Mastercard's guidelines.

    In line with Mastercard's total compensation philosophy and assuming that the job will be performed in the US, the successful candidate will be offered a competitive base salary and may be eligible for an annual bonus or commissions depending on the role. The base salary offered may vary depending on multiple factors, including but not limited to location, job-related knowledge, skills, and experience. Mastercard benefits for full time (and certain part time) employees generally include: insurance (including medical, prescription drug, dental, vision, disability, life insurance); flexible spending account and health savings account; paid leaves (including 16 weeks of new parent leave and up to 20 days of bereavement leave); 80 hours of Paid Sick and Safe Time, 25 days of vacation time and 5 personal days, pro-rated based on date of hire; 10 annual paid U.S. observed holidays; 401k with a best-in-class company match; deferred compensation for eligible roles; fitness reimbursement or on-site fitness facilities; eligibility for tuition reimbursement; and many more. Mastercard benefits for interns generally include: 56 hours of Paid Sick and Safe Time; jury duty leave; and on-site fitness facilities in some locations.

    Pay Ranges
    O'Fallon, Missouri: $115,000 - $184,000 USD

  • Locations
    O Fallon, MO • New York, NY • Salt Lake City, UT • Arlington, VA