Job Description

The Senior Data Engineer will serve as a subject matter expert in end-to-end data engineering, focusing on large-scale data solutions. This role involves implementing and optimizing data architectures, designing and managing data pipelines, and leading the development of advanced data solutions, including real-time analytics and machine learning models. The Senior Data Engineer will also mentor junior data engineers and provide technical leadership. The role will collaborate with IT & Business workstreams to develop analytic tools to improve decision making leveraging data.

The duties and responsibilities of this position shall consist of, but not be limited to, the following

Data Engineering and Architecture

• Serve as a subject matter expert in end-to-end data engineering, focusing on large-scale data solutions.
• Implement and optimize data architectures, including data lakes, warehouses, and pipelines, ensuring high performance, scalability, and security.
• Lead the design and implementation of advanced data solutions, including real-time analytics and machine learning models.
• Design, develop, and manage data pipelines and ETL processes to facilitate data flow from multiple sources, ensuring transformation and enrichment for analytics and reporting.
• Write clean, efficient, and optimized code using programming languages such as Python within Microsoft Fabric notebooks for data processing, automation, and custom ETL workflows.
• Use SQL for complex data querying, data manipulation, performance optimization, and database schema management within Microsoft Fabric and Azure environments.
• Develop, deploy, and maintain APIs for data access and integration across platforms, including Microsoft Fabric, SAP Datasphere, and Azure.
• Develop and maintain a metadata-driven data architecture to improve data governance, lineage, and quality
• Mentor and guide junior data engineers, providing technical leadership and fostering a collaborative team environment.

Microsoft Fabric and SAP Datasphere Integration

• Lead the implementation of Microsoft Fabric, ensuring seamless integration with SAP Datasphere and S/4 HANA as part of Jack Links' data strategy.
• Configure and manage Microsoft Fabric components, such as Lakehouse, Data Warehouse, Data Engineering, and Notebooks, to meet complex data processing, storage, and analytical requirements.
• Develop and implement data workflows within Microsoft Fabric, using notebooks for advanced data transformations, optimizing workflows for performance and data quality.
• Utilize Microsoft Fabric’s data connectors to ensure smooth data integration from diverse sources, including SAP Datasphere, S/4 HANA, and Azure.
• Collaborate with Azure administrators and stakeholders to optimize Fabric’s resource usage and performance, aligning with data processing needs.
• Stay updated with new features and best practices in Microsoft Fabric and SAP Datasphere to ensure that Jack Links leverages both platforms effectively.

SAP Technologies and Embedded Analytics

• Integrate SAP Datasphere and S/4 HANA embedded analytics within Microsoft Fabric to enhance enterprise-wide reporting and data insights.
• Manage SAP Datasphere data flows, connecting and orchestrating data from various SAP systems and non-SAP sources for comprehensive analytics.
• Configure and manage SAP Datasphere, ensuring high data quality and consistency across applications, and implement solutions for robust data governance and integration.
• Collaborate with business teams and SAP stakeholders to ensure SAP Datasphere and S/4 HANA data aligns with organizational goals for analytics, insights, and reporting.
• Lead initiatives to enhance data quality, governance, and integration across SAP systems.

Power Platform and Power BI

• Develop and deploy Power Platform solutions (e.g., Power Automate, Power Apps) to streamline data workflows, support automation, and enhance operational efficiency.
• Implement reporting solutions using Power BI, utilizing DAX functions for complex data transformations and Power BI dashboards to provide insights across the organization.
• Lead the development of advanced analytics and reporting solutions using Power BI and other visualization tools.

Qualifications

Required Education:

• Bachelor’s degree in Computer Science, Information Technology, or a related field (or equivalent experience).

Required Experience:

• Minimum 7+ years of proven experience in data engineering, with hands-on experience in Microsoft Fabric, SAP Datasphere, Databricks, and other SAP technologies.
• Strong expertise in SQL and Python for data querying, transformation, and pipeline development.
• Proven experience with data modeling, ETL processes, data warehousing, and handling complex data structures.
• Experience with Power Platform tools (e.g., Power Automate, Power Apps) and Power BI for data visualization and reporting.

Preferred:

• Experience with cloud platforms such as Azure.
• DP-600 certification (Certified Microsoft Fabric Data Engineer) or equivalent certification.
• Familiarity with real-time analytics, machine learning and AI concepts.
• Experience with API lifecycle management, including versioning, security, monitoring, and performance optimization.

Additional Information

The salary range for this role is $119,600 - $164,450 (Annually). Actual salaries will vary based on several factors, including but not limited to external market data, internal equity, location, and candidate skill set and experience. Base pay is just one component of Jack Link’s Total Rewards package for Team Members. Other rewards may include annual incentive and program-specific awards. Jack Link’s provides a variety of benefits to eligible Team Members, including medical, dental and vision benefits, life and disability insurance, 401k participation, paid holidays, and paid time off.

EQUAL EMPLOYMENT OPPORTUNITY EMPLOYER:
Jack Link’s provides equal employment opportunity (EEO) to all persons regardless of age, color, national origin, citizenship status, physical or mental disability, race, religion, creed, gender, sex, sexual orientation, gender identity and/or expression, genetic information, marital status, status with regard to public assistance, veteran status, or any other characteristic that is protected by federal, state or local law.

E-VERIFY:
Jack Link’s is participant in the federal E-Verify program to confirm the identity and employment authorization of all newly hired employees. For information about the E-Verify program, please visit: http://www.uscis.gov/e-verify/employees

All your information will be kept confidential according to EEO guidelines.