Job Description

The purpose of this job is to research, develop, document, and modify extract, transform, load processes and jobs in support of a big data infrastructure, as well as data warehouse (EDW) for Pilot Flying J. 

ESSENTIAL FUNCTIONS:

 1. Research, develop, document, and modify Big Data Lake processes and jobs according to data architecture and modeling requirements, and processes set forth by the senior Business Intelligence (BI) data team members

2. Maintain accountability for completing the key EDW/Big Data Lake project activities; communicate project status and risks to project leader

3. Troubleshoot issues including connection, failed jobs, application errors, server alerts, and space thresholds within predefined service level agreements (SLAs)

4. Proactively maintain and tune SQL code according to EDW and Big Data Lake best practices

5. Review and ensure appropriate documentation for all new development and modifications of the big data processes and jobs

6. Perform unit testing for solutions developed, and ensure integrity and security of institutional data

7. Take technical specifications and complete development of data solutions for analytics

8. Take business specifications for small to medium projects/data requests and create technical specifications, and data models

9. Perform code reviews of work from other team members

10. Mentor junior team members in best practices

11. Model behaviors that support the company’s common purpose; ensure guests and team members are supported at the highest level

12. Ensure all activities are in compliance with rules, regulations, policies, and procedures of the organization

13. Complete other duties as assigned

 TRAVEL AND PHYSICAL REQUIREMENTS:

• Travel less than 10%

• General office work requiring sitting or standing for long periods of time

• Participate in a 24/7 on-call rotation for after-hours and weekend production support

This role is part of our employee referral program!

Qualifications

QUALIFICATIONS:

• Bachelor’s degree in computer science, business administration, information technology, or related field required

• Minimum three years’ experience in technology operations required; five years’ experience preferred

SPECIALIZED KNOWLEDGE: 

• Strong SQL knowledge and skills required

• Familiarity with enterprise AWS cloud environment or similar data platform with an emphasis in EMR and Redshift required 

• Experience with Spark/Spark-streaming, Python required

• Knowledge of Postgres and SQLServer preferred

• Knowledge of ETL tools such as Informatica or Datastage preferred

• PFJ institutional knowledge preferred

COMPETENCIES:

• Excellent analytical skills and the ability to identify solutions to complex data problems

• Ability to communicate and interact effectively with team leadership and different levels of the organization

• Strong customer service skills

• Attention to detail and accuracy

• Strong written and verbal communication skills

• Willingness to learn and embrace new technologies

• Ability to prioritize and execute tasks in a fast-paced and dynamic environment

• Ability to take initiative, work independently and with a team

Additional Information

 TRAVEL AND PHYSICAL REQUIREMENTS:

• Travel less than 10%

• General office work requiring sitting or standing for long periods of time

• Participate in a 24/7 on-call rotation for after-hours and weekend production support

This role is part of our employee referral program!