Sorry, this listing is no longer accepting applications. Don’t worry, we have more awesome opportunities and internships for you.

Data Engineer (Must have professional experience with Spark and Python)

Luth Research

Data Engineer (Must have professional experience with Spark and Python)

San Diego, CA
Paid
  • Responsibilities

    Job Description

    Luth Research seeks a Data Engineer that directly support the organization’s business goals of growth, profitability, accuracy, and quality through developing repeatable, documented, and data-oriented engineering solutions that provide growth and scalability via automation, process improvements, or other similar means. The Data Engineer will be working in a fast paced and demanding environment and will report directly to the VP of Online Operations. If you have experience as a Data Engineer and are interested in working collaboratively in a growth environment, apply to become part of our dedicated team today.

    ESSENTIAL JOB FUNCTIONS AND RESPONSIBILITIES:

    • Develop code to support assigned projects and core company initiatives in a clear, concise, and object oriented way containing comments and following standard software development principles/procedures in order to achieve maximum business growth, scalability, profitability, and accuracy.
    • Work with Management, Development, and Data teams to develop, architect, implement, and deploy systems and processes supporting company goals related to business growth, scalability, profitability, and accuracy.
    • Build QA checks and planning into the development process and actively work with management, data, and QA teams in ensuring all releases are bug free and ensures quality and usability across the organization to drive growth and profitability.
    • Support Management in creating technical documentation and test plans to ensure features are documented and progress is communicated clearly and concisely across the organization to ensure cohesion and maximum effectiveness in testing, launching, and understanding newly developed/enhanced products and services in order to increase client satisfaction, revenue, and profitability.
    • Actively participate in discussions with Management, Development, and Data teams to provide suggestions on direction and architecture of upcoming projects to ensure the team is communicating with each other in a professional matter in order to promote cohesion, comprehension, and a clear goal to work towards which would lead to increased productivity, profitability, accuracy, and growth.
    • Work effectively across various data systems (i.e., OLTP databases, Data warehouses, HDFS, etc) using specific programming languages (i.e., Python, SQL and SPARK) to best support the team and provide efficient and productive strategies to ensure quality, accuracy, growth and profitability.
    • Define data quality plans to address data quality issues; work with business users to build business understanding of data issues to promote accuracy, communication, and client satisfaction along with increased revenue, growth, and profitability.
    • Create well-written, clear, concise and accurate document artifacts including functional specifications, mapping documents process diagrams test plans and test scripts for the purposes of data warehouse construction, report development, verification etc. to allow for consistency and proficiency within the organization promoting speediness, growth, and profitability.
    • Practice and demonstrate exemplary work ethics, self-motivation in learning and taking on new challenges to support sales for the company to strengthen team culture and promote growth and profitability.
    • Any special projects as requested by senior management that would aid the company in efforts to support one another as a team, provide customer satisfaction in a timely fashion, and generate growth and profitability.

    OTHER JOB FUNCTIONS AND RESPONSIBILITIES:

    • COMMITMENT: Knowledgeable about market research, dedicated to the goals of the company while promoting a positive culture to ensure good relationships, overall satisfaction and profitability. 
    • ACCESSIBILITY: Must be able to access and function within areas key to productivity. Adequate manual dexterity to operate assigned and shared office equipment. Ability to travel on periodic overnight and extended stays, and work extended hours when necessary.
    • COMMUNICATIONS: Must speak clearly and fluently to communicate on a wide range of topics. Above average reading comprehension, and grammatically correct written communication skills. Must have the ability to understand and respond intelligently to business correspondence. Interpersonal skills as needed to persuade, manage conflict, debate and negotiate. Response to pressure should be calm and reasonable. 
    • TECHNICAL: Must demonstrate a high proficiency in understanding and working with basic software and computer skills, to include Microsoft Outlook, Excel, PowerPoint and Word.
    • JUDGMENT: Comprehension of job requirements and procedures. Can initiate and perform work assignments under minimal supervision that may be broad, varied, and complex in nature. Employee must have the ability to use educated and intuitive judgment to make decisions.
    • FLEXIBILITY: Must be able to work in a shifting environment with ability to juggle and prioritize multiple, competing tasks and demands and to seek supervisory assistance as appropriate.
    • ANALYSIS: Mathematical aptitude; use of numeric calculations for accuracy of reports and tasks.  
    • ORGANIZATION: Organizational and time management skills sufficient to plan and accomplish assigned goals. 
    • LOGIC: Deductive reasoning ability to enable the appropriate application of general concepts to specific situations. Able to translate theory into business practices. Employee must apply experience, skills and information to identify problems and plan strategic resolutions.
    • WORK ETHICS: Must be willing to work hard, be dependable and responsible, possess a positive attitude and maintain a sense of honesty and integrity. 
    • CORE VALUES: Luth Research and its employees are committed to our Core Values; Passionate and Driven * Delivering Excellence * Embracing and Driving Change * Career Growth and Development * Keeping it fun.
  • Qualifications

    Qualifications

    EDUCATION, EXPERIENCE & SKILLS:

    • BS or comparable work experience.
    • 2-3 years of experience in IT as an Engineer, Analyst, or SQL Developer using SQL, Spark, and Python.
    • Familiarity with core technology required: Hadoop/HDFS, CLIs such as Bash, SQL, Spark, and Python.
    • Solid understanding of SQL, stored procedures and ad-hoc query development in Postgres environments:
    1. UNION, INTERSECT, EXCEPT clauses.
    2. Nested SQL queries.
    3. Windowing queries (postgres has a distinct flavor).
    4. Pivot queries (crosstab function).
    5. INNER, LEFT, and OUTER JOINs.
    6. EXPLAIN and how to interpret query plans.
    7. Compound indexes and query optimization for compound indexes.
    8. Data loading and dumping.
    9. Foreign key constraints as they relate to data manipulation.
    10. Hashing for id generation.
    11. Understanding of triggers and functions.
    • Ability to write requirements to extract data from existing databases, develop transformation rules based on business requirements gathered from non-technical people and test them.
    • Comprehensive understanding of relational databases and the data in them.
    • Conceptual understanding of OLTP vs Data Warehousing.
    • Experience with Data Conversions, Data Profiling and Root Cause Analysis a plus.
    • Understanding of digital media analytics and reporting is a plus.
    • An understanding of Business Objects, Tableau, Excel pivot tables is a plus.
    • Demonstrates an ability to think outside the box and take initiative upon themselves in order to solve problems as they arise.
    • Flexibility in hours including some evening and weekend hours.

    Luth Research is committed to the principles of Equal Employment Opportunities and to making employment decisions based on merit and value. We will comply with all Federal, State and Local laws providing Equal Employment Opportunities, as well as all laws related to terms and conditions of employment.

    Additional Information

    All your information will be kept confidential according to EEO guidelines.