Job Description
The purpose of this job is to serve as an enterprise lead big data architect and exert for data platform architecture, data platforms and data products. Responsible for researching and designing complex data solutions to meet the needs of the organization. Will work with the Architecture Review Board, DnA Hub Team & across IT to define unique and innovative solutions for achieving strategic business goals.
1. Responsible for data architecture, platform and solution design decisions for the enterprise initiatives and large data projects
2. Create detailed architecture diagrams to support the needs of the Architecture Review Board and DnA Hub data projects
3. Lead in the design and implementation of Big Data architecture solutions for various scalable, high availability & fault tolerance applications
4. Stay up to date on new capabilities, technology and trends to identify and influence areas of improvement and best practices
5. Partner with the PMO, Security, Enterprise Architecture and DevOps teams in defining security and process best practices, appropriate software upgrades and integration of those across the data environment
6. Formulate business system architecture plans, estimate costs, and ensure projects meet the strategic needs of the organization
7. Provide technical expertise to guide and mentor fellow team members in your area of expertise
8. Responsible for developing, distributing, supporting, enforcing, and integrating best practices and technology standards across the organization
9. Model behaviors that support the company’s common purpose; ensure guests and team members are supported at the highest level
10. Ensure all activities are in compliance with rules, regulations, policies, and procedures
Complete other duties as assigned
Qualifications
· Master’s degree in computer science, engineering, information technology, or related field required
· Master’s degree in computer science, engineering, information technology, or related field required
· Minimum 10 years’ experience as a lead technical role architecting data warehouses and/or data lakes with Big Data technologies such as Spark, Python and Kafka, cloud platforms like AWS, Azure, etc
· Minimum 5 years’ experience in the design, operationalization and implementation of Big Data pipelines and frameworks to support AI/ML data science cloud based solutions (AWS experience preferred)
· Minimum five years’ database design experience required
· Minimum five years’ data engineering experience required
· Expert knowledge of distributed data processing such as Hadoop ecosystem or Spark
· Expert SQL knowledge and skills required
· Expert knowledge of AWS or similar Big Data platform required
· Experience with Spark/Spark-streaming, Message Que technologies and Python required
· Experience in architectural best practices in building data lakes
· Strong problem solving and troubleshooting skills
· Ability to manage the balance of current and future needs in both design and content
· Excellent analytical skills and the ability to identify solutions to complex data problems
· Project management skills, which include planning, supervising or coordinating the work of others and communicating well with clients
· A passion to stay up-to-date with emerging and new technologies
· Customer service and team oriented
· Self-motivated with a strong attention to detail
· Expert written and verbal communication skills
· Strong problem solving and critical thinking skills
Additional Information
All your information will be kept confidential according to EEO guidelines.
• General office work requiring sitting or standing for long periods of time • Participate in a 24/7 on-call rotation for after hours and weekend production support