Senior Developer

Hansen Talent Group

Senior Developer

Columbia, SC
Full Time
Paid
  • Responsibilities

    Hansen Talent Group is seeking a Data Engineer with strong AWS data warehousing experience a great data driven team! This position is open to remote candidates, but could require quarterly travel. A local candidate is preferred.

    The AWS Data Engineer will be involved in all aspects of data engineering from delivery planning, estimating and analysis, all the way through to data architecture and pipeline design, delivery and production implementation

    Duties:

    • Deliver digestible, contemporary and immediate data content to support and drive business decisions
    • Involved in the design and implementation of complex data solutions ranging from batch to streaming and event-driven architectures, across cloud, on-premise and hybrid client technology landscapes
    • Review functional and technical designs to identify areas of risk and/or missing requirements
    • Create ETL processes using PySpark and Scala.
    • Build applications using Python, SQL, Databricks and AWS
    • Contribute to the exploration and understanding of new tools and techniques, and propose improvements to the data pipeline

    Qualifications:

    • 8+ years working with Large Data Lakes as a Data Engineer
    • Hands-on experience with AWS computational technologies, AWS storage, Spark, Scala, Python.