Databricks administrator

United Global Technologies

Databricks administrator

Columbia, SC
Full Time
Paid
  • Responsibilities

    Minimum Required Education: Bachelor's degree-in Computer Science, Information Technology or other job related degree. Degree Equivalency: 4 years of job related work experience or 2 years of job related experience plus an associate’s degree in Computer Science, Information Technology or other job related degree

    Minimum Required Work Experience: 8 years-of application development, systems testing or other job related experience.

    Onsite Requirements: Partially onsite 3 days per week (Tue, Wed, Thurs) and as needed. Standard work hours: 8:30 AM – 5:00 PM No Clearance needed Team Name: aka Data Lake Team

    Required Technologies:

    • 7+ years of technical experience with at least 3 years managing Databricks environments in production at enterprise scale

    • Deep expertise with Databricks Unity Catalog, Delta Lake, Delta Live Tables, SQL Warehouses, and medallion architecture implementations

    • Hands-on experience administering Databricks workspaces, metastores, cluster policies, jobs, and serverless compute

    • Proven ability to design and maintain Infrastructure-as-Code solutions (AWS CloudFormation, CDK, Github Actions, or Similar) for Databricks and AWS resource provisioning

    • Experience integrating Databricks with Azure AD/Entra for identity and access governance

    • Strong Understanding of FinOps practices, including tagging standards, cost analysis, and optimization for cloud compute

    • Working knowledge of data ingestion patterns (batch, streaming, CDC) to support data engineering enablement

    • Strong knowledge of Spark, Python, AWS services (like EC2, S3, IAM, Glue, Cloud Watch) Nice to Have: R R Studio / Posit Workbench R Shiny /Posit Connect Posit Package Manager Amazon Bedrock