AI Testing Architect

Select Minds LLC

AI Testing Architect

Dallas, TX
Full Time
Paid
  • Responsibilities

    Benefits:

    Competitive salary

    Health insurance

    Opportunity for advancement

    Job Title: AI Testing Architect (GenAI / QA Automation) Work Type: Full-Time/Contract Location: Dallas, Texas Onsite Interview Mode: Virtual + In-Person (depends) Work Auth : Must be authorized to work in the U.S. Domain: Enterprise AI / Agentic AI / AWS Bedrock Compensation: Competitive, commensurate with experience

    We are hiring a senior AI Testing Architect to design and implement AI-driven solutions across software testing and quality engineering. This role focuses on applying Generative AI to improve test coverage, reduce cycle time, and modernize QA practices.

    You will work hands-on with engineering and QA teams while also guiding tooling decisions and adoption approaches. This is a high-impact individual contributor role with ownership of architecture, implementation, and practical AI adoption across testing workflows.

    Key Responsibilities

    • Design and implement AI-driven solutions for test automation, test data generation, and defect detection
    • Build and deploy LLM-based workflows (e.g., test case generation, RAG-based validation, anomaly detection)
    • Evaluate, select, and integrate AI tools and frameworks for QA and SDLC use cases
    • Develop reusable architecture patterns for AI-enabled testing across teams
    • Integrate AI solutions into CI/CD pipelines and existing engineering workflows
    • Collaborate with Engineering, QA, and DevOps teams to drive practical AI adoption
    • Optimize performance, cost, and reliability of AI-based solutions in production
    • Provide technical guidance and hands-on support to engineers adopting AI tools
    • Contribute to lightweight AI governance practices, including data handling, security, and responsible usage

    Required Qualifications

    • 8+ years of experience in software engineering, QA automation, or test architecture
    • 3+ years of hands-on experience with AI/ML or Generative AI in production environments
    • Strong experience with test automation frameworks (Selenium, Playwright, Cypress, PyTest, TestNG)
    • Strong programming skills in Python
    • Experience building or integrating LLM-based solutions (prompting, RAG, embeddings, vector search)
    • Experience integrating solutions into CI/CD pipelines (Jenkins, GitHub Actions, Azure DevOps)
    • Experience with at least one cloud platform (AWS, Azure, or GCP)
    • Strong understanding of software testing principles, QA processes, and SDLC

    Preferred Qualifications

    • Experience with LangChain or LlamaIndex
    • Experience with vector databases (Pinecone, FAISS, Weaviate)
    • Exposure to MLOps practices and model lifecycle management
    • Experience with AI governance, security, or compliance frameworks
    • Prior experience as an AI Architect, Solution Architect, or Principal Engineer
    • Experience working in enterprise-scale environments

    Technical Stack

    • Languages: Python (primary), Java or JavaScript (optional)
    • Testing: Selenium, Playwright, Cypress, PyTest, TestNG
    • AI/GenAI: OpenAI APIs, LangChain or LlamaIndex, embeddings, RAG
    • Data: Vector databases (Pinecone, FAISS, Weaviate)
    • Cloud: AWS, Azure, or GCP
    • CI/CD: Jenkins, GitHub Actions, Azure DevOps

    Success Metrics

    • Reduce regression testing cycle time through AI-driven automation
    • Improve test coverage and defect detection using AI-generated test assets
    • Deliver reusable AI architecture patterns adopted across teams
    • Drive measurable adoption of AI tools within engineering and QA workflows