GenAI Test Automation Engineer

@ PB consulting
PB consultingpbconsulting.com

GenAI Test Automation Engineer

Lake Barcroft, Virginia
Posted 1 day ago

About the job

The company develops AI-powered testing solutions, focusing on automation frameworks, workflows, and quality engineering using Generative AI tools and technologies.

Requirements

  • 5+ years AI development experience
  • Experience with LLM-powered agents
  • Knowledge of AI test automation
  • Familiar with GitHub CI/CD workflows
  • Experience with automation frameworks

Qualifications

  • Strong problem-solving skills
  • Effective communication skills
  • Ability to work in teams
  • Proactive and innovative mindset

Full job description

We are seeking a Senior GenAI Test Automation Engineer with strong experience in AI development, agentic workflows, and intelligent test automation. The ideal candidate will design AI-powered testing solutions, build reusable automation frameworks, and integrate Generative AI capabilities into software quality processes.

Required Qualifications
  • 5+ years of experience in AI development, software engineering, or test automation.
  • Hands-on experience building LLM-powered agents and agentic workflows.
  • Experience using Generative AI tools such as GitHub Copilot and Claude.
  • Strong knowledge of AI-driven test automation, workflow automation, and quality engineering practices.
  • Experience with GitHub platform, CI/CD workflows, and automation pipelines.
Key Responsibilities
  • Design and implement reusable agentic testing frameworks for automated test generation, maintenance, failure analysis, and defect reporting.
  • Develop AI-powered solutions for requirements validation, test case generation, and quality insights.
  • Build automated reporting solutions by aggregating test results, service data, logs, and defect information.
  • Create AI-based quality gates to validate requirements, acceptance criteria, test coverage, and dependencies.
  • Establish test automation standards, templates, and best practices across teams.
Required Technical Skills

GenAI / LLM / Agent Development

  • Experience building LLM-based agents with tool usage, structured outputs, guardrails, and prompt engineering.
  • Experience designing AI workflows for test generation, analysis, and reporting.

Automation & Testing

  • Strong experience with test automation frameworks such as:
    • Karate (API testing, contract testing, data-driven testing)
    • Playwright (UI automation, selectors, parallel execution)
  • Knowledge of test strategy, coverage, regression testing, and defect analysis.

GitHub & DevOps

  • Strong experience with:
    • GitHub Copilot
    • GitHub Actions
    • CI/CD automation
    • Pull request checks and workflow integrations
    • GitHub APIs/webhooks
Preferred Skills
  • Experience with microservices architectures.
  • Experience building AI-assisted engineering tools.
  • Knowledge of cloud platforms, DevOps practices, and Agile methodologies.
Deliverables
  • AI-powered agentic testing automation framework.
  • GenAI-driven reporting and quality insights.
  • Automated quality gates integrated into development workflows.
  • Standardized testing guidelines and reusable templates.

Show full description