Automation QA Engineer – Generative AI

External job listingat RMS IT Solutions Inc.

Automation QA Engineer – Generative AI. Remote. Travel to Atlanta, GA, once a month. Send your resume by email.

External source - not verified5 weeks agoOpen until: Jan 14, 2027

Salary

Not provided

Location

United States, United States

Employment type

Full time

Workplace

Not provided

Automation QA Engineer – Generative AI

United States, United States

Job description

Tasks

  • Validate AI-generated responses for relevance, accuracy, completeness, and consistency.
  • Evaluate hallucination rates, grounding accuracy, latency, and context retention.
  • Test safety compliance and response consistency.
  • Define acceptance criteria for AI-generated content.

Requirements

  • Strong expertise in Playwright and modern test automation practices.
  • Hands-on experience in automation testing of GenAI-based applications.
  • Experience with automated AI evaluation frameworks and quality scorecards.

Schedule

  • Remote
  • Candidates must be willing to travel to Atlanta, GA, once a month

How to apply

  • Send over your resume by email.
  • Check daily new open jobs at the website.

Location

  • Atlanta, GA

Similar jobs