AI Evaluation Specialist

External job listingat KR3 Information Systems Inc

Tasks Assess and validate enterprise AI solutions, including OpenAI, LLMs, Generative AI platforms, AI Agents, and RAG-based systems. Evaluate AI quality, accuracy, reliability, safety, s...

External source - not verified5 days agoOpen until: Feb 2, 2027

Salary

Not provided

Location

United States, United States

Employment type

Full time

Workplace

Not provided

AI Evaluation Specialist

United States, United States

Job description

Tasks

  • Assess and validate enterprise AI solutions, including OpenAI, LLMs, Generative AI platforms, AI Agents, and RAG-based systems.
  • Evaluate AI quality, accuracy, reliability, safety, security, privacy, and business readiness for adoption.

Requirements

  • Generative AI & LLM Evaluation
  • AI Testing, QA & Validation Frameworks
  • Prompt Engineering & Hallucination Analysis
  • RAG, AI Agents & Enterprise AI Platforms
  • AI Safety, Responsible AI & Governance
  • Python, SQL, Analytics & Reporting
  • AI Scorecards, Benchmarks & Acceptance Criteria
  • 5+ years of AI/Model Evaluation experience and hands-on expertise in assessing enterprise AI products and solutions.

Schedule

  • Full-time
  • Remote

How to apply

  • Send your updated resume by email or connect directly.

Similar jobs