AI Evaluation Researcher | $60/hr Remote

Position: VBT Task AuthorType: Short-Term ContractCompensation: $10 per hourLocation: RemoteCommitment: 10-40 hrs/week
Role ResponsibilitiesInvestigate hard-to-find facts and verify information through credible sources.Design challenging research tasks to test AI models.Test AI model outputs and identify failures in search and reasoning.Analyze model search trajectories, source selection, and reasoning failures.Write clear benchmark prompts and accurate, primary-source-backed answer keys.
RequirementsPossess strong relevant experience in investigative research, fact-checking, AI benchmark authoring, red-teaming, or technical QA.Have experience using AI benchmarks such as GAIA, BrowseComp, SimpleQA, SWE-bench, Terminal-Bench, or Humanity s Last Exam.Demonstrate strong web research and OSINT skills, including navigating academic archives, local records, and specialized databases.Capable of strong analysis of model search trajectories and failures.Strong writing skills to craft clear and accurate benchmark tasks.
Application ProcessApply via Easy ApplyCheck email for next steps