AI Data Science Domain Expert

About the role

Confidential is seeking an AI Data Science Domain Expert to review and refine AI-generated content and data outputs using domain knowledge and project-specific rubrics. The role involves prompt development, model evaluation, research, data quality, and clear reporting.

Responsibilities

• Review, edit, and refine AI-generated content and data outputs for accuracy, clarity, and relevance.
• Develop and optimize prompts to guide AI models toward desired outputs.
• Evaluate AI model performance using rubrics and provide structured feedback and suggestions.
• Conduct research to validate facts, enhance data quality, and support content evaluation.
• Annotate data, fact-check outputs, and ensure adherence to analytic standards.
• Interpret and summarize complex datasets or findings in actionable reports and technical summaries.
• Collaborate asynchronously with project leads and other domain experts to share insights and best practices.

Requirements

• Professional experience in Data Science, Machine Learning, Applied AI, Statistics, Quantitative Analytics, or Data Analytics.
• Experience producing or reviewing research papers, analytical reports, experiment summaries, notebooks, or technical documentation.
• Strong analytical reasoning, critical thinking, attention to detail, and professional writing and communication skills.
• Experience with data annotation, content review, or rubric-based evaluation is highly desirable.
• Background in prompt engineering, AI output evaluation, fact-checking, or RLHF (Reinforcement Learning from Human Feedback) is preferred.

Key facts

• Role type: Contractor (Part-Time).
• The source lists 15+ openings.
• Preferred experience includes Data Science, Machine Learning, Applied AI, Statistics, Quantitative Analytics, or Data Analytics.