Python AI Engineer
Aviso de fuente externaen XChange Software Inc
AI/ML Engineer to build and scale automated evaluation systems for enterprise GenAI agents. The role focuses on LLM evaluations, LLM-as-a-Judge, agent trajectory testing, distributed infe...
Salario
No especificado
Ubicación
Mexico City, México
Tipo de empleo
Tiempo completo
Modalidad
No especificado
Python AI Engineer
Mexico City, México
Descripción del empleo
AI/ML Engineer to build and scale automated evaluation systems for enterprise GenAI agents. The role focuses on LLM evaluations, LLM-as-a-Judge, agent trajectory testing, distributed inference pipelines, MCP telemetry, CI/CD regression gates, and data governance.Key Requirements:Strong Python and distributed systems expertiseExperience with GenAI/LLM evaluation, prompt engineering, and telemetryLLM-as-a-Judge and IRR/Kappa knowledgeGoogle ADK, MCP, RPC/Protobuf experienceAsync processing, Pub/Sub, retries, and scalable pipelinesAgent/tool-calling and multi-turn trajectory testingCI/CD integration and sandboxed testingETL, JSON telemetry, analytics dashboardsPII masking, security, and data retention experience