Data Scientist
- Hiring Organisation
- Mercor
- Location
- Kettering, Ohio, United States
- Employment Type
- Permanent
- Salary
- USD Annual
# Job Description: AI Task Evaluation & Statistical Analysis Specialist Role Overview We're seeking a data-driven analyst to conduct comprehensive failure analysis on AI agent performance across finance-sector tasks. You'll identify patterns, root causes, and systemic issues in our evaluation framework by analyzing task … performance across multiple dimensions (task types, file types, criteria, etc.). Key Responsibilities - Statistical Failure Analysis : Identify patterns in AI agent failures across task components (prompts, rubrics, templates, file types, tags) - Root Cause Analysis : Determine whether failures stem from task design, rubric clarity, file complexity, or agent limitations