Data Scientist | $120/hr Remote | Mercor

At Crossing Hurdles, we work as a referral partner. We refer candidates to Mercor that collaborates with the world's leading AI research labs to build and train cutting-edge AI models.

Organization: Mercor

Position: Data Scientist

Referral Partner: Crossing Hurdles

Type: Hourly contract

Compensation: $100-$120 per hour

Location: Remote

Duration: 3–4 weeks

Commitment: 10-40 hours/week, flexible and asynchronous

Role Responsibilities (Training support will be provided)

• Conduct statistical failure analysis across finance-sector AI tasks.
• Identify patterns in AI agent performance failures across task components (e.g., prompts, rubrics, templates).
• Perform root cause analysis to determine if failures stem from task design, rubric clarity, or agent limitations.
• Analyze performance variations across finance sub-domains, file types, and task categories.
• Create dashboards and reports highlighting failure clusters, edge cases, and areas for improvement.
• Recommend improvements to task design, rubric structure, and evaluation criteria.
• Communicate insights to data labeling experts and technical teams.

Requirements

• Strong foundation in statistical analysis, hypothesis testing, and pattern recognition.
• Proficiency in Python (pandas, scipy, matplotlib/seaborn) or R for data analysis.
• Experience with exploratory data analysis and deriving actionable insights from complex datasets.
• Familiarity with LLM evaluation methods and quality metrics.
• Comfortable working with Excel, data visualization tools (Tableau/Looker), and SQL.
• Strong relevant experience.

Application Process (Takes 20 min)

• Upload resume.
• AI interview based on your resume (15 min).
• Submit form.