1 of 1 Permanent Observability Jobs in Windsor

other teams build against. Build evaluation frameworks and developer tooling robust enough for production yet simple enough for non-specialist developers to adopt. Establish observability standards for AI systems - quality, performance, cost, and regression signals - and build dashboards and reporting that turn those signals into actionable decisions. Drive engineering rigor … machine translation, or content-generation systems, including metrics such as COMET, chrF++, BLEU, MetricX, and MQM-style human evaluation. Experience with experimentation and observability tooling, data/test-set versioning, and rigorous benchmarking workflows. Established practice in AI governance and documentation - model cards, system cards, reproducibility, and responsible-AI considerations ...