2 of 2 Remote Canary Deployment Jobs

benchmarks, and customer deployments CI/CD & Release Engineering Design and maintain CI/CD pipelines across backend, infrastructure, and ML components Implement safe deployment strategies (e.g. blue/green, canary releases) Partner with engineers to improve build speed, test reliability, and deployment confidence Observability, Reliability ...

approved content stores. Establish offline/online evaluation frameworks (accuracy, safety, faithfulness, latency, cost), create test datasets, and run A/B or canary experiments. Monitor production behavior, analyze conversations, and iterate on prompts and retrieval strategies to improve outcomes. Enforce content safety, PII handling, data privacy ...