robustness with OpenSearch and continuous measurement Implement and maintain large language model (LLM) and agent evaluation and monitoring frameworks, including offline test sets, automated regression checks, relevance and grounding scoring, and production dashboards to continuously improve quality, safety, latency, and cost Engineer secure, reliable integrations with systems bankers rely … improve code quality, delivery speed, and productivity (e.g., code generation/refactoring, unit test creation, documentation), while validating outputs through peer review, automated testing, and secure coding standards Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities ...