426 to 450 of 559 Remote Microsoft Certified Professional Jobs

AI Agent Evaluation Engineer - Remote

Hiring Organisation
YO AI Labs
Location
Detroit, Michigan, United States
Employment Type
Permanent
Salary
USD Annual
support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context Protocol (MCP) tools. You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization . … refactoring, and performance optimization . Build deterministic verification systems and golden reference solutions. Evaluate AI agents' ability to reason through complex codebases and use MCP tools effectively. Develop realistic, reproducible software engineering scenarios. Ensure tasks accurately measure coding ability, problem-solving, and tool usage. Document solutions and provide clear technical ...

AI Agent Evaluation Engineer - Remote

Hiring Organisation
YO AI Labs
Location
Baltimore, Maryland, United States
Employment Type
Permanent
Salary
USD Annual
support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context Protocol (MCP) tools. You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization . … refactoring, and performance optimization . Build deterministic verification systems and golden reference solutions. Evaluate AI agents' ability to reason through complex codebases and use MCP tools effectively. Develop realistic, reproducible software engineering scenarios. Ensure tasks accurately measure coding ability, problem-solving, and tool usage. Document solutions and provide clear technical ...

AI Agent Evaluation Engineer - Remote

Hiring Organisation
YO AI Labs
Location
Omaha, Nebraska, United States
Employment Type
Permanent
Salary
USD Annual
support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context Protocol (MCP) tools. You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization . … refactoring, and performance optimization . Build deterministic verification systems and golden reference solutions. Evaluate AI agents' ability to reason through complex codebases and use MCP tools effectively. Develop realistic, reproducible software engineering scenarios. Ensure tasks accurately measure coding ability, problem-solving, and tool usage. Document solutions and provide clear technical ...

AI Agent Evaluation Engineer - Remote

Hiring Organisation
YO AI Labs
Location
Denver, Colorado, United States
Employment Type
Permanent
Salary
USD Annual
support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context Protocol (MCP) tools. You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization . … refactoring, and performance optimization . Build deterministic verification systems and golden reference solutions. Evaluate AI agents' ability to reason through complex codebases and use MCP tools effectively. Develop realistic, reproducible software engineering scenarios. Ensure tasks accurately measure coding ability, problem-solving, and tool usage. Document solutions and provide clear technical ...

AI Agent Evaluation Engineer - Remote

Hiring Organisation
YO AI Labs
Location
Indianapolis, Indiana, United States
Employment Type
Permanent
Salary
USD Annual
support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context Protocol (MCP) tools. You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization . … refactoring, and performance optimization . Build deterministic verification systems and golden reference solutions. Evaluate AI agents' ability to reason through complex codebases and use MCP tools effectively. Develop realistic, reproducible software engineering scenarios. Ensure tasks accurately measure coding ability, problem-solving, and tool usage. Document solutions and provide clear technical ...

AI Agent Evaluation Engineer - Remote

Hiring Organisation
YO AI Labs
Location
Milwaukee, Wisconsin, United States
Employment Type
Permanent
Salary
USD Annual
support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context Protocol (MCP) tools. You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization . … refactoring, and performance optimization . Build deterministic verification systems and golden reference solutions. Evaluate AI agents' ability to reason through complex codebases and use MCP tools effectively. Develop realistic, reproducible software engineering scenarios. Ensure tasks accurately measure coding ability, problem-solving, and tool usage. Document solutions and provide clear technical ...

AI Agent Evaluation Engineer - Remote

Hiring Organisation
YO AI Labs
Location
Cincinnati, Ohio, United States
Employment Type
Permanent
Salary
USD Annual
support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context Protocol (MCP) tools. You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization . … refactoring, and performance optimization . Build deterministic verification systems and golden reference solutions. Evaluate AI agents' ability to reason through complex codebases and use MCP tools effectively. Develop realistic, reproducible software engineering scenarios. Ensure tasks accurately measure coding ability, problem-solving, and tool usage. Document solutions and provide clear technical ...

AI Agent Evaluation Engineer - Remote

Hiring Organisation
YO AI Labs
Location
Portland, Oregon, United States
Employment Type
Permanent
Salary
USD Annual
support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context Protocol (MCP) tools. You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization . … refactoring, and performance optimization . Build deterministic verification systems and golden reference solutions. Evaluate AI agents' ability to reason through complex codebases and use MCP tools effectively. Develop realistic, reproducible software engineering scenarios. Ensure tasks accurately measure coding ability, problem-solving, and tool usage. Document solutions and provide clear technical ...

AI Agent Evaluation Engineer - Remote

Hiring Organisation
YO AI Labs
Location
Atlanta, Georgia, United States
Employment Type
Permanent
Salary
USD Annual
support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context Protocol (MCP) tools. You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization . … refactoring, and performance optimization . Build deterministic verification systems and golden reference solutions. Evaluate AI agents' ability to reason through complex codebases and use MCP tools effectively. Develop realistic, reproducible software engineering scenarios. Ensure tasks accurately measure coding ability, problem-solving, and tool usage. Document solutions and provide clear technical ...

AI Agent Evaluation Engineer - Remote

Hiring Organisation
YO AI Labs
Location
Louisville, Kentucky, United States
Employment Type
Permanent
Salary
USD Annual
support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context Protocol (MCP) tools. You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization . … refactoring, and performance optimization . Build deterministic verification systems and golden reference solutions. Evaluate AI agents' ability to reason through complex codebases and use MCP tools effectively. Develop realistic, reproducible software engineering scenarios. Ensure tasks accurately measure coding ability, problem-solving, and tool usage. Document solutions and provide clear technical ...

AI Agent Evaluation Engineer - Remote

Hiring Organisation
YO AI Labs
Location
Boston, Massachusetts, United States
Employment Type
Permanent
Salary
USD Annual
support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context Protocol (MCP) tools. You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization . … refactoring, and performance optimization . Build deterministic verification systems and golden reference solutions. Evaluate AI agents' ability to reason through complex codebases and use MCP tools effectively. Develop realistic, reproducible software engineering scenarios. Ensure tasks accurately measure coding ability, problem-solving, and tool usage. Document solutions and provide clear technical ...

AI Agent Evaluation Engineer - Remote

Hiring Organisation
YO AI Labs
Location
Miami, Florida, United States
Employment Type
Permanent
Salary
USD Annual
support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context Protocol (MCP) tools. You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization . … refactoring, and performance optimization . Build deterministic verification systems and golden reference solutions. Evaluate AI agents' ability to reason through complex codebases and use MCP tools effectively. Develop realistic, reproducible software engineering scenarios. Ensure tasks accurately measure coding ability, problem-solving, and tool usage. Document solutions and provide clear technical ...

AI Agent Evaluation Engineer - Remote

Hiring Organisation
YO AI Labs
Location
Pittsburgh, Pennsylvania, United States
Employment Type
Permanent
Salary
USD Annual
support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context Protocol (MCP) tools. You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization . … refactoring, and performance optimization . Build deterministic verification systems and golden reference solutions. Evaluate AI agents' ability to reason through complex codebases and use MCP tools effectively. Develop realistic, reproducible software engineering scenarios. Ensure tasks accurately measure coding ability, problem-solving, and tool usage. Document solutions and provide clear technical ...

AI Agent Evaluation Engineer - Remote

Hiring Organisation
YO AI Labs
Location
Oklahoma City, Oklahoma, United States
Employment Type
Permanent
Salary
USD Annual
support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context Protocol (MCP) tools. You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization . … refactoring, and performance optimization . Build deterministic verification systems and golden reference solutions. Evaluate AI agents' ability to reason through complex codebases and use MCP tools effectively. Develop realistic, reproducible software engineering scenarios. Ensure tasks accurately measure coding ability, problem-solving, and tool usage. Document solutions and provide clear technical ...

AI Agent Evaluation Engineer - Remote

Hiring Organisation
YO AI Labs
Location
Dallas, Texas, United States
Employment Type
Permanent
Salary
USD Annual
support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context Protocol (MCP) tools. You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization . … refactoring, and performance optimization . Build deterministic verification systems and golden reference solutions. Evaluate AI agents' ability to reason through complex codebases and use MCP tools effectively. Develop realistic, reproducible software engineering scenarios. Ensure tasks accurately measure coding ability, problem-solving, and tool usage. Document solutions and provide clear technical ...

AI Agent Evaluation Engineer - Remote

Hiring Organisation
YO AI Labs
Location
Chicago, Illinois, United States
Employment Type
Permanent
Salary
USD Annual
support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context Protocol (MCP) tools. You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization . … refactoring, and performance optimization . Build deterministic verification systems and golden reference solutions. Evaluate AI agents' ability to reason through complex codebases and use MCP tools effectively. Develop realistic, reproducible software engineering scenarios. Ensure tasks accurately measure coding ability, problem-solving, and tool usage. Document solutions and provide clear technical ...

AI Agent Evaluation Engineer - Remote

Hiring Organisation
YO AI Labs
Location
Washington, Washington DC, United States
Employment Type
Permanent
Salary
USD Annual
support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context Protocol (MCP) tools. You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization . … refactoring, and performance optimization . Build deterministic verification systems and golden reference solutions. Evaluate AI agents' ability to reason through complex codebases and use MCP tools effectively. Develop realistic, reproducible software engineering scenarios. Ensure tasks accurately measure coding ability, problem-solving, and tool usage. Document solutions and provide clear technical ...

AI Agent Evaluation Engineer - Remote

Hiring Organisation
YO AI Labs
Location
Memphis, Tennessee, United States
Employment Type
Permanent
Salary
USD Annual
support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context Protocol (MCP) tools. You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization . … refactoring, and performance optimization . Build deterministic verification systems and golden reference solutions. Evaluate AI agents' ability to reason through complex codebases and use MCP tools effectively. Develop realistic, reproducible software engineering scenarios. Ensure tasks accurately measure coding ability, problem-solving, and tool usage. Document solutions and provide clear technical ...

AI Agent Evaluation Engineer - Remote

Hiring Organisation
YO AI Labs
Location
Richmond, Virginia, United States
Employment Type
Permanent
Salary
USD Annual
support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context Protocol (MCP) tools. You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization . … refactoring, and performance optimization . Build deterministic verification systems and golden reference solutions. Evaluate AI agents' ability to reason through complex codebases and use MCP tools effectively. Develop realistic, reproducible software engineering scenarios. Ensure tasks accurately measure coding ability, problem-solving, and tool usage. Document solutions and provide clear technical ...

AI Agent Evaluation Engineer - Remote

Hiring Organisation
YO AI Labs
Location
Wichita, Kansas, United States
Employment Type
Permanent
Salary
USD Annual
support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context Protocol (MCP) tools. You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization . … refactoring, and performance optimization . Build deterministic verification systems and golden reference solutions. Evaluate AI agents' ability to reason through complex codebases and use MCP tools effectively. Develop realistic, reproducible software engineering scenarios. Ensure tasks accurately measure coding ability, problem-solving, and tool usage. Document solutions and provide clear technical ...

AI Agent Evaluation Engineer - Remote

Hiring Organisation
YO AI Labs
Location
Hartford, Connecticut, United States
Employment Type
Permanent
Salary
USD Annual
support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context Protocol (MCP) tools. You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization . … refactoring, and performance optimization . Build deterministic verification systems and golden reference solutions. Evaluate AI agents' ability to reason through complex codebases and use MCP tools effectively. Develop realistic, reproducible software engineering scenarios. Ensure tasks accurately measure coding ability, problem-solving, and tool usage. Document solutions and provide clear technical ...

AI Agent Evaluation Engineer - Remote

Hiring Organisation
YO AI Labs
Location
Columbia, Missouri, United States
Employment Type
Permanent
Salary
USD Annual
support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context Protocol (MCP) tools. You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization . … refactoring, and performance optimization . Build deterministic verification systems and golden reference solutions. Evaluate AI agents' ability to reason through complex codebases and use MCP tools effectively. Develop realistic, reproducible software engineering scenarios. Ensure tasks accurately measure coding ability, problem-solving, and tool usage. Document solutions and provide clear technical ...

AI Agent Evaluation Engineer - Remote

Hiring Organisation
YO AI Labs
Location
Minneapolis, Minnesota, United States
Employment Type
Permanent
Salary
USD Annual
support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context Protocol (MCP) tools. You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization . … refactoring, and performance optimization . Build deterministic verification systems and golden reference solutions. Evaluate AI agents' ability to reason through complex codebases and use MCP tools effectively. Develop realistic, reproducible software engineering scenarios. Ensure tasks accurately measure coding ability, problem-solving, and tool usage. Document solutions and provide clear technical ...

AI Agent Evaluation Engineer - Remote

Hiring Organisation
YO AI Labs
Location
Honolulu, Hawaii, United States
Employment Type
Permanent
Salary
USD Annual
support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context Protocol (MCP) tools. You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization . … refactoring, and performance optimization . Build deterministic verification systems and golden reference solutions. Evaluate AI agents' ability to reason through complex codebases and use MCP tools effectively. Develop realistic, reproducible software engineering scenarios. Ensure tasks accurately measure coding ability, problem-solving, and tool usage. Document solutions and provide clear technical ...

AI Agent Evaluation Engineer - Remote

Hiring Organisation
YO AI Labs
Location
Birmingham, Alabama, United States
Employment Type
Permanent
Salary
USD Annual
support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context Protocol (MCP) tools. You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization . … refactoring, and performance optimization . Build deterministic verification systems and golden reference solutions. Evaluate AI agents' ability to reason through complex codebases and use MCP tools effectively. Develop realistic, reproducible software engineering scenarios. Ensure tasks accurately measure coding ability, problem-solving, and tool usage. Document solutions and provide clear technical ...