9 of 9 Permanent Benchmarking Jobs in Lanarkshire

across the lifecycle: experimentation, versioning, CI/CD, deployment, monitoring, and maintenance for models/prompts/agents.Implement robust testing (unit/integration), performance benchmarking (latency/cost), and observability (logging/metrics/tracing) for AI services.Collaborate with cross-functional stakeholders to define requirements, success metrics, and rollout plans ...

orchestration Experience building reusable internal libraries or frameworks that accelerate team delivery and promote engineering consistency Familiarity with advanced LLM evaluation techniques, including automated benchmarking, red-teaming, and latency/cost profiling in production Experience with gRPC and Protobuf-based service design in distributed, high-throughput environments Exposure to platform ...

growth within the UK marketplace Build internal, cross-offering relationships to sell and deliver multi-faceted M&A services Conduct/lead assessment and benchmarking with industry leading practices pertaining to IT management, information security and cybersecurityPerform business requirement studies, evaluate technology options to address business needs, and improve operational ...

ready identity constructs and can leverage AI where useful for reporting and review Drive engineering excellence through design reviews, reference architectures, coding standards, performance benchmarking, and reliability engineering practices as part of existing governance processes Coach and grow engineers, providing technical guidance and fostering a culture of quality, ownership ...

/DL stack (e.g., PyTorch, Hugging Face)Hands-on experience evaluating, fine-tuning, and deploying Large Language ModelsStrong grounding in experimental design, evaluation, and benchmarking of ML systemsAbility to bridge research and engineering: prototypes that become production-ready capabilitiesAwareness of inference cost, performance, and optimisation techniquesStrong communication skills, including translating ...

agent-ready identity constructs and can leverage AI where useful for reporting and reviewDrive engineering excellence through design reviews, reference architectures, coding standards, performance benchmarking, and reliability engineering practices as part of existing governance processesCoach and grow engineers, providing technical guidance and fostering a culture of quality, ownership, and continuous ...

movements, and customer demand signals. Prioritise feature and capability development in alignment with strategy and investment priorities. 3. Competitive Differentiation & Positioning Perform competitive analysis, benchmarking, and positioning activities. Ensure each offering has a clear differentiation narrative backed by assets and proof points. Partner with Sales Enablement to incorporate competitive insights ...

Company DescriptionWork with Us. Change the World.At AECOM, we're delivering a better world. Whether improving your commute, keeping the lights on, providing access to clean water, or transforming skylines, our work helps people and ...

JPMorganChase within the AI/ML Data Platform team, you will be a key technical contributor on LLM inference performance — supporting optimization strategy, benchmarking, and efficiency at scale. You will collaborate closely with senior engineers and engineering leadership to help shape how our platform evolves, ensuring every model we serve … high-impact individual contributor role where your technical contributions will have direct, measurable influence on the firm's AI capabilities.Job ResponsibilitiesExecute systematic benchmarking and performance characterization across production LLM workloads, establishing reproducible baselines, identifying regressions, and quantifying the impact of configuration changes before they reach productionDesign and run quantization experiments ...