1 to 25 of 37 LangSmith Jobs in the UK

project management skills in Agile environments Experience with any of the following is advantageous: agentic frameworks (e.g., LangChain, LlamaIndex), deep learning frameworks, Langfuse, Langsmith, MCP (Model Context Protocol), bias mitigation techniques #J-18808-Ljbffr ...

/CD, and Infrastructure as Code. Proficiency with GitHub Actions, GitLab, and Jenkins. Knowledge of LLMOps and MLOps, model governance, AI security and guardrails, LangSmith, Arize, and monitoring and evaluation frameworks. Master's degree in Computer Science, AI, Data Science, or related discipline preferred. AWS Solutions Architect Professional certification preferred. ...

desired skills Knowledge of vector databases and retrieval strategies. Experience with recommender systems and ranking models. Familiarity with LLM evaluation tools (e.g., RAGAS, TruLens, LangSmith, Arize). A working understanding of cloud networking and platform infrastructure. Experience in e‐commerce or retail environments. Why join us? Be a part ...

Protocol (MCP)• Evaluation engineering (golden datasets, regression gates in CI, LLM-judge calibration)• Guardrail and AI-observability tooling (e.g. NeMo Guardrails, OpenTelemetry GenAI conventions, LangSmith, Braintrust)MLOps & LLMOps• Hands-on with MLOps platforms (Azure ML, Databricks, SageMaker) and vector/retrieval databases (Pinecone, Milvus, pgvector)• Experience with GPU-accelerated infrastructure ...

Docker Compose.* Infrastructure as Code: Proficiency with Terraform or equivalent.* Evaluation and Monitoring: Experience with evaluation-driven development and LLM observability tooling such as Langsmith, Langfuse, Braintrust, or similar.* CI/CD: Comfortable owning pipelines end to end (GitHub Actions, GitLab CI, Jenkins).* Database Management: Experience with vector databases ...

Docker Compose.* Infrastructure as Code: Proficiency with Terraform or equivalent.* Evaluation and Monitoring: Experience with evaluation-driven development and LLM observability tooling such as Langsmith, Langfuse, Braintrust, or similar.* CI/CD: Comfortable owning pipelines end to end (GitHub Actions, GitLab CI, Jenkins).* Database Management: Experience with vector databases ...

Docker Compose.* Infrastructure as Code: Proficiency with Terraform or equivalent.* Evaluation and Monitoring: Experience with evaluation-driven development and LLM observability tooling such as Langsmith, Langfuse, Braintrust, or similar.* CI/CD: Comfortable owning pipelines end to end (GitHub Actions, GitLab CI, Jenkins).* Database Management: Experience with vector databases ...

SDKs or similar), and an informed view of when to use them and when not Experience with evaluation and observability tooling such as MLflow, LangSmith or Arize Experience configuring agentic coding assistants for a team, with shared instructions, skills and workflows Solid grounding in machine learning and NLP: able ...

modular architecture, TDD, code quality tools. · AI Engineering (Desirable): RAG pipelines, agentic workflows, MCP, LLM integration (OpenAI, Gemini or other models from Huggingface), LangSmith, TruLens. Agentic Frameworks (Desirable): LangChain, CrewAI, Autogen, OpenAI Agents, Google ADK. WHAT YOU'LL LOVE ABOUT WORKING HERE We’re a fantastic team of bright, ambitious ...

modular architecture, TDD, code quality tools. · AI Engineering (Desirable): RAG pipelines, agentic workflows, MCP, LLM integration (OpenAI, Gemini or other models from Huggingface), LangSmith, TruLens.* Agentic Frameworks (Desirable): LangChain, CrewAI, Autogen, OpenAI Agents, Google ADK.## **WHAT YOU'LL LOVE ABOUT WORKING HERE**We’re a fantastic team of bright, ambitious ...

modular architecture, TDD, code quality tools. · AI Engineering (Desirable): RAG pipelines, agentic workflows, MCP, LLM integration (OpenAI, Gemini or other models from Huggingface), LangSmith, TruLens.* Agentic Frameworks (Desirable): LangChain, CrewAI, Autogen, OpenAI Agents, Google ADK.## **WHAT YOU'LL LOVE ABOUT WORKING HERE**We’re a fantastic team of bright, ambitious ...

modular architecture, TDD, code quality tools. · AI Engineering (Desirable): RAG pipelines, agentic workflows, MCP, LLM integration (OpenAI, Gemini or other models from Huggingface), LangSmith, TruLens.* Agentic Frameworks (Desirable): LangChain, CrewAI, Autogen, OpenAI Agents, Google ADK.## **WHAT YOU'LL LOVE ABOUT WORKING HERE**We’re a fantastic team of bright, ambitious ...

MLflow, Weights & Biases, Data Version Control) Experience developing LLM/GenAI applications, including prompt engineering and RAG architectures Familiarity with LLMOps tooling such as LangSmith, LangChain, or LangGraph Understanding of model evaluation, validation techniques, and production monitoring Experience working in cross-functional teams from problem framing through to production delivery ...

MLflow, Weights & Biases, Data Version Control) Experience developing LLM/GenAI applications, including prompt engineering and RAG architectures Familiarity with LLMOps tooling such as LangSmith, LangChain, or LangGraph Understanding of model evaluation, validation techniques, and production monitoring Experience working in cross-functional teams from problem framing through to production delivery ...

MLflow, Weights & Biases, Data Version Control) Experience developing LLM/GenAI applications, including prompt engineering and RAG architectures Familiarity with LLMOps tooling such as LangSmith, LangChain, or LangGraph Understanding of model evaluation, validation techniques, and production monitoring Experience working in cross-functional teams from problem framing through to production delivery ...

applications to enterprise data, tools, and services Apply experience with LLM observability and evaluation standards or platforms such as OpenTelemetry, OpenInference, Arize Phoenix, LangSmith, or equivalent, including traces across model, retrieval, and tool-execution steps Show familiarity with knowledge graphs, multimodal models, fine‐tuning, synthetic data, or advanced model‐evaluation ...

source models — with fallback routing, token, cost, and latency management Implement LLMOps in production: eval harnesses with real quality metrics, prompt versioning, observability tooling (LangSmith, Braintrust, or equivalent), cost and safety monitoring Embed directly with client engineering teams to analyse the SDLC to identify AI/agentic opportunities ...

preferable to prompt engineering or RAG Experience with real‐time streaming, multimodal models, or search technologies like Elasticsearch Familiarity with model observability tools (LangSmith, Weights & Biases) and cost optimization strategies Experience in specialized verticals (financial services, energy, healthcare, legal, retail) with understanding of compliance, security, and responsible AI practices Experience ...

source models — with fallback routing, token, cost, and latency management Implement LLMOps in production: eval harnesses with real quality metrics, prompt versioning, observability tooling (LangSmith, Braintrust, or equivalent), cost and safety monitoring Embed directly with client engineering teams to analyse the SDLC to identify AI/agentic opportunities ...

source models with fallback routing, token, cost, and latency management Implement LLMOps in production: eval harnesses with real quality metrics, prompt versioning, observability tooling (LangSmith, Braintrust, or equivalent), cost and safety monitoring Embed directly with client engineering teams to analyse the SDLC to identify AI/agentic opportunities ...

hands‐on, and experience in a regulated environment (auditability, explainability, model risk, data residency) Experience with LLM evaluation and observability tooling, for example Langfuse, LangSmith, or OpenTelemetry Benefits 28 days annual leave plus bank holidays Hybrid model where employees work a minimum of 40% in the office each month (expectation ...

source models - with fallback routing, token, cost, and latency management Implement LLMOps in production: eval harnesses with real quality metrics, prompt versioning, observability tooling (LangSmith, Braintrust, or equivalent), cost and safety monitoring Embed directly with client engineering teams to design, prototype, and deploy agentic solutions - workshops, proofs of concept, code ...

technical design discussions and solution development. Strong problem-solving skills and an innovative mindset. Desirable Experience Experience with AWS Bedrock , LangGraph and/or LangSmith . Frontend development experience. Exposure to Information Security or secure software development environments. Experience working on AI transformation, automation or productivity-focused initiatives. Knowledge ...

source models — with fallback routing, token, cost, and latency management Implement LLMOps in production: eval harnesses with real quality metrics, prompt versioning, observability tooling (LangSmith, Braintrust, or equivalent), cost and safety monitoring Embed directly with client engineering teams to design, prototype, and deploy agentic solutions — workshops, proofs of concept, code ...

budgeted, engineered artifact rather than a prompt**The reference stack**The reference technology stack for this role is our supported paved road: self-hosted LangSmith and LangGraph Platform as the agent runtime and evaluation plane, model providers behind a swappable gateway seam, PostgreSQL with pgvector plus ClickHouse and S3-compatible ...