1 to 25 of 40 LangSmith Jobs in the UK

project management skills in Agile environments Experience with any of the following is advantageous: agentic frameworks (e.g., LangChain, LlamaIndex), deep learning frameworks, Langfuse, Langsmith, MCP (Model Context Protocol), bias mitigation techniques #J-18808-Ljbffr ...

/CD, and Infrastructure as Code. Proficiency with GitHub Actions, GitLab, and Jenkins. Knowledge of LLMOps and MLOps, model governance, AI security and guardrails, LangSmith, Arize, and monitoring and evaluation frameworks. Master's degree in Computer Science, AI, Data Science, or related discipline preferred. AWS Solutions Architect Professional certification preferred. ...

desired skills Knowledge of vector databases and retrieval strategies. Experience with recommender systems and ranking models. Familiarity with LLM evaluation tools (e.g., RAGAS, TruLens, LangSmith, Arize). A working understanding of cloud networking and platform infrastructure. Experience in e‐commerce or retail environments. Why join us? Be a part ...

Protocol (MCP)• Evaluation engineering (golden datasets, regression gates in CI, LLM-judge calibration)• Guardrail and AI-observability tooling (e.g. NeMo Guardrails, OpenTelemetry GenAI conventions, LangSmith, Braintrust)MLOps & LLMOps• Hands-on with MLOps platforms (Azure ML, Databricks, SageMaker) and vector/retrieval databases (Pinecone, Milvus, pgvector)• Experience with GPU-accelerated infrastructure ...

e.g., Pandas, Spark, dbt, etc.). Hands-on experience with MLOps/LLMOps principles, including CI/CD for data workflows, automated agent evaluation (LangSmith, Opik, Langfuse), and infrastructure as code (Terraform). Experience building systems with different data formats (structured vs unstructured) and data processing methods (streaming vs batch ...

Docker Compose.* Infrastructure as Code: Proficiency with Terraform or equivalent.* Evaluation and Monitoring: Experience with evaluation-driven development and LLM observability tooling such as Langsmith, Langfuse, Braintrust, or similar.* CI/CD: Comfortable owning pipelines end to end (GitHub Actions, GitLab CI, Jenkins).* Database Management: Experience with vector databases ...

Docker Compose.* Infrastructure as Code: Proficiency with Terraform or equivalent.* Evaluation and Monitoring: Experience with evaluation-driven development and LLM observability tooling such as Langsmith, Langfuse, Braintrust, or similar.* CI/CD: Comfortable owning pipelines end to end (GitHub Actions, GitLab CI, Jenkins).* Database Management: Experience with vector databases ...

Docker Compose.* Infrastructure as Code: Proficiency with Terraform or equivalent.* Evaluation and Monitoring: Experience with evaluation-driven development and LLM observability tooling such as Langsmith, Langfuse, Braintrust, or similar.* CI/CD: Comfortable owning pipelines end to end (GitHub Actions, GitLab CI, Jenkins).* Database Management: Experience with vector databases ...

SDKs or similar), and an informed view of when to use them and when not Experience with evaluation and observability tooling such as MLflow, LangSmith or Arize Experience configuring agentic coding assistants for a team, with shared instructions, skills and workflows Solid grounding in machine learning and NLP: able ...

modular architecture, TDD, code quality tools. · AI Engineering (Desirable): RAG pipelines, agentic workflows, MCP, LLM integration (OpenAI, Gemini or other models from Huggingface), LangSmith, TruLens. Agentic Frameworks (Desirable): LangChain, CrewAI, Autogen, OpenAI Agents, Google ADK. WHAT YOU'LL LOVE ABOUT WORKING HERE We’re a fantastic team of bright, ambitious ...

modular architecture, TDD, code quality tools. · AI Engineering (Desirable): RAG pipelines, agentic workflows, MCP, LLM integration (OpenAI, Gemini or other models from Huggingface), LangSmith, TruLens.* Agentic Frameworks (Desirable): LangChain, CrewAI, Autogen, OpenAI Agents, Google ADK.## **WHAT YOU'LL LOVE ABOUT WORKING HERE**We’re a fantastic team of bright, ambitious ...

modular architecture, TDD, code quality tools. · AI Engineering (Desirable): RAG pipelines, agentic workflows, MCP, LLM integration (OpenAI, Gemini or other models from Huggingface), LangSmith, TruLens.* Agentic Frameworks (Desirable): LangChain, CrewAI, Autogen, OpenAI Agents, Google ADK.## **WHAT YOU'LL LOVE ABOUT WORKING HERE**We’re a fantastic team of bright, ambitious ...

modular architecture, TDD, code quality tools. · AI Engineering (Desirable): RAG pipelines, agentic workflows, MCP, LLM integration (OpenAI, Gemini or other models from Huggingface), LangSmith, TruLens.* Agentic Frameworks (Desirable): LangChain, CrewAI, Autogen, OpenAI Agents, Google ADK.## **WHAT YOU'LL LOVE ABOUT WORKING HERE**We’re a fantastic team of bright, ambitious ...

MLflow, Weights & Biases, Data Version Control) Experience developing LLM/GenAI applications, including prompt engineering and RAG architectures Familiarity with LLMOps tooling such as LangSmith, LangChain, or LangGraph Understanding of model evaluation, validation techniques, and production monitoring Experience working in cross-functional teams from problem framing through to production delivery ...

MLflow, Weights & Biases, Data Version Control) Experience developing LLM/GenAI applications, including prompt engineering and RAG architectures Familiarity with LLMOps tooling such as LangSmith, LangChain, or LangGraph Understanding of model evaluation, validation techniques, and production monitoring Experience working in cross-functional teams from problem framing through to production delivery ...

MLflow, Weights & Biases, Data Version Control) Experience developing LLM/GenAI applications, including prompt engineering and RAG architectures Familiarity with LLMOps tooling such as LangSmith, LangChain, or LangGraph Understanding of model evaluation, validation techniques, and production monitoring Experience working in cross-functional teams from problem framing through to production delivery ...

Required MCP server development and tool ecosystem integration Experience in Financial Services, Energy, Healthcare, or another regulated environment Model observability tooling such as LangSmith or Weights & Biases, and cost and latency optimisation at scale Writing, speaking, or community contribution in AI engineering Experience working alongside partner ecosystems such as Anthropic ...

development. Proven experience with standard monitoring/logging tools (e.g., Prometheus, Grafana, Datadog, OpenTelemetry) as well as LLM-specific tracing and evaluation platforms (e.g., LangSmith, Phoenix/Arize, Langfuse, TruLens). Familiarity with modern CI/CD pipelines (GitHub Actions, GitLab CI, ArgoCD) and Infrastructure as Code (IaC) tools (Terraform ...

applications to enterprise data, tools, and services Apply experience with LLM observability and evaluation standards or platforms such as OpenTelemetry, OpenInference, Arize Phoenix, LangSmith, or equivalent, including traces across model, retrieval, and tool-execution steps Show familiarity with knowledge graphs, multimodal models, fine‐tuning, synthetic data, or advanced model‐evaluation ...

source models — with fallback routing, token, cost, and latency management Implement LLMOps in production: eval harnesses with real quality metrics, prompt versioning, observability tooling (LangSmith, Braintrust, or equivalent), cost and safety monitoring Embed directly with client engineering teams to analyse the SDLC to identify AI/agentic opportunities ...

preferable to prompt engineering or RAG Experience with real‐time streaming, multimodal models, or search technologies like Elasticsearch Familiarity with model observability tools (LangSmith, Weights & Biases) and cost optimization strategies Experience in specialized verticals (financial services, energy, healthcare, legal, retail) with understanding of compliance, security, and responsible AI practices Experience ...

source models — with fallback routing, token, cost, and latency management Implement LLMOps in production: eval harnesses with real quality metrics, prompt versioning, observability tooling (LangSmith, Braintrust, or equivalent), cost and safety monitoring Embed directly with client engineering teams to analyse the SDLC to identify AI/agentic opportunities ...

source models with fallback routing, token, cost, and latency management Implement LLMOps in production: eval harnesses with real quality metrics, prompt versioning, observability tooling (LangSmith, Braintrust, or equivalent), cost and safety monitoring Embed directly with client engineering teams to analyse the SDLC to identify AI/agentic opportunities ...

hands‐on, and experience in a regulated environment (auditability, explainability, model risk, data residency) Experience with LLM evaluation and observability tooling, for example Langfuse, LangSmith, or OpenTelemetry Benefits 28 days annual leave plus bank holidays Hybrid model where employees work a minimum of 40% in the office each month (expectation ...

source models - with fallback routing, token, cost, and latency management Implement LLMOps in production: eval harnesses with real quality metrics, prompt versioning, observability tooling (LangSmith, Braintrust, or equivalent), cost and safety monitoring Embed directly with client engineering teams to design, prototype, and deploy agentic solutions - workshops, proofs of concept, code ...