1 to 25 of 28 Permanent LangSmith Jobs

agile environments Bonus Points For Experience with agentic frameworks (e.g., LangChain, LlamaIndex) Experience in deep learning frameworks and front-end development Familiarity with Langfuse, Langsmith, or other LLM observability tools Understanding of Model Context Protocol and bias/hallucination mitigation techniques Previous success in integrating GenAI solutions into enterprise-scale ...

Weaviate, Chroma, pgvector, FAISS; embeddings, semantic and hybrid search, reranking MLOps/LLMOps & deployment: Docker, Kubernetes, FastAPI, CI/CD; observability, tracing, evaluation tooling (LangSmith, LangFuse); guardrails, prompt/version management Responsible AI & safety: bias & fairness, hallucination mitigation, evaluation, privacy, security, governance of AI and agentic systems Solution Design : Ability ...

with GraphRAG and agentic RAG. LLMOps, Evaluation & Responsible AI – operationalizing LLM and agentic systems at scale; evaluation harnesses, quality metrics, observability, tracing and monitoring (LangSmith, LangFuse); guardrails, red‐teaming and continuous optimization of accuracy, cost and latency. Understanding of AI governance, security, privacy, bias/fairness and emerging regulations. Machine ...

desired skills Knowledge of vector databases and retrieval strategies. Experience with recommender systems and ranking models. Familiarity with LLM evaluation tools (e.g., RAGAS, TruLens, LangSmith, Arize). A working understanding of cloud networking and platform infrastructure. Experience in e‐commerce or retail environments. Why join us? Be a part ...

have Knowledge of vector databases and retrieval strategies. Experience with recommender systems and ranking models. Familiarity with LLM evaluation tools (e.g., RAGAS, TruLens, LangSmith, Arize). A working understanding of cloud networking and platform infrastructure. Experience in e-commerce or retail environments. Why join us? Be a part of this ...

would LOVE if youhave Knowledge ofvector databases and retrieval strategies. Experience withrecommender systems and ranking models. Familiarity with LLM evaluation tools (e.g., RAGAS,TruLens,LangSmith,Arize). A working understanding of cloud networking and platform infrastructure. Experience in e-commerce or retail environments. Why join us? Be a part ...

Docker , Kubernetes , and Docker Compose . Infrastructure as Code (IaC) : Exposure to tools like Terraform . Monitoring Tools : Familiarity with LLM monitoring tools like Langsmith , Langfuse , or similar. CI/CD : Experience with continuous integration and deployment tools such as GitLab , GitHub , or Jenkins . Database Management Vector Databases: Experience ...

Docker , Kubernetes , and Docker Compose . Infrastructure as Code (IaC) : Exposure to tools like Terraform . Monitoring Tools : Familiarity with LLM monitoring tools like Langsmith , Langfuse , or similar. CI/CD : Experience with continuous integration and deployment tools such as GitLab , GitHub , or Jenkins . Database Management Vector Databases: Experience ...

experience with Docker, Kubernetes, and Docker Compose. Infrastructure as Code (IaC): Exposure to tools like Terraform. Monitoring Tools: Familiarity with LLM monitoring tools like Langsmith, Langfuse, or similar. CI/CD: Experience with continuous integration and deployment tools such as GitLab, GitHub, or Jenkins. Database Management Vector Databases: Experience with ...

Hands-on experience with Docker, Kubernetes, and Docker Compose.Infrastructure as Code (IaC): Exposure to tools like Terraform.Monitoring Tools: Familiarity with LLM monitoring tools like Langsmith, Langfuse, or similar.CI/CD: Experience with continuous integration and deployment tools such as GitLab, GitHub, or Jenkins.Database ManagementVector Databases: Experience with ...

/B testing and experimentation frameworks for AI features Contributions to open-source ML projects or research publications Experience with model observability tools (LangSmith, W&B;, MLflow) DEIB Our Commitment to Diversity, Equity, Inclusionand Belonging (DEIB) We believe attracting and retaining the best talent and fostering an inclusive culture strengthens ...

databases and multi-agent systems. Experience building APIs, platforms, tools and AI-enabled products. Familiarity with evaluation and observability tools such as Arize, Promptfoo, LangSmith or MLflow. Experience with red teaming, AI safety, testing and governance. Strong knowledge of CI/CD, DevOps, Docker and Kubernetes. Strong communication skills ...

open‐source models – with fallback routing, token, cost, and latency management ImplementLLMOpsin production: eval harnesses with real quality metrics, prompt versioning, observability tooling (LangSmith, Braintrust, or equivalent), cost and safety monitoring Embed directly with client engineering teams to design, prototype, and deploy agentic solutions – workshops, proofs of concept, code‐with ...

Experience with high-traffic, real-time consumer platforms Fine-tuning experience and the judgement to know when it beats prompting or RAG Observability tooling (LangSmith, Langfuse, W&B) and cost optimisation Experience with AI coding tools (Claude Code, Codex, Copilot) What's on Offer Competitive salary benchmarked to your level ...

wider Google Cloud Platform (e.g. Cloud Run, Pub/Sub, Cloud Storage). Experience with an LLM observability or evaluation platform such as Langfuse, LangSmith, Braintrust or Arize Phoenix. Understanding of MCP and integration of tools with agentic systems. Experience grounding LLM output in data via techniques such ...

source models – with fallback routing, token, cost, and latency management Implement LLMOps in production: eval harnesses with real quality metrics, prompt versioning, observability tooling (LangSmith, Braintrust, or equivalent), cost and safety monitoring Embed directly with client engineering teams to design, prototype, and deploy agentic solutions – workshops, proofs of concept, code ...

modular architecture, TDD, code quality tools. · AI Engineering (Desirable): RAG pipelines, agentic workflows, MCP, LLM integration (OpenAI, Gemini or other models from Huggingface), LangSmith, TruLens. Agentic Frameworks (Desirable): LangChain, CrewAI, Autogen, OpenAI Agents, Google ADK. WHAT YOU'LL LOVE ABOUT WORKING HERE We’re a fantastic team of bright, ambitious ...

with Anaplan or similar enterprise planning platforms Experience with A/B testing and experimentation frameworks for AI features Experience with model observability tools (LangSmith, W&B, MLflow) Our Commitment to Diversity, Equity, Inclusionand Belonging (DEIB) We believe attracting and retaining the best talent and fostering an inclusive culture strengthens ...

Expertise : Hands-on experience working with AI tools and APIs to automate workflows or enhance product capabilities eg Claude API, OpenAI API, LangGraph, LangSmith, RAG, Prompt Engineering, Agentic AI (Certifications). The Startup Mindset : You are pragmatic. You understand the value of testing and process ...

teaming, regression suites to continuously measure model quality in production. Instrument AI pipelines with tracing, latency histograms, and cost dashboards using tools such as LangSmith, Helicone, or Grafana Embed responsible-AI practices: hallucination mitigation, PII redaction, output guardrails, and bias monitoring into every feature. Mentor senior engineers, conduct rigorous code ...

About the company the company is the AI platform powering global debt markets — the world’s largest asset class at over $145 trillion. Debt markets are vast, global, and mission‐critical, yet still run on ...

bachelor’s or postgraduate program Course Topics Agentic AI architecture & design patterns LLM tool use and function calling Multi‐agent orchestration (LangGraph, AutoGen) LangChain & LangSmith for production pipelines Retrieval‐augmented generation (RAG) systems Memory & state management for AI agents API integration and external tool use AI agent evaluation & observability Deploying ...

project scope, and manage expectations with clients and leadership. Drive the technology selection process, evaluating build-vs-buy decisions for AI platforms (e.g., Arize, LangSmith) and foundational models. Architect model- and tool-agnostic multi-agent systems governed by an MCP Control Plane. Design and implement the Agent Registry ...

mentoring others and elevating team capabilities. Nice to Have Treasury, fintech, or payments domain knowledge (cash positioning, FX, liquidity). LLM observability tools: LangSmith, Arize, Weights & Biases. AWS (S3, Glue, Redshift, Lambda); TMS/financial data providers (Bloomberg, Kyriba). Startup, founder, or cross‐functional multi‐product experience. Benefits Paid ...

whether outputs technically succeed Comfortable in a fast-moving environment where requirements evolve weekly Nice to Have Hands-on experience with PostHog, Arize, Langfuse, LangSmith, Helicone, or similar LLM observability tools Familiarity with prompt engineering, RAG systems, or agent orchestration frameworks Prior software development experience (a plus, not mandatory) Exposure ...