1,201 to 1,225 of 1,709 Data Pipeline Jobs in the UK

Menzies is seeking a senior data engineering lead to design and deliver scalable, secure data pipelines into BigQuery and related GCP services. You will shape the engineering approach, set standards for data modelling, testing, and cost optimisation, and partner with teams to deliver reusable … data products. You will mentor engineers and promote governance and data quality by design. Ideal candidates have 5+ years in data engineering, strong SQL/Python skills, and deep knowledge of BigQuery, #J-18808-Ljbffr ...

Azure) Conduct rigorous model evaluation, A/B testing, and performance monitoring Mentor junior ML engineers and conduct technical code reviews Collaborate with data engineers to optimise feature stores and data pipelines Stay current with latest ML research and evaluate applicability to client projects Requirements 5+ ...

stack. The network, signal layers, and forecasting architectures need to work together as one coherent system. Designing and building the agent orchestration pipeline that allows AI forecasters to ingest data, reason, and produce predictions. Building and optimising the signal pipeline that feeds real-world data … underway on forecasting architectures. You're making architectural decisions independently and contributing to technical strategy, not just executing tickets. At 6 months: The signal pipeline has an inductive process, a world model sits on top, and there's a sellable product for clients. You've unified the different parts ...

serve as a senior subject matter expert for AI risk and responsible AI across Bloomberg. This person will work closely with engineering, product, data science, legal, compliance, CISO, privacy, and risk stakeholders to provide practical, technically credible guidance on AI use cases, AI systems and data … Bloomberg, including product, platform, internal tooling, automation, and third-party AI solutions. Evaluate AI risks related to bias, explainability, hallucination, robustness, model drift, data leakage, privacy, security, intellectual property, misuse, transparency, and human oversight. Advise teams on appropriate controls, testing, monitoring, documentation, and risk mitigation strategies based ...

Markets is seeking a Senior Data Engineer to advance our Snowflake-based Data Lakehouse, enabling analytics, compliance, and decision-making across trading, finance, and marketing. You will own data pipelines, modelling, governance, and BI reporting, collaborating with Trading, Finance, and Compliance to deliver scalable … auditable data solutions. This role requires 5–8 years in data engineering and strong Snowflake experience. #J-18808-Ljbffr ...

NextGenEnergyJobs is seeking a data engineer to design, build, and maintain scalable data pipelines in Databricks while ensuring data reliability. You will own Databricks models, define schemas, test, and maintain a clean data warehouse. The role also focuses on automating processes with … Python and delivering useful dashboards for Finance and Asset Management. You will integrate systems via REST APIs, promote data quality through monitoring and governance, and collaborate with non-technical #J-18808-Ljbffr ...

DATA in the United Kingdom is seeking an experienced Data Engineer/Architect to deliver data solutions for enterprise clients. You will lead data pipelines, design Databricks-based lakehouse architectures, and ensure governance and security across projects. The role requires deep expertise … across the data lifecycle, mentoring teams, and strong client engagement. You will collaborate with analytics leadership to translate business needs into scalable data platforms. #J-18808-Ljbffr ...

capability model Experience working in a multi-entity, multinational environment Experience integrating security into large-scale development programmes Experience supporting secure AI or data-centric applications Minimum Qualifications Required Minimum Degree or equivalent professional experience in one of the following: computer science software engineering cyber security information security … Familiarity with NIST frameworks, particularly NIST CSF and NIST SSDF, demonstrated through training or experience Relevant vendor certifications linked to SAST, DAST, SCA or pipeline tooling where used in the organisation Evidence of continuous professional development in secure coding, software assurance or emerging technologies such as AI security Minimum ...

systems, including non-deterministic and agentic applications. OptimizeAI systems and workloads for latency, throughput,computeefficiency, reliability, security, and cost. Partner with business, engineering, data, risk, and control teams to take solutions from concept through production deployment and ongoingoperation. Establish engineering standards,mentorengineers,and influencetechnical strategy across teams. Theminimumrequirements … model-driven applications in production. Strongproficiencyin Python anda track recordof developing maintainable, well-tested production software. Strong SQL skills and experience working with data-intensive applications and large-scale datasets. Experience designing and building APIs, services, data pipelines, or distributed systems that support AI/ ...

deterministic and agentic applications. Optimize AI systems and workloads for latency, throughput, compute efficiency, reliability, security, and cost. Partner with business, engineering, data, risk, and control teams to take solutions from concept through production deployment and ongoing operation. Establish engineering standards, mentor engineers, and influence technical strategy across … production. Strong proficiency in Python and a track record of developing maintainable, well-tested production software. Strong SQL skills and experience working with data-intensive applications and large-scale datasets. Experience designing and building APIs, services, data pipelines, or distributed systems that support AI/ ...

deterministic and agentic applications. Optimize AI systems and workloads for latency, throughput, compute efficiency, reliability, security, and cost. Partner with business, engineering, data, risk, and control teams to take solutions from concept through production deployment and ongoing operation. Establish engineering standards, mentor engineers, and influence technical strategy across … production. Strong proficiency in Python and a track record of developing maintainable, well-tested production software. Strong SQL skills and experience working with data-intensive applications and large-scale datasets. Experience designing and building APIs, services, data pipelines, or distributed systems that support AI/ ...

deterministic and agentic applications. Optimize AI systems and workloads for latency, throughput, compute efficiency, reliability, security, and cost. Partner with business, engineering, data, risk, and control teams to take solutions from concept through production deployment and ongoing operation. Establish engineering standards, mentor engineers, and influence technical strategy across … production. Strong proficiency in Python and a track record of developing maintainable, well-tested production software. Strong SQL skills and experience working with data-intensive applications and large-scale datasets. Experience designing and building APIs, services, data pipelines, or distributed systems that support AI/ ...

deterministic and agentic applications. Optimize AI systems and workloads for latency, throughput, compute efficiency, reliability, security, and cost. Partner with business, engineering, data, risk, and control teams to take solutions from concept through production deployment and ongoing operation. Establish engineering standards, mentor engineers, and influence technical strategy across … production. Strong proficiency in Python and a track record of developing maintainable, well-tested production software. Strong SQL skills and experience working with data-intensive applications and large-scale datasets. Experience designing and building APIs, services, data pipelines, or distributed systems that support AI/ ...

enterprise that impacts the customer will be disrupted. We believe the future will run on the connective tissue between people, machines and data: all in the service of creating the most human processes and experiences for customers and employees. Job Description: About the Role As a Senior Forward … just coding - you're solving some of the most exciting challenges and problem solving in enterprise AI rollout, spanning enterprise data pipelines, multi‐agent orchestration/workflows and RAG/SLM finetuning. Responsibilities Lead the technical solution design and implementation of large‐scale Agentic and Knowledge AI solutions ...

Build and improve software components that aggregate, correlate and present data from over 30 global distribution sites Develop applications and data-processing logic to identify performance issues, service degradation and hotspots across distributed systems Contribute to telemetry pipelines that ingest, transform and route metrics, logs … telemetry standards is desirable Exposure to Kubernetes, containers or cloud platforms is desirable Exposure to data-processing, event-streaming or telemetry-pipeline technologies is desirable Exposure to CI/CD, GitOps or configuration-as-code approaches is desirable Exposure to synthetic monitoring, automated testing, probes or distributed ...

ready to LEVEL-UP THE GAME? We’re looking for an AI Solutions Technical Engineering Manager to lead the delivery of AI- and data-enabled products and platforms from early shaping through to measurable outcomes in production. You’ll operate at the intersection of engineering leadership, AI delivery … drive innovation while delivering under tight timelines and high expectations. The role You will lead multidisciplinary engineering teams (AI/ML, data, software, platform) to deliver AI capabilities that are trusted, adopted, and production-grade . You’ll partner with senior stakeholders & Product Managers to define outcomes, guide ...

decision intelligence company used by governments, defence organisations, financial institutions, and corporates operating in complex, fast-moving environments. Our capabilities fuse curated data sources, domain-specific AI, and deep human expertise to transform information overload into clear, actionable foresight. Our ambition is to become the analytical backbone that … over which problems we take on. Breadth rather than a narrow track. The work follows the problem, which means service design one month and pipeline or infrastructure work the next. Engineers here have the opportunity to build depth across several areas rather than being funnelled into one. Progress without ...

Novo Nordisk is seeking a Sr Data Engineering Professional for its London-based Bio Data & AI Engineering team. You will develop and advance data pipelines and omics data products to support early research and target discovery. You will collaborate with scientists across … Denmark, and the US, building scalable data solutions while ensuring quality and governance across the data lifecycle. #J-18808-Ljbffr ...

Senior Python Engineer/Back End Developer to join a fast-moving team. You will develop Python microservices, scalable services, voice chat, and data pipelines, using AI technologies including ASR, TTS, and LLMs. The ideal candidate will have strong Python skills, a pragmatic delivery-focused approach … ability to take ownership in a fast-paced, evolving environment. Key Responsibilities: Develop and maintain scalable Python services, microservices, voice chat, and data pipelines. Work with the Tech Lead and wider team on architecture, technical decisions, and solution design. Collaborate with product, data science, QA, design ...

maintaining quality and security. Familiarity with MCP (Model Context Protocol), Agent Skills and designing agentic systems that integrate models with tools and enterprise data via structured interfaces is a plus. Job Responsibilities Design, develop, and deploy GenAI and Agentic AI solutions that improve automation, decision-making, and user … practices. Develop prompt strategies and prompt engineering assets (templates, routing, guardrails), and implement automated evaluation to improve quality over time. Build and maintain data pipelines and processing workflows required for ML/GenAI use cases using cloud services. Apply MLOps practices across the lifecycle: experimentation, versioning, CI/ ...

future of Salesforce. We are Salesforce, the Customer Company, inspiring the future of business with AI + Data + CRM. Leading with our core values, we help companies across every industry blaze new trails and connect with customers in a whole new way. And, we empower … Technical Authority: Serve as the final technical escalation point for your portfolio. Maintain deep architectural judgment across the Salesforce platform, advanced LLM techniques, data pipelines, and agentic orchestration. Guide Enterprise Implementations: Unblock complex data readiness, tool integration, and multi-agent orchestration challenges. Step in directly ...

United Kingdom, London, London Staff Software Engineer - Machine Learning About this role We’re on a mission to transform the way we use data and AI to service our customers and drive efficiency across the business. Do you love shaping the technical landscape and driving innovation across … MLOps standards and practices across teams, including CI/CD for models, automated testing, monitoring, and deployment pipelines Collaborate with enterprise platform and data science teams, contributing to platform capabilities where appropriate and partnering on use case delivery Build and maintain strong relationships with key stakeholders, including senior ...

Quantum is seeking a Senior Data Engineer to design and build a robust, high-performance real-time data backbone. You will lead data pipelines, integrate Salesforce Marketing Cloud, CDP, and SCV sources, and own the semantic layer with Cube.js for self-serve analytics. … collaborate with data architects and stakeholders, mentor junior engineers, and work across AWS, GCP, or Azure to optimise data ingestion, storage, and processing. #J-18808-Ljbffr ...

agents and LLM-powered applications Design and develop robust, scalable, and maintainable automated test frameworks Collaborate with product managers, machine learning engineers, and data scientists to translate AI features and model behaviors into test cases and validation criteria Improve testing processes and infrastructure, integrating automated checks into … model performance and contribute to post-release quality validation Champion quality best practices across engineering teams Design, manage, and maintain test data strategies and mock services Manage the full defect lifecycle using customer feedback and debugging logs Report directly to the director of engineering Requirements 5+ years ...

Kubernetes, Elastic Container Service, or equivalent technologies in production environments Strong experience designing and implementing application programming interfaces, distributed systems, event-driven architectures, data pipelines, PostgreSQL, MongoDB, Redis, vector databases, observability, and automated deployment pipelines Demonstrated ability to influence technical direction while remaining close to the codebase, mentoring … Kubernetes, Elastic Container Service, or equivalent technologies in production environments Strong experience designing and implementing application programming interfaces, distributed systems, event-driven architectures, data pipelines, PostgreSQL, MongoDB, Redis, vector databases, observability, and automated deployment pipelines Demonstrated ability to influence technical direction while remaining close to the codebase, mentoring ...