1,351 to 1,375 of 1,699 Data Pipeline Jobs in the UK

Data Engineer III — Python & Databricks Pipelines

Location
Auchentibber, Scotland, United Kingdom
JPMorganChase's Investment Banking Data Products team is seeking a Software Engineer III to design and deliver reliable data collection, storage, and analytics solutions that are secure, scalable, and compliant with enterprise standards. You will develop and maintain data pipelines using Python and Databricks … review controls for data protection, and apply AI-assisted development tools to improve quality while ensuring traceability and auditability. #J-18808-Ljbffr ...

Contract Data Engineer

Hiring Organisation
Opus Recruitment Solutions Ltd
Location
Telford, Shropshire, United Kingdom
Employment Type
Full-Time
Salary
£400.00 - £450.00 per day
Opus have partnered with a global FinTech company who're undergoing a large transformation to move their existing data platform from BigQuery to Snowflake. - Rate: £450 per day (Outside IR35) - Start Date: September 2026 - Length : 6 months - Working pattern : Fully-remote Key Requirements: Strong Snowflake experience (ideally 2+ … years) Experience with data platform migrations, particularly into Snowflake Building data pipelines, lineage frameworks, dynamic tables and semantic views Strong SQL and Python skills Experience with dbt (or similar tools such as Dataform) Exposure to Snowflake Cortex and Streamlit applications is highly desirable Agile environment experience ...

AI-Driven Data Engineer — Python, Databricks, React

Location
Auchentibber, Scotland, United Kingdom
JPMorganChase is seeking a Data Engineer to enhance, build, and deliver scalable data collection, storage, and analytics solutions for CIO, Treasury & Corporate Risk Management. You will maintain critical data pipelines across multiple technical areas and drive AI-powered data initiatives while ensuring ...

AI-First Data Engineer — Build Scalable Pipelines & Equity

Location
Greater London, England, United Kingdom
Zego in London is seeking a hands-on Data Engineer to build and maintain scalable data pipelines within an established platform. You will collaborate with Engineering, Data Science, Analytics and Product to ensure data is reliable and ready for analytics and operation. ...

Cloud Data Engineer: Serverless Pipelines on GCP/AWS

Location
Greater London, England, United Kingdom
Ipsos is recruiting a Data Engineer to evolve our Audience Measurement data platforms using cloud-native, serverless patterns. You will join a team focused on managed cloud services, cost-conscious design, and incremental improvement, working with internal teams to develop robust data pipelines … optimize storage on GCP. The role emphasizes serverless architectures, DataOps practices, and agile delivery, with collaboration across data scientists and engineers to productionise models and #J-18808-Ljbffr ...

SC Cleared Data Engineer — Azure Databricks & Pipelines

Location
England, United Kingdom
Associates is seeking a Senior SC Cleared Data Engineer with extensive Azure Databricks experience to join a UK Central Government data team responsible for designing and developing high-volume datasets and robust data pipelines. You will work with Spark-based technologies, build, automate … operate data pipelines, and apply CI/CD practices with Docker and Kubernetes in a secure government context. #J-18808-Ljbffr ...

Azure Databricks Engineer — Hybrid (London)

Location
Greater London, England, United Kingdom
Cognizant in London is seeking an experienced Azure Databricks Data Engineer to design, develop, deploy, and optimize scalable data solutions on Microsoft Azure. You will build production-grade data pipelines with Delta Lake, Unity Catalog, and Databricks tools. The role requires hands-on expertise … PySpark, Python, SQL, and Spark architecture, plus experience with GitLab-based CI/CD, Databricks Asset Bundles, and Azure Data Lake Storage. #J-18808-Ljbffr ...

Research Engineer, Safety Oversight, DeepMind

Location
Greater London, England, United Kingdom
Jobs3. UK4. Research Engineer, Safety Oversight, DeepMind—G## Research Engineer, Safety Oversight, DeepMindGoogle00AI SafetyFull-timeLondon, UKApply Job### Job DescriptionWe aim to turn production data into intelligence on the safety of deployed AI models. Safety Oversight is a new team tasked with using large-scale production traffic … teams offer diverse learning opportunities and varied career pathways for those driven to achieve exceptional results through collective effort.ResponsibilitiesBuild classifiers and large-scale data pipelines to detect model misbehavior and misuse end-to-end. Research and develop cross-context monitoring systems to detect coordinated harms, developing novel signal ...

Senior Data Engineer: Scalable Pipelines & AI Platform

Location
Greater London, England, United Kingdom
Elsevier in London is seeking a Senior Data Engineer to build and maintain scalable, high-performance data-driven applications. You will design and develop data pipelines, ensuring reliability and effectiveness in delivering insights. Strong skills in Python and knowledge of cloud platforms like ...

Cloud Performance Engineer

Location
Greater London, England, United Kingdom
skills and the ability to independently drive work to completion Strong communication skills and ability to collaborate across teams Preferred Qualifications: Experience building data pipelines for centralizing structured data Experience working with Cisco routing and switching hardware Experience working with Google Cloud Platform Experience programming … Experience with Linux kernel bypass techniques such as DPDK. For more information about DRW's processing activities and our use of job applicants' data, please view our Privacy Notice at https://drw.com/privacy-notice. California residents, please review the California Privacy Notice for information about ...

Senior Full-Stack Engineer: AI-Powered Climate Insurance

Location
Greater London, England, United Kingdom
Artio is seeking a Senior Full Stack Engineer to own the technical architecture and platform behind our risk models. You will bridge software, data engineering and data science to deploy AI-driven insights for early-stage carbon insurance. The role is hands-on and autonomous, based … London with hybrid work. You will scale geospatial data pipelines and collaborate with founders and the data team to ship features from concept to production. #J-18808-Ljbffr ...

Senior Product Data Scientist — Operations Delivery Intelligence

Location
Greater London, England, United Kingdom
British Airways is seeking a Principal Product Data Scientist to join the Operations Delivery Intelligence directorate, driving industrialised decision-support software across airline operations. You’ll own production ML codebases, lead end-to-end delivery, and partner … with stakeholders to optimise complex operational problems. You’ll prototype and deploy ML models in Python, build robust data pipelines, and shape pipeline orchestration and CI/CD. #J-18808-Ljbffr ...

Fabric Architect - Local Authority

Hiring Organisation
Spencer Clarke Group
Location
London, United Kingdom
Employment Type
Contract
Contract Rate
£649 - £650/day Inside IR35
solutions, significant changes and alignment with Microsoft and enterprise architecture best practice. Define and validate architecture patterns for OneLake, Lakehouses, Warehouses, notebooks, data pipelines, dataflows, semantic models, Power BI and supporting Azure services. Review and strengthen the council's Bronze, Silver and Gold Medallion architecture, ensuring that transformations … reusable data products and reporting layers are consistent, scalable and supportable Review and strengthen Fabric and supporting Azure governance standards, including resource groups, subscriptions, ownership, tagging, RBAC, monitoring, cost management, workspace creation, lifecycle management and environment separation About you: You will have the following experiences: Proven experience designing ...

Data Engineer: Ingestion & Lakehouse Platform

Location
Greater London, England, United Kingdom
Preply is building a unified data lake and production-grade data assets to power analytics, ML, and product features across the platform. As a Data Engineer, you’ll own ingestion, enrichment, and governance to ensure reliable, observable data pipelines that scale with … user growth and global reach. You’ll collaborate with ML Platform, Analytics, and Product squads, delivering end-to-end data solutions, implementing quality checks, and driving standards for data contracts and lineage across the #J-18808-Ljbffr ...

GTM Engineer

Location
Greater London, England, United Kingdom
system of record has evolved into a broader platform for operating people globally. With Athena, our agentic AI layer, Humaans moves beyond data management into intelligent orchestration, connecting workflows across HR, IT, Finance, and Operations so organisations can act faster and with greater confidence, redefining how work gets … come from SDR, RevOps, growth, or product backgrounds. If you\'ve been the person quietly wiring Clay into your CRM and automating your own pipeline, this is the role for that instinct. This is an in-person role. Our GTM team comes together in the office Monday through Thursday ...

Quantitative Developer (Systematic Options/Python) – Tier 1 Hedge Fund – Excellent Compensation & Benefits

Location
Greater London, England, United Kingdom
visibility into positions, signals, risk, and overall system health Improving platform reliability, observability, testing, documentation, and automation across the development lifecycle Debugging complex data pipelines, signal implementations, and production workflows Leveraging AI-assisted development tools and automated workflows to accelerate delivery and reduce operational burden Identifying recurring operational … software engineering best practices including testing, version control, code review, monitoring, and modular design Strong debugging and problem-solving capabilities across complex data and technology workflows Comfortable operating in a highly collaborative front-office environment working directly with PMs and researchers Strong ownership mentality with the ability ...

Lead Data Engineer: AI-Driven Data Platforms (Python)

Location
Auchentibber, Scotland, United Kingdom
JPMorgan Chase & Co. is seeking a Lead Data Engineer to join the Corporate Technology team in Glasgow. You will enhance, build, and deliver data collection, storage, access, and analytics solutions that support AI and analytics initiatives across the firm. The role emphasizes secure, scalable data pipelines and architectures, with a focus on governance and regulatory compliance. You will collaborate with cross‐functional teams to enable data-driven decisions, drive innovation, and raise the bar #J-18808-Ljbffr ...

Lead Product Analyst - Business Operations - Wise Business

Hiring Organisation
Wise
Location
London, UK
Employment Type
Full-time
product whilst tackling key pain points our customers experience in dealing with our servicing teams. WHAT YOU'LL BE DOINGDerive actionable insights from data to drive the team's strategy and inform product decisions. Establish clear goals, define measurable KPIs, and develop compelling narratives to help your team … understand their progress. Ensure accurate, impactful, fast decision making with high quality analysis, helping us to iterate faster. Build automated data pipelines and dashboards to minimise repetitive tasks and allow data self-serve. Identify & evaluate high impact opportunities, find ways to support & accelerate or identify ...

Software Engineer - Senior

Location
Greater London, England, United Kingdom
Software Engineer - Senior Department: Factor Employment Type: Permanent - Full Time Location: London, UK Description Factor is an API driven, AI powered retail data platform for global energy utilities. We use deep machine learning to help energy retailers accurately value the energy they sell: improving margins, unlocking more competitive … priced, forecast, and delivered globally. As a senior engineer, you will play a pivotal role in developing the core of our system: scalable data pipelines, pricing engines, and APIs that support real time decision making for energy retailers and their customers. You’ll work in a highly capable ...

Lead Digitisation Engineer

Location
Bedlington, England, United Kingdom
Role Overview and Responsibilities TT Electronics, Bedlington , are hiring for a Lead Digitisation Engineer to lead the strategy, architecture, and implementation of automated data pipelines, IoT integration, smart manufacturing systems, and advanced analytics. Working directly to drive yield optimisation, predictive maintenance, and lights-out automation across our cleanroom … infrastructure. Key Responsibilities Include: Designing and owning the Industry 4.0 Strategy & Roadmap. Driving the integration of legacy and modern microelectronics equipment. Architecting robust data pipelines to collect, store, and analyse process data. Collaborating with process engineers to implement advanced process control (APC), statistical process control (SPC), and machine ...

Quantitative Developer

Hiring Organisation
WorldQuant
Location
London, UK
Employment Type
Full-time
just use AI to move faster; you'll help shape how it's applied across our engineering practice. Design and build data pipelines and the data layer. Develop and maintain the computational frameworks and infrastructure that run our quantitative strategies at scale. Implement and enhance quant … related software systems for data, research, portfolio construction, and trading. Work closely with Researchers, and Quants as a hands-on engineering partner, helping them turn ideas into robust production solutions. Gain exposure to the full lifecycle of the systematic/quant business, from data ingestion through ...

AI Data Platform Engineer: Scalable Pipelines for AI

Location
Manchester, England, United Kingdom
Vertus Partners is seeking an experienced AI/data engineer to help with the greenfield design and build of the next generation data foundations that power search, analytics and AI-driven applications across the business. This is a hands-on role focused on designing robust data pipelines, improving data accessibility and creating scalable solutions that enable better use of information across a complex technology environment. #J-18808-Ljbffr ...

Senior AI Engineer - Machine Learning (Computer Vision)

Location
Camden Town, England, United Kingdom
developing AI solutions using LLMs and generative AI, including iterating on prompts and workflows to improve output quality Building and maintaining scalable data pipelines, applying best practices in data preparation to ensure quality and reliability Helping to standardise and reuse AI workflows, making it easier … cutting-edge technology, AI-driven content creation, and cloud-native platforms, we're evolving from traditional shoot‐led production to a scalable, data-driven content engine enabling faster speed to market, richer personalisation, and truly immersive shopping experiences. This is a unique opportunity to shape how millions ...

Cyber Security Engineer I Software engineering London

Location
Greater London, England, United Kingdom
across Checkout, while ensuring AI technologies are deployed in a safe, governed, and resilient manner. The successful candidate will work closely with Engineering, Data Governance, GRC, and business teams to embed security into AI systems, assess AI-related risks, and help the organisation adopt AI securely at scale. … will act as the bridge between cyber security and emerging AI technologies. You will help shape how Checkout secures AI tools, models, data pipelines, and supporting infrastructure, while also identifying opportunities to use AI to strengthen cyber defence capabilities. This is a hands‐on role suited to someone ...

Lead AI & Data Engineer — Java, AWS, Agentic AI

Location
Glasgow, Scotland, United Kingdom
JPMorgan Chase & Co. in the United Kingdom seeks a Lead Software Engineer to design and deliver AI and data engineering solutions at scale, with a focus on secure, reliable production systems. You will drive agentic AI initiatives, build data pipelines, and collaborate across teams to align ...