726 to 750 of 931 Data Pipeline Jobs in the UK excluding London

Immediate start 🌳 What you'll be doing: 🌳 Owning the build of data source connectivity & transformation pattern templates — reusable by design 🌳 Designing complex pipeline patterns for large and XL-complexity feeds, including CDC and parallel load 🌳 Supporting the Lead Data Engineer on pattern design for correctness … data problems 🌳 Tech stack: AWS Glue, S3/Iceberg, MWAA, Python, PySpark, Terraform 🌳 Must-have: Active SC Clearance This is hands-on pipeline engineering on one of the most complex data feeds programmes in the public sector right now — not maintenance work, real build. 📩 Ready ...

seeking an experienced Architect specializing in infrastructure and software architecture to shape how AI workloads are designed, placed, and scaled across on-premises data centres, edge environments, and public cloud. This is an architecture leadership role: you will own the reference architectures, decision frameworks, and technical standards that … architecture for workloads spanning the on-premise server and public cloud compute and GPU estate. Define the patterns teams use for hosting, compute, data pipelines, training and fine-tuning, model serving, and retrieval-augmented systems. Workload Placement and Portability: Establish the decision framework that determines where a given ...

roles below. You'll work on applied AI and agentic systems for PE clients, hands-on with model integration, multi-agent workflows and data engineering from day one. Looking for a strong Python and SQL foundation, basic ML knowledge, and a CS/AI/Data … Location: UK (Brighton, Hybrid)/Europe (Remote) Position: Full-Time, Contract Take AI systems from research to production, building multi-agent workflows, scalable data pipelines and Azure-deployed services for PE and professional services clients. Suits an experienced AI or software engineer with advanced Python, agentic frameworks ...

Consulting Limited is seeking a highly skilled Data Lakehouse Engineer for a hybrid contract role based in Basildon, UK. The successful candidate will design and implement modern data lakehouse architectures, ensuring high performance and scalability. Key responsibilities include developing data pipelines using Python … PySpark, working with AWS services, and implementing CI/CD pipelines. Strong experience in AWS Data Engineering and knowledge of data quality frameworks are essential. #J-18808-Ljbffr ...

Methods Business and Digital Technology is seeking a Senior Data Engineer with strong SQL and Java expertise to design and deliver scalable data solutions. In this role, you will leverage Java's robustness and Scala's functional data-processing power to build scalable pipelines … manage distributed big data frameworks. Location: onsite in Glasgow (3 days per week). You will design, develop and maintain data pipelines, write high-performance SQL, build backend data processing applications in #J-18808-Ljbffr ...

JPMorganChase in the United Kingdom is seeking a Lead Data Engineer to design, build, and maintain scalable data pipelines and architectures within the Compute Infrastructure Platforms team. You will collaborate with agile teams to deliver secure, reliable data solutions that power the firm … analytics and decisions. You will own end-to-end data lifecycle, from ingestion to access, implement backups and archiving, and champion data quality and security. #J-18808-Ljbffr ...

provider with ambitious plans to become the best and biggest in the UK market. We've made huge investments in our pricing and data capabilities over the past few years, along with nurturing our 4Cs culture. We provide insurance for over four million customers, but we know there … even bigger opportunity out there - our Pricing, Data and Analytics community value curiosity, collaboration and constructive challenge. We are always looking for new ideas and diverse perspectives to question established thinking and drive meaningful change. Great pricing is built on trust, innovation and precision ...

client-facing solutions and proprietary internal platforms. The successful candidate will work across a broad range of challenges, including AI agents, workflow automation, data engineering, app development, market intelligence, ERP-related solutions and internal AI products that support consultants and clients alike. You'll have the opportunity … business. What You'll Be Doing Client Delivery Developing AI-enabled applications and automation solutions Building AI agents and agentic workflows Supporting data engineering and integration activities Working on technology-enabled transformation projects Taking client requirements from idea through to working solution Collaborating with consultants and technical specialists ...

Allstate in the United Kingdom is seeking a data engineer to design, develop, and maintain scalable data pipelines. You will work with Spark, Microsoft Fabric, and Lakehouse architectures to ingest, transform, and curate data from diverse enterprise sources. You will collaborate with Analytics Engineers … teams, data scientists, and platform engineers to deliver trusted datasets and data products. Strong mentoring and cloud-based analytics experience are essential. #J-18808-Ljbffr ...

idpp is seeking a Data Analytics Engineer (Microsoft Fabric) to help shape and grow a modern enterprise data platform. You will join a data team responsible for a recently deployed Microsoft Fabric platform, working with datasets spanning manufacturing operations, sustainability and energy analytics … core business systems. The role involves designing end-to-end data pipelines, building trusted data models, enabling analytics, and collaborating with stakeholders across UK, US and Europe to #J-18808-Ljbffr ...

team of scientists and engineers in designing our next generation of design verification environment Take ownership of key components in our modelling and simulation pipeline, and work closely with the quantum team to streamline and optimise their workflows Write full provable, reliable, well-documented, and high-quality software Build … have Skills: Exposure to quantum physics and electromagnetic Experience of working with cloud platforms such as Azure/GCP/AWS Experience with data pipelines Bachelor's/Master's degree in applied science, computer science, engineering, or a related discipline Benefits: Competitive salary Meaningful equity participation Flexible ...

fastest‐growing insurance companies. We research and develop AI systems that catapult insurance from a slow‐moving, traditional past into a data‐driven, technology‐lead and society‐defining future. We’re looking for dynamic, driven professionals like you to help evolve our business in new directions. … Senior Machine Learning Engineer, you will support the development of a privacy‐preserving generative AI ecosystem designed to protect personal and sensitive corporate data by design, including data residency, anonymisation and secure deployment principles. Working within a multidisciplinary and multi‐partner environment, the postholder will help ...

disaster recovery processes Monitor database performance, identify bottlenecks, and implement tuning improvements Design and maintain database structures to support business applications Ensure data integrity, consistency, and security across all environments Business-Critical Systems Support Provide technical support and administration for business-critical systems Work closely with business stakeholders … managing system upgrades, patching, and compliance activities Strong troubleshooting and problem-solving skills across systems and applications Desirable Experience with integration tools and data pipelines Knowledge of cloud platforms (e.g., Azure SQL, hybrid environments) Scripting/automation skills (PowerShell, SQL scripting) Experience supporting reporting tools (e.g., Cognos, Power ...

Hiscox Underwriting Group Services Ltd (HUGS) in the UK is seeking a data engineering specialist to join the Enterprise Technology Data service vertical. You will contribute to scalable data warehouse solutions and oversee end-to-end ETL design in a cloud/on-premise … environment. Responsibilities include translating business requirements into robust data pipelines, working within Agile teams and CI/CD pipelines to deliver across data platforms, and collaborating with stakeholders to enable #J-18808-Ljbffr ...

Ground Control is seeking a Lead Data Engineer to drive the technical direction of our Microsoft Fabric platform. You will shape data engineering standards, guide complex migrations from on-premise systems, and build robust data pipelines to support Power BI reporting and analytics. … will mentor engineers, influence platform strategy, and collaborate with partners to retire legacy tooling while delivering a scalable, secure data estate. #J-18808-Ljbffr ...

JPMorganChase is seeking a Data Engineer in the Corporate Technology team to build and deliver scalable data pipelines and analytics solutions that power AI initiatives across the firm. You will maintain critical data architectures, collaborate with global teams, and drive improvements in data ...

Somerset Bridge seeks a Data Engineer to design, build and optimise data pipelines across Pricing, Underwriting and Claims. You’ll work on a modern Azure-based data platform, consolidating capabilities on Databricks, Delta Lake and Unity Catalog to support analytics and AI initiatives. … collaborate with Data Architects and Analysts, delivering scalable, secure data solutions in a hybrid setup with both real-time and batch processing. #J-18808-Ljbffr ...

Location: LeedsSalary: 72,000 - 108,000 (per annum)Job type: PermanentWorking pattern: Full time/Flexible workingIndustry: Technology & Internet Services/Data & Advanced AnalyticsCompany: HaysConsultant: Jonathan WaltersHays office: Leeds — Part 6th Floor, Broad Gate, The HeadrowPhone: 0113 200 3750Email: jonathan.walters@hays.comLead AI EngineerLeeds or Edinburgh72,000 - 108,000Your … roleThe Data, Technology and Innovation (DTI) division enables the group to be a digital-first, data-led smart regulator by delivering a secure, agile, and cost-effective technology and data ecosystem that drives better decisions, transparency, and operational efficiency. Working alongside the wider ...

Leonard Curtis is seeking a Data Engineer to build, maintain, and optimise robust data pipelines. This role develops efficient ETL/ELT workflows using Microsoft Fabric tools and the Databricks Lakehouse Platform to deliver clean, production-ready data for enterprise analytics. You will implement … Delta Live Tables, write PySpark and SQL in Fabric Notebooks and Databricks clusters, and ensure data access control, quality checks, and governance through Unity Catalog. #J-18808-Ljbffr ...

Roke Manor Research Ltd is seeking a Data Engineer to design and develop data pipelines and analytics for National Security customers, leveraging distributed compute to transform raw data into actionable insights. You will work with diverse data sources, collaborate with customers … scrum team, and ensure data security and quality. DV clearance eligibility is required for this role. #J-18808-Ljbffr ...

develop, and sustain BI solutions across the UK, with Aberdeen preferred. You will work with IT and business teams to translate requirements into data-driven decisions, ensure data quality, and support data integration and platform reliability. The role requires travel international when needed ...

Zealand. The RoleTo take technical responsibility for the operation and modernisation of Peninsula's finance and HR systems, working in the Data Team, alongside our in-house Development Team and third-party technology suppliers across the globe. We seek technical experts with: Substantial experience of developing solutions, data … processes and data. A history of liaising with stakeholders at the highest level in international corporate businesses. Reporting to the Associate Director of Data & Systems Engineering, this role is for a candidate willing and able to develop and implement solutions, troubleshoot existing deployments and manage technical debt, whilst ...

Morrisons is seeking an Analytics Engineer to join our Data & Analytics team at our Head Office. You will shape data models and centralised semantic layers that power trusted reporting and data products across the business. You’ll translate complex business requirements into scalable data structures, mentor colleagues on SQL and data testing, and collaborate with stakeholders to drive insight-driven decisions while optimising data pipelines on Google Cloud Platform. #J-18808-Ljbffr ...

Apple Inc. is seeking a Senior Data Science Manager to lead strategic data solutions in Cambridge, MA. The role oversees analytics engineering and experimentation, driving data integrity and scalable data pipelines across multiple sources. You will guide teams in data storytelling, performance optimization, and collaboration with cross-functional leaders to align analytics with strategic objectives, while promoting an inclusive data-driven culture. #J-18808-Ljbffr ...

days per week, or 40% of your time, at one of our above office sites About this opportunity We're transforming how data and security are engineered across Lloyds Banking Group, using data, automation and modern architectures to detect, disrupt and deter threats at pace … scale. Within the Chief Security Office, our Security Data & AI Lab is building intelligent, AI-driven security capabilities that help keep our customers and colleagues safe! As a Site Reliability Engineer, you'll join a collaborative team focused on the resilient operation of cloud-hosted applications and services. ...