426 to 450 of 825 Data Pipeline Jobs in England

an ever-changing global market. About the Role: At CRU, we're transforming how the world understands commodities. We're building cutting-edge platforms that will redefine how data is delivered to our clients-and we're looking for a talented Data Engineer to be at the heart of it. If you're passionate about data … and creating robust, scalable pipelines using modern tech, this is your opportunity to help shape a key part of CRU's future. Key Responsibilities: Develop and maintain scalable data pipelines to power next-gen data products in the commodities industry. Ensure data quality using the latest analytics and monitoring tools. Design and build robust … . 2-3 years of hands-on Python (scripting and development). Experience in a fast-paced startup or agile environment. Strong background in schema design and dimensional data modeling. Able to communicate data architecture clearly with internal stakeholders. Experience with Azure, Airflow, DBT, Kubernetes, GitHub. Bonus points for: open-source contributions, an active GitHub profile More ❯

an ever-changing global market. About the Role: At CRU, we're transforming how the world understands commodities. We're building cutting-edge platforms that will redefine how data is delivered to our clients-and we're looking for a talented Data Engineer to be at the heart of it. If you're passionate about data … and creating robust, scalable pipelines using modern tech, this is your opportunity to help shape a key part of CRU's future. Key Responsibilities: Develop and maintain scalable data pipelines to power next-gen data products in the commodities industry. Ensure data quality using the latest analytics and monitoring tools. Design and build robust … . 2-3 years of hands-on Python (scripting and development). Experience in a fast-paced startup or agile environment. Strong background in schema design and dimensional data modeling. Able to communicate data architecture clearly with internal stakeholders. Experience with Azure, Airflow, DBT, Kubernetes, GitHub. Bonus points for: open-source contributions, an active GitHub profile More ❯

Viya 4. Support the migration of legacy SAS platforms to cloud-native SAS Viya 4 environments, including namespace separation and Kubernetes orchestration. Implement and manage configuration objects, service data, and translation objects within SAS environments. Collaborate with data engineers and DevOps teams to integrate SAS with Oracle, GitLab CI/CD pipelines, and other enterprise platforms. … Monitor and optimise platform performance, ensuring high availability and compliance with security standards. Provide technical support and troubleshooting for SAS users and developers. Automate environment provisioning and data transfers using approved EA integration patterns. Participate in community knowledge sharing and contribute to best practice documentation. Essential Skills and Experience: SAS Enterprise Guide (EG) – workflow orchestration and user support. … Viya 4 – platform configuration, migration, and containerisation (Kubernetes). SAS Visual Analytics (VA) and SAS Visual Investigator (VI) – dashboard and investigation tool support. Oracle – integration and data pipeline support. Configuration Management – experience managing service objects, deployment artefacts, and environment baselines. Testing Lifecycle Knowledge – including test strategy design, environment comparison utilities, and automated testing integration. Desirable Attributes: Experience More ❯

Viya 4. Support the migration of legacy SAS platforms to cloud-native SAS Viya 4 environments, including namespace separation and Kubernetes orchestration. Implement and manage configuration objects, service data, and translation objects within SAS environments. Collaborate with data engineers and DevOps teams to integrate SAS with Oracle, GitLab CI/CD pipelines, and other enterprise platforms. … Monitor and optimise platform performance, ensuring high availability and compliance with security standards. Provide technical support and troubleshooting for SAS users and developers. Automate environment provisioning and data transfers using approved EA integration patterns. Participate in community knowledge sharing and contribute to best practice documentation. Essential Skills and Experience: SAS Enterprise Guide (EG) – workflow orchestration and user support. … Viya 4 – platform configuration, migration, and containerisation (Kubernetes). SAS Visual Analytics (VA) and SAS Visual Investigator (VI) – dashboard and investigation tool support. Oracle – integration and data pipeline support. Configuration Management – experience managing service objects, deployment artefacts, and environment baselines. Testing Lifecycle Knowledge – including test strategy design, environment comparison utilities, and automated testing integration. Desirable Attributes: Experience More ❯

Viya 4. Support the migration of legacy SAS platforms to cloud-native SAS Viya 4 environments, including namespace separation and Kubernetes orchestration. Implement and manage configuration objects, service data, and translation objects within SAS environments. Collaborate with data engineers and DevOps teams to integrate SAS with Oracle, GitLab CI/CD pipelines, and other enterprise platforms. … Monitor and optimise platform performance, ensuring high availability and compliance with security standards. Provide technical support and troubleshooting for SAS users and developers. Automate environment provisioning and data transfers using approved EA integration patterns. Participate in community knowledge sharing and contribute to best practice documentation. Essential Skills and Experience: SAS Enterprise Guide (EG) - workflow orchestration and user support. … Viya 4 - platform configuration, migration, and containerisation (Kubernetes). SAS Visual Analytics (VA) and SAS Visual Investigator (VI) - dashboard and investigation tool support. Oracle - integration and data pipeline support. Configuration Management - experience managing service objects, deployment artefacts, and environment baselines. Testing Lifecycle Knowledge - including test strategy design, environment comparison utilities, and automated testing integration. Desirable Attributes: Experience More ❯

Senior Data Engineer| AWS/Databricks/PySpark | London/Glasgow (Hybrid) | August Start Role: Senior Data Engineer Location: This is a hybrid engagement represented by 2 days/week onsite, either in Central London or Glasgow. Start Date: Must be able to start mid-August. Salary: £80k-£90k (Senior) | £90k-£95k (Lead) About The Role … Our partner is looking for a Senior Data Engineer to join a high-impact engineering team delivering scalable data solutions for complex marketing and customer insight use cases. This is an opportunity to work on cutting-edge data pipelines, cloud-native platforms and real-time data flows in a collaborative, forward-thinking … with cross-functional teams including Data Science, Software Engineering and Product. Champion best practices in data governance, observability and compliance. Contribute to CI/CD pipeline development and infrastructure automation (Terraform, AWS DevOps). Provide input into technical decisions, peer reviews and solution design. Requirements Proven experience as a Data Engineer in cloud More ❯

Excel VBA. Experience with CI/CD pipelines and Azure DevOps is also valued. Key Responsibilities: - Develop serverless applications using Cloud Functions (Python or Node.js) - Build and optimise data pipelines with Cloud Dataflow - Manage relational databases via Cloud SQL (PostgreSQL/MySQL) - Implement workflows using GCS triggers and IAM permissions - Integrate APIs using Apigee - Create Excel-based automation More ❯

Q4 2024, led by Notable Capital, CRV and Heavybit. At its core, LocalStack provides a high-fidelity emulator and local cloud development platform. Imagine developing cloud applications and data pipelines entirely on your local machine within a lightweight cloud sandbox, running in Docker! Our mission is to empower developers to rapidly build and test their cloud applications, allowing More ❯

model? We are seeking a Senior Backend Developer to support the development of our AI-driven marketing platform, with a strong focus on performance, scalability, and data pipeline architecture. This role is ideal for someone experienced in backend API development and working with modern data infrastructure. At Ask BOSCO® , we're on a mission to … Senior Backend Developer you won't just write code - you'll shape the future of a high-growth MarTech product, lead technical strategy, and work directly with founders, data scientists, and clients to deliver impactful, intelligent solutions. If you're excited by ownership, innovation, and the chance to make a real mark in a scaling business, this is … of profits donated to 1moreChild orphanage yearly Markets: Marketing & eCommerce Agencies. eCommerce retailers. Your Expertise: Highly experienced Developer with experience of backend API development and working with modern data infrastructure. At ASK BOSCO® , part of Modo25, we're building a smarter, faster, people-first marketing tech business. We're entering a phase of accelerated growth, and you'll More ❯

ranks 189 on the Fortune 500. Further information about Lear is available at or on Position overview: As an Application Solution Architect, you will design and implement scalable, data-driven solutions using Palantir Foundry. You'll work closely with business stakeholders, data engineers, and developers to translate business needs into robust technical architectures that leverage Foundry … technical constraints. Design scalable and efficient data models and ontologies within Foundry. Define and oversee the development of data pipelines and workflows using Foundry's Pipeline Builder and Code Repositories. Lead integration of external systems and APIs into Foundry for seamless data flow. Work with cross-functional teams to gather requirements, define architecture … TECHNICAL/PERSONNEL SKILLS : Experience designing scalable data models and ontologies. Understanding of semantic data modelling and entity relationships. Familiarity with Foundry's Ontology SDK, Pipeline Builder, and Code Workspaces. Experience integrating external systems and APIs into Foundry. Knowledge of data transformation, cleansing, and enrichment techniques. Awareness of data privacy, access More ❯

Senior Azure Data Engineer (Databricks) Location: London (Hybrid) | Practice Area: Technology & Engineering | Type: Permanent Engineer advanced data solutions at scale in a world-class consulting environment The Role As a Senior Azure Data Engineer (Databricks) at Capco, you will play a hands-on role in designing, building, and deploying scalable and secure data engineering pipelines using the Databricks platform on Azure. You'll partner with clients to understand their data needs and develop innovative solutions that drive business transformation. You'll also contribute to best practice implementation and continuous improvement within cross-functional engineering teams. What You'll Do Design and develop robust pipelines using DeltaLake, Spark Structured Streaming … Kafka and Azure Event Hubs Apply DevOps principles to develop CI/CD pipelines using Azure DevOps, Jenkins, or GitHub Actions Collaborate with clients and stakeholders to translate data needs into strategic technical solutions Champion clean code, data lifecycle optimisation, and software engineering best practices What We're Looking For Proven hands-on experience with Databricks More ❯

Job Title: Data & Migration Workstream Lead Location: London (Hybrid 1-2 days) Job Type: Full-time, Permanent Salary: £100,000 - £115,000 + Benefits Industry: Financial Technology A leading FinTech client based in London is seeking a hands-on … Data & Migration Workstream Lead to own and deliver all data-related activities across complex projects. This role requires strong expertise in data migration, pipeline development, and stakeholder management within banking or fintech environments, experience in BaaS is highly desirable. You'll lead data migration strategy, execution, and governance, ensuring smooth, high … quality transitions aligned with business goals. Key Responsibilities: Lead end-to-end delivery of the Data & Migration workstream across multiple programmes Develop robust data pipelines and reporting solutions to meet client and business needs Act as primary liaison between clients, technical teams, and workstream leads Define migration strategy, data mapping, validation, and support dress More ❯

days onsite per week End Date: 28/11/2025 Role Overview: We are seeking a highly skilled Hadoop Engineer to support and enhance our Operational Data Platform (ODP) deployed in an on-premises environment. The ideal candidate will have extensive experience in the Hadoop ecosystem, strong programming skills, and a solid understanding of infrastructure-level data analytics. This role focuses on building and maintaining scalable, secure, and high-performance data pipelines within enterprise-grade on-prem systems. Key Responsibilities: Design, develop, and maintain data pipelines using Hadoop technologies in an on-premises infrastructure. Build and optimise workflows using Apache Airflow and Spark Streaming for real-time data processing. … Develop robust data engineering solutions using Python for automation and transformation. Collaborate with infrastructure and analytics teams to support operational data use cases. Monitor and troubleshoot data jobs, ensuring reliability and performance across the platform. Ensure compliance with enterprise security and data governance standards. Required Skills & Experience: Minimum 5 years of experience More ❯

healthcare. We work with leaders and frontline teams to improve health, transform healthcare, embed life science innovation and boost growth through investment. With unmatched access to UK healthcare data and award-winning data science expertise, our team are a driving force for delivering positive and meaningful change. Everyone at CF is passionate about healthcare. We understand … diagnostics, and health tech companies as well as their investors. We support the life sciences industry in the uptake of innovation including access, pathway transformation, and use of data & digital, and how they partner with health systems to improve patient outcomes. We have achieved Chartered Management Consulting (ChMC) accreditation for our learning and development programme, the highest recognition … have seen our staff develop, grow and be promoted to the leadership team. Whether your preference is to follow a path in the consulting team or in the data innovation team, the learning and development programme will set you up for success. Year One Training: In your first year, you will undergo a comprehensive training programme designed to More ❯

SQL, ETL, Azure Senior Data Engineer is required to join a forward-thinking data team within a thriving city-based insurance group. This role will see you playing a critical role in delivering reliable, scalable and business-focused data solutions. With a strong focus on Microsoft technologies and cloud-based tools, you’ll work … through data. The ideal candidate here will have a strong background in insurance MI or reporting—experience within an MGA or insurance carrier is essential. Key Responsibilities Deliver data solutions and changes that support evolving business requirements. Build and maintain robust, scalable data pipelines using SQL and ETL best practices. Collaborate with stakeholders to analyse, define … and implement solutions to complex data challenges. Proactively assess the impact of changes on the broader data model and ensure integrity is maintained. Work alongside the MI/reporting team to ensure data is accurately reflected in dashboards and reporting tools. Consult with business analysts, system owners and architects to align technical delivery with More ❯

Metyis is growing! We are looking for a Data Science Principal with +8 years of experience to join our Data and Analytics team in London. Who we are Metyis is a global and forward-thinking firm operating across a wide range of industries, developing and delivering Big Data, Digital Commerce, Marketing & Design solutions and … management oversight required to meet client expectations. Responsibilities may include overall project delivery quality, development of presentations, and managing of external relationships. Function as a sounding board for data and analytics related questions of client business leadership. Seek compelling opportunities beyond the scope of the current project. Provide guidance to more junior members of the team, while orchestrating … consulting experience or relevant industry experience, with at least 3+ years at a project lead level. Master (or Ph.D.) degree in a quantitative field with a focus on data analysis (e.g. econometrics, AI, mathematics, physics, and other exact sciences). Sharp thinking ability to be able to quickly differentiate major contributors from irrelevant details and to hierarchically structure More ❯

Join to apply for the Senior Software Engineer - Data role at Count Continue with Google Continue with Google Join to apply for the Senior Software Engineer - Data role at Count Get AI-powered advice on this job and more exclusive features. Sign in to access AI-powered advices Continue with Google Continue with Google Continue with … and experience talk with your recruiter to learn more. Base pay range About Us We are a fast-growing team on a mission to reimagine analytics and make data accessible to all. The Count canvas combines the power of data notebooks with the collaborative workflow of digital whiteboards. Were often referred to as the Figma for … data because of the way Count transforms the way data teams work with the wider business through greater transparency and trust. Since launching in September 2022 we have seen the canvas concept explode, with Count empowering some of Europes leading tech companies including Cleo, BeautyPie, TooGoodToGo and Omnipresent to revolutionise how their teams understand and work More ❯

providing expertise and guidance across the team. Work on BI development, data modelling, and reporting, using Qlik. Design and manage databases including migrations and data pipeline management. Source and integrate data from a range of systems, including relational databases, flat files, and APIs. Champion robust documentation and cross-training to ensure team resilience … and minimise single points of failure. Desirable Skills Strong experience in development in Power Apps, Power Automate and Power Platform Data modelling and logical database design experience Knowledge of C# Project management experience DCS Recruitment and all associated companies are committed to creating a working environment where diversity is celebrated and everyone is treated fairly, regardless of gender More ❯

providing expertise and guidance across the team. Work on BI development, data modelling, and reporting, using Qlik. Design and manage databases including migrations and data pipeline management. Source and integrate data from a range of systems, including relational databases, flat files, and APIs. Champion robust documentation and cross-training to ensure team resilience … and minimise single points of failure. Desirable Skills Strong experience in development in Power Apps, Power Automate and Power Platform Data modelling and logical database design experience Knowledge of C# Project management experience DCS Recruitment and all associated companies are committed to creating a working environment where diversity is celebrated and everyone is treated fairly, regardless of gender More ❯

version control systems like Azure DevOps is a strong plus. Main responsibilities: Design, develop, and deploy applications using Google Cloud Functions (Python or Node.js). Implement and optimize data pipelines using Google Cloud Dataflow. Manage and query relational databases using Cloud SQL (PostgreSQL/MySQL). Handle file operations and trigger-based workflows using Google Cloud Storage. Configure More ❯

Head of Data Engineering Manchester (Hybrid)Permanent Full-timeSalary: £100,000 - £120,000 (DOE) A major UK financial services organisation is seeking a visionary Head of Data Engineering to lead and scale its enterprise-wide data platforms. Youll drive the design and delivery of modern data solutions across cloud, analytics, and core … banking systems — enabling smarter decisions, customer innovation, and regulatory excellence. Key Responsibilities: Lead and develop high-performing data engineering teams Architect scalable, secure data pipelines and platforms (Azure, Databricks, etc.) Partner with product, risk, and tech leaders to deliver data-driven outcomes Champion best practices in data governance, quality, and DevOps What … You’ll Bring: Proven leadership in large-scale data engineering within complex environments Deep technical expertise in cloud-native data architecture Strong strategic thinking and stakeholder engagement skills Passion for transforming legacy systems into modern, value-driving platforms This is a rare opportunity to shape the future of data in a trusted institution committed More ❯

Head of Data Engineering Manchester (Hybrid) Permanent Full-time Salary: £100,000 - £120,000 (DOE) A major UK financial services organisation is seeking a visionary Head of Data Engineering to lead and scale its enterprise-wide data platforms. Youll drive the design and delivery of modern data solutions across cloud, analytics, and … core banking systems — enabling smarter decisions, customer innovation, and regulatory excellence. Key Responsibilities: Lead and develop high-performing data engineering teams Architect scalable, secure data pipelines and platforms (Azure, Databricks, etc.) Partner with product, risk, and tech leaders to deliver data-driven outcomes Champion best practices in data governance, quality, and DevOps … What You'll Bring: Proven leadership in large-scale data engineering within complex environments Deep technical expertise in cloud-native data architecture Strong strategic thinking and stakeholder engagement skills Passion for transforming legacy systems into modern, value-driving platforms This is a rare opportunity to shape the future of data in a trusted institution More ❯

ideal candidate will have extensive hands-on experience building and implementing ELK solutions from the ground up-not just monitoring existing systems. Key Responsibilities: Design, build, and implement data ingestion pipelines using Logstash and Kafka Set up and configure the ELK Stack (Elasticsearch, Logstash, Kibana), including Fleet and Integrations Collaborate with stakeholders to analyze data and … availability, and reliability of the ELK environment Maintain and support the ELK stack and its integrations Apply domain knowledge in security and cloud environments to enhance data pipeline resilience and compliance Mandatory Skills & Qualifications: 8+ years of hands-on experience with Elasticsearch , Logstash , and Kibana Proven track record of implementing and maintaining ELK stacks Experience designing and … developing data pipelines Strong exposure to cloud platforms (e.g., AWS, Azure, GCP) Proficiency with Kafka for data streaming and ingestion Background or familiarity in the security domain Deep understanding of ELK ecosystem components including Fleet , Beats , and advanced Kibana dashboards Strong problem-solving and analytical skills Desirable: Experience with Elastic Security or Observability solutions Certification in More ❯

Location: Manchester (Hybrid) Department : Data Reports To: Lead Data Engineer About CAVU For airports, for partners, for people. We are CAVU. At CAVU our purpose is to find new and better ways to make airport travel seamless and enjoyable for everybody. From the smallest ideas to the biggest changes, every day here is about creating better … boundaries, then CAVU is the place for you. Together, we can reach new heights. Together, we are CAVU. What's the role? CAVU is continuing its digital and data transformation, and we're looking for a Data Engineer to help shape the next phase. You'll be joining a centralised, expert data team that … across product, commercial, and operations - and this role will have a big say in what we build next. You'll be responsible for designing and building robust, scalable data pipelines using PySpark, SQL and Databricks - enabling our analytics, BI and data science colleagues to unlock real value across the business. This is a brilliant opportunity for More ❯

Are you a SQL Server expert with a passion for data architecture and engineering in the fast-paced world of finance? We're looking for a Front Office Data Engineer/Data Architect to join a high-performing team at the heart of a leading financial institution. The Role: You'll be embedded within … the Front Office Technology Team, reporting directly to the team lead and collaborating closely with four other talented data engineers. This is a hybrid role, offering the flexibility of remote work combined with the energy of on-site collaboration. What You'll Be Doing: Designing, developing, and maintaining robust data pipelines and architectures Working with modern … Microsoft SQL Server (2016 or later) in an on-prem environment Supporting front office operations with real-time, high-quality data solutions Leveraging tools like Azure Data Factory, Microsoft Python, and Azure Fabric (if you have them!) What We're Looking For: Strong experience with Microsoft SQL Server (2016+) - this is a must-have Solid background More ❯