401 to 425 of 1,060 Data Pipeline Jobs in England

Data Engineering Lead – Azure & Databricks | Full Time Role - Hybrid 2/3 days per week London This role has a Flexible salary and company benefits as well get in touch to learn more! My client is looking for a hands-on Data Engineering Lead to shape and evolve a modern hybrid data platform built … on Azure and Databricks. This role is central to enabling scalable, high-performance data solutions that drive analytics and reporting across the organisation. What does the role consist of? Design and enhance data pipelines that support large-scale ingestion, transformation, and delivery across varied sources. Leverage Azure and Databricks to ensure reliable, high-throughput data movement and integration for analytics and BI. Apply best practices in orchestration, monitoring, and error handling to maintain consistent and dependable data flows. Optimise hybrid cloud architecture for performance, scalability, and cost-efficiency. Implement smart storage strategies, compute resource allocation, and caching techniques to support growing data volumes. Lead and mentor a team of More ❯

Data Engineering Lead – Azure & Databricks | Full Time Role - Hybrid 2/3 days per week London This role has a Flexible salary and company benefits as well get in touch to learn more! My client is looking for a hands-on Data Engineering Lead to shape and evolve a modern hybrid data platform built … on Azure and Databricks. This role is central to enabling scalable, high-performance data solutions that drive analytics and reporting across the organisation. What does the role consist of? Design and enhance data pipelines that support large-scale ingestion, transformation, and delivery across varied sources. Leverage Azure and Databricks to ensure reliable, high-throughput data movement and integration for analytics and BI. Apply best practices in orchestration, monitoring, and error handling to maintain consistent and dependable data flows. Optimise hybrid cloud architecture for performance, scalability, and cost-efficiency. Implement smart storage strategies, compute resource allocation, and caching techniques to support growing data volumes. Lead and mentor a team of More ❯

Fimador is currently recruiting for a Senior Data Engineer to lead a team developing cutting-edge … data-driven products. This role is helping the firm pioneer AI and ML in the global environment. This role is central to designing and maintaining scalable pipelines, data platforms, and integrations, while ensuring solutions meet regulatory standards and align with architectural best practices. Key Responsibilities: Build and optimise scalable data pipelines using Databricks and … backlog refinement. Promote engineering best practices including CI/CD, code reviews, and testing. Research and introduce new tools, technologies, and methodologies. Ideal experience: Experience with efficient, reliable data pipelines that improve time-to-insight. Knowledge of secure, auditable, and compliant data workflows. Know how on optimising performance and reducing costs through Spark and Databricks tuning. More ❯

Senior Data Engineer This company is leading the way in reshaping how property is managed across the UK. Blending technology, insight, and people, they’re on a mission to create smarter, more sustainable estates. This Senior Data Engineer role is central to that mission, building data platforms that power informed decisions at scale. Role … Location: Leicestershire, 1 day per week in the office Package: £60,000- £70,000pa & Benefits Industry: Property & Facilities Management What You’ll Be Doing: Building and maintaining scalable data pipelines using Microsoft Fabric, Data Factory, OneLake, Dataflows, and Notebooks. Creating robust data models to support analytics and reporting functions. Integrating and transforming data from cloud and on-premise sources using metadata-driven processes. Developing secure, governed multi-tenant data environments with row- and tenant-level access controls. Ensuring data quality, consistency, and compliance across the stack, aligned with industry standards like Uniclass and SFG20. Collaborating with analysts and developers to turn business requirements into scalable data More ❯

Senior Data Engineer This company is leading the way in reshaping how property is managed across the UK. Blending technology, insight, and people, they’re on a mission to create smarter, more sustainable estates. This Senior Data Engineer role is central to that mission, building data platforms that power informed decisions at scale. Role … Location: Leicestershire, 1 day per week in the office Package: £60,000- £70,000pa & Benefits Industry: Property & Facilities Management What You’ll Be Doing: Building and maintaining scalable data pipelines using Microsoft Fabric, Data Factory, OneLake, Dataflows, and Notebooks. Creating robust data models to support analytics and reporting functions. Integrating and transforming data from cloud and on-premise sources using metadata-driven processes. Developing secure, governed multi-tenant data environments with row- and tenant-level access controls. Ensuring data quality, consistency, and compliance across the stack, aligned with industry standards like Uniclass and SFG20. Collaborating with analysts and developers to turn business requirements into scalable data More ❯

Data Analyst (BI & SQL) Up to £50K plus benefits Birmingham Role Summary We are seeking a skilled and motivated SQL Analyst. In this role, you will play a vital part in analysing, creating, implementing, and maintaining data infrastructure, ensuring the seamless operation of corporate IT systems. This is a unique opportunity to contribute to our journey … of innovation, efficiency, and customer excellence. Core Duties Design, implement, and maintain on-prem and cloud data infrastructure to support IT services. Administer corporate databases, including maintenance, upgrades, and monitoring for resilience and efficiency. Develop and implement data pipelines for data warehousing and analytics requirements. Perform database administration tasks such as user management, backups … APIs and web services. Experience Required In-depth knowledge of Microsoft SQL Server (2017 and above), including SSMS, SSRS, SSAS, SSIS, and SQL scripting. Expertise in database development, data cubes, and data marts. Proficiency with data visualisation tools like Power BI, Tableau, or SAP BusinessObjects. Familiarity with cloud data services such as More ❯

Data Analyst - Matillion £475 - 525 Inside IR via umbrella 6 months Gloucestershire - twice a week on site We're looking for a Data Analyst who can bridge the gap between technical detail and business insight. This role is perfect for someone who enjoys working with non-technical stakeholders, translating complex data requirements into clear … actionable outcomes that drive smarter decision-making. You'll play a hands on role in data analysis, transformation and root-cause investigation helping the business get to the "why" behind the numbers. We need someone who's confident navigating modern data stacks and comfortable turning raw data into meaningful intelligence. What you'll be … doing: Partnering closely with non-technical teams to understand and define data requirements Translating business questions into SQL queries, reports, and dashboards Performing root-cause analysis to identify data quality or process issues Working with Matillion ETL to design, optimise and maintain data pipelines Supporting the development and maintenance of Snowflake based data More ❯

Job Title : Lead Data & Machine Learning Architect Location : Yate (On-Site 2 Days Per Week) Salary : Up to £60,000 (Depending on Experience) Overview of Business: This is a chance to join a team who are creating an Energy Management Solutions to minimise energy cost & increase higher returns from energy assets. We are seeking a highly skilled Lead … Data & Machine Learning Architect to design and lead the development of robust data and machine learning systems. You will take ownership of the data architecture, drive the development and deployment of machine learning models, and contribute to the strategic use of data across the organisation. Key Responsibilities: Data Architecture Schema … Model Ownership: Design, implement, and maintain logical and physical data models, primarily using PostgreSQL. Data Integration: Build and manage robust data pipelines to ingest, clean, and unify data from APIs, sensors, and other external sources, using tools like Dagster. System Design: Select appropriate storage and processing technologies tailored to system needs. Governance More ❯

Job Title : Lead Data & Machine Learning Architect Location : Yate (On-Site 2 Days Per Week) Salary : Up to £60,000 (Depending on Experience) Overview of Business: This is a chance to join a team who are creating an Energy Management Solutions to minimise energy cost & increase higher returns from energy assets. We are seeking a highly skilled Lead … Data & Machine Learning Architect to design and lead the development of robust data and machine learning systems. You will take ownership of the data architecture, drive the development and deployment of machine learning models, and contribute to the strategic use of data across the organisation. Key Responsibilities: Data Architecture Schema … Model Ownership: Design, implement, and maintain logical and physical data models, primarily using PostgreSQL. Data Integration: Build and manage robust data pipelines to ingest, clean, and unify data from APIs, sensors, and other external sources, using tools like Dagster. System Design: Select appropriate storage and processing technologies tailored to system needs. Governance More ❯

Data Engineer – Hedge Fund | AWS | SQL | Python | Power BI Location: London Contract: Full-time Salary: £150,000 + Bonus + Benefits A leading hedge fund is seeking a skilled Data Engineer to join its front-office technology team. This is a high-impact role where you’ll work directly with portfolio managers, quants, and analysts to … design and deliver scalable, cloud-based data solutions that power trading and investment strategies. Key Responsibilities Design, build, and optimise data pipelines and ETL workflows using AWS, Python, and SQL. Develop and maintain data models, ensuring accuracy and reliability of trading and market data. Deliver Power BI dashboards and reports to provide real-time … insights for investment teams. Partner with stakeholders across the equities business to understand data requirements and deliver impactful solutions. Ensure data quality, governance, and performance standards are consistently met. Collaborate with quants, traders, and developers to support research, trading, and risk workflows. What you’ll bring Proven experience as a Data Engineer within financial More ❯

Data Engineer – Hedge Fund | AWS | SQL | Python | Power BI Location: London Contract: Full-time Salary: £150,000 + Bonus + Benefits A leading hedge fund is seeking a skilled Data Engineer to join its front-office technology team. This is a high-impact role where you’ll work directly with portfolio managers, quants, and analysts to … design and deliver scalable, cloud-based data solutions that power trading and investment strategies. Key Responsibilities Design, build, and optimise data pipelines and ETL workflows using AWS, Python, and SQL. Develop and maintain data models, ensuring accuracy and reliability of trading and market data. Deliver Power BI dashboards and reports to provide real-time … insights for investment teams. Partner with stakeholders across the equities business to understand data requirements and deliver impactful solutions. Ensure data quality, governance, and performance standards are consistently met. Collaborate with quants, traders, and developers to support research, trading, and risk workflows. What you’ll bring Proven experience as a Data Engineer within financial More ❯

s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world. YOUR ROLE As a Data Developer within Capgemini’s Financial Services practice, you will be responsible for designing, developing, and maintaining data solutions that enable business insights and operational efficiency. The role … involves working with structured and unstructured data , building data pipelines , and ensuring data quality and governance across on-premises and cloud environments. YOUR PROFILE Extract data from diverse sources (flat files, APIs, databases) using SSIS connection managers and configure secure, reliable connectivity. ETL Package Development: Design and implement SSIS packages with Control … Flow and Data Flow tasks for data extraction, transformation, and loading into staging tables. Data Transformation & Cleansing: Apply transformations (Derived Column, Lookup, Conditional Split) to standardize and validate data before loading into trusted staging. Performance Optimization & Error Handling: Optimize SSIS packages for large data volumes using Bulk Insert or parallel More ❯

involves spending at least two days per week currently, or 40% of our time, at our London Office About this opportunity A fantastic opportunity has emerged for a Data/Software Engineering leader to collaborate with multi-functional teams within the Personalised Experiences and Communications Platform As a head of data your responsibilities will be delivering … the highest quality data capability, drawing upon your engineering expertise, whilst being open minded to the opportunities the cloud provides What you'll do Lead the software engineering squads in delivering high-quality software applications and systems that leverage AI and machine learning to provide personalised experiences for our twenty-six million customers and users. Work with the … and challenges that arise during the software development lifecycle. Deliver technical solutions that can be employed across multiple entities within the group. Define consumption and integration patterns and data models and contracts. Create automation tools for data reconciliation and curation. Drive the culture of delivering highly secured and high-quality software. Identify and eliminate recurring issues More ❯

A leading global investment firm is seeking a Market Data Engineer to join its London-based team and help build robust, scalable tick data infrastructure that powers systematic trading strategies across asset classes. This is a high-impact engineering role focused on designing and optimizing real-time and historical market data pipelines in a … cloud-native environment. You'll work closely with trading and quant teams to ensure data is clean, fast, and accessible - enabling research, signal generation, and execution at scale. What You'll Do Build and maintain high-performance tick data pipelines for ingesting, processing, and storing large volumes of market data. Work with time-series databases (e.g. … KDB, OneTick) and Parquet-based file storage to optimize data access and retrieval. Design scalable cloud-native solutions (AWS preferred) for market data ingestion and distribution. (Bonus) Integrate Apache Iceberg for large-scale data lake management and versioned data workflows. Collaborate with trading and engineering teams to define data requirements More ❯

big ambitions but needs more excellent minds to challenge the status-quo and help it reach new horizons. Where you come in? You'll be joining the Portfolio Data squad to tackle some of the most critical challenges in transforming how we manage insurance exposure and risk aggregations. The current data estate is siloed, inefficient, and … difficult to scale, so the team is designing a robust solution to support seamless data ingestion, scalable storage, and optimise for downstream use cases, including developing our algorithmic underwriting capability. Alongside this, the squad is building a trusted source of truth for insurance exposure data — aligning methodologies with the Exposure Management team and delivering intuitive, high … value views and dashboards for Portfolio Management. By joining us, you'll help modernize our data landscape, eliminate manual and unreliable processes, and empower the business with faster, smarter, and more reliable insights. What you will be doing: • Work with actuaries, data scientists and engineers to design, build, optimise and maintain production grade data More ❯

and artificial intelligence, our technology suite provides tailored, exclusive insights that support our clients in achieving performance and efficiency. By securely handling and combining private and public shipping data flows, and applying advanced analytics, insights are delivered over web and mobile applications, as well as through a rich set of APIs and SDKs. Our backend architecture is abstracted … can be directly embedded in our client's system topologies. About the role: We are looking for a motivated, curious, and solutions-oriented Product Manager with a strong data science and technical background to join our team in London/Athens. This role sits within one of our backend teams, requiring heavy collaboration with data scientists … and backend engineers. You will be expected to translate complex data-driven workflows into clear product requirements and contribute to the development of technically sophisticated features. Help us shape the future of the Signal Ocean Platform, our core SaaS product. You'll build deep knowledge of the shipping industry and our platform, bridging the gap between business needs More ❯

deep business knowledge, operational excellence, and cutting-edge solutions – we help companies across industries get ahead and stay ahead. Powered by curiosity, courage, and innovation, our teams implement data, technology, and AI to create tomorrow, today. Get to know us at genpact.com and on LinkedIn, X, YouTube, and Facebook. Inviting Applications for the role of Senior Principal Consultant … team. In this role, you will be instrumental in designing, developing, deploying, and managing AI/ML solutions on the Microsoft Azure platform. You will work closely with data scientists, researchers, and product managers to translate complex analytical models into production-ready, scalable applications. Your expertise in Azure AI services, MLOps, and data engineering will be … Azure Synapse Analytics). • Model Deployment & Management: Implement robust MLOps practices for continuous integration, continuous delivery (CI/CD), monitoring, and retraining of machine learning models in Azure. • Data Pipelining: Build and optimize scalable data pipelines for ingesting, transforming, and preparing large datasets for AI model training and inference. • Performance Optimization: Optimize AI models and their More ❯

deep business knowledge, operational excellence, and cutting-edge solutions – we help companies across industries get ahead and stay ahead. Powered by curiosity, courage, and innovation, our teams implement data, technology, and AI to create tomorrow, today. Get to know us at genpact.com and on LinkedIn, X, YouTube, and Facebook. Inviting Applications for the role of Senior Principal Consultant … team. In this role, you will be instrumental in designing, developing, deploying, and managing AI/ML solutions on the Microsoft Azure platform. You will work closely with data scientists, researchers, and product managers to translate complex analytical models into production-ready, scalable applications. Your expertise in Azure AI services, MLOps, and data engineering will be … Azure Synapse Analytics). • Model Deployment & Management: Implement robust MLOps practices for continuous integration, continuous delivery (CI/CD), monitoring, and retraining of machine learning models in Azure. • Data Pipelining: Build and optimize scalable data pipelines for ingesting, transforming, and preparing large datasets for AI model training and inference. • Performance Optimization: Optimize AI models and their More ❯

At Neptune, we believe great technology starts with great people - and great decisions start with great data. From managing stock and inventory to understanding our customers, data drives everything we do. We're looking for a Data Engineer to help shape how we collect, structure, and use data across the business. You'll play … key role in delivering reliable, high-quality datasets that power smarter, faster decisions every day. This is a hands-on role where you'll design and maintain the data pipelines, integrations, and platforms that keep Neptune's data accurate, accessible, and secure. Your Key Responsibilities Design, build, and maintain robust ETL pipelines to efficiently extract, transform … and load data from multiple sources. Develop and optimise SQL queries, stored procedures, and database scripts to deliver high-performance data processing. Implement automated data flows that connect operational systems with analytics and business intelligence (BI) tools. Re-engineer manual or ad hoc data processes into scalable, repeatable workflows. Ensure data More ❯

Lead Data Engineer: Hands-On Execution & Transformation Leadership Location: London (Hybrid Working Model) Contract Length: 12-Month Engagement Rate: Up to £600 per day (Outside IR35) A Tier 1 Financial Services company is undertaking a pivotal, large-scale data strategy transformation, migrating its entire data estate to a cutting-edge, cloud-native platform built … on Snowflake (hosted on Azure) . We are seeking a highly experienced Lead Data Engineer for a critical, multi-faceted leadership role . This engagement demands a senior professional who can seamlessly integrate deep, recent, hands-on engineering execution with strategic team guidance to deliver a scalable, high-performance data ecosystem. Candidates whose recent roles are … depth and delivery , not just breadth and design. Deep Hands-On Engineering: Act as the principal technical expert, leading the development and implementation of highly scalable and repeatable data pipelines in Snowflake . You must have demonstrable, recent experience executing complex data modeling standards using dbt (data build tool) for transformation and orchestration. Crucial More ❯

Lead Data Engineer: Hands-On Execution & Transformation Leadership Location: London (Hybrid Working Model) Contract Length: 12-Month Engagement Rate: Up to £600 per day (Outside IR35) A Tier 1 Financial Services company is undertaking a pivotal, large-scale data strategy transformation, migrating its entire data estate to a cutting-edge, cloud-native platform built … on Snowflake (hosted on Azure) . We are seeking a highly experienced Lead Data Engineer for a critical, multi-faceted leadership role . This engagement demands a senior professional who can seamlessly integrate deep, recent, hands-on engineering execution with strategic team guidance to deliver a scalable, high-performance data ecosystem. Candidates whose recent roles are … depth and delivery , not just breadth and design. Deep Hands-On Engineering: Act as the principal technical expert, leading the development and implementation of highly scalable and repeatable data pipelines in Snowflake . You must have demonstrable, recent experience executing complex data modeling standards using dbt (data build tool) for transformation and orchestration. Crucial More ❯

Data Engineering Lead Salary: Up to £95,000 + Bonus I am working with a technology driven organisation who are leaders in their field that are delivering some of the world's most innovative projects in their space. With a strong focus on innovation, sustainability and data-driven decision-making, they are investing heavily in their … digital transformation journey. As part of this growth, they are looking to bring on a Data Engineering Lead to shape and optimise their hybrid Azure/Databricks data platform. This is a strategic and hands-on role where you will lead the development of scalable data solutions and mentor a team of BI Developers … a collaborative environment that values technical excellence, continuous learning and inclusive leadership. In this role, you will be responsible for: Leading a technical team to deliver dashboards and data products aligned with business needs. Designing and developing robust data pipelines using Azure Data Factory, Databricks, and SQL. Architecting a scalable, high-performance data More ❯

Data Engineering Lead Salary: Up to £95,000 + Bonus I am working with a technology driven organisation who are leaders in their field that are delivering some of the world's most innovative projects in their space. With a strong focus on innovation, sustainability and data-driven decision-making, they are investing heavily in their … digital transformation journey. As part of this growth, they are looking to bring on a Data Engineering Lead to shape and optimise their hybrid Azure/Databricks data platform. This is a strategic and hands-on role where you will lead the development of scalable data solutions and mentor a team of BI Developers … a collaborative environment that values technical excellence, continuous learning and inclusive leadership. In this role, you will be responsible for: Leading a technical team to deliver dashboards and data products aligned with business needs. Designing and developing robust data pipelines using Azure Data Factory, Databricks, and SQL. Architecting a scalable, high-performance data More ❯

Senior Data Engineer Salary: £70,000 Location: Wiltshire (2 Days a Week in Office) Step into a leadership role where your technical expertise fuels strategic decision-making across multiple regions. Own the evolution of a resilient, scalable data ecosystem built on Azure and next-gen analytics tools The Opportunity This is an exciting opportunity to join … a forward-thinking organisation that's putting data at the heart of its strategy and decision-making. You'll play a key role in shaping and managing a modern, cloud-based data infrastructure that supports operations across the UK, Ireland, and North America. As a senior leader within a collaborative data and analytics team … you'll have the freedom to innovate, implement new technologies, and influence how data drives business growth. You'll lead cloud migration initiatives, enhance system performance, and ensure data quality and security at scale. If you're looking to make a measurable impact and take ownership of a global data ecosystem, this role offers More ❯

Senior Data Engineer Salary: £70,000 Location: Wiltshire (2 Days a Week in Office) Step into a leadership role where your technical expertise fuels strategic decision-making across multiple regions. Own the evolution of a resilient, scalable data ecosystem built on Azure and next-gen analytics tools The Opportunity This is an exciting opportunity to join … a forward-thinking organisation that's putting data at the heart of its strategy and decision-making. You'll play a key role in shaping and managing a modern, cloud-based data infrastructure that supports operations across the UK, Ireland, and North America. As a senior leader within a collaborative data and analytics team … you'll have the freedom to innovate, implement new technologies, and influence how data drives business growth. You'll lead cloud migration initiatives, enhance system performance, and ensure data quality and security at scale. If you're looking to make a measurable impact and take ownership of a global data ecosystem, this role offers More ❯