451 to 475 of 1,098 Data Pipeline Jobs in the UK excluding London

Insight Global’s client is looking for a Senior Data Engineer to join their Finance and Operations team, responsible for designing and maintaining Azure-based data pipelines and APIs, building and optimizing ETL processes, managing large datasets, troubleshooting data issues, and documenting technical solutions. The ideal candidate will have strong coding skills in Python … and SQL, experience with dbt, Azure DevOps, and CI/CD best practices, and a solid understanding of data warehousing principles. Success in this role requires excellent communication, a collaborative mindset, and proactive problem-solving to mitigate blockers and deliver scalable solutions. Candidates with experience in tools like Snowflake, Airflow, or Terraform, familiarity with infrastructure as code, and … exposure to financial and operational data domains will stand out. This is a full-time onsite position in our London office, working closely with global teams to ensure data quality, automation, and continuous improvement. Please note, this is a 6 month contract-to-hire position and would require you to be on-site 5 days a More ❯

Job summary We're seeking an experienced, forward-thinking Technical Lead to drive the delivery and evolution of the South West Secure Data Environment (SWSDE). This pioneering regional platform is transforming how health and care data is securely and ethically linked for research. Our aim is to improve health and wellbeing by making research safer … forward and grow our capacity to deliver projects. The Technical Lead will build a multi-disciplinary technical team and oversee all aspects of SWSDE's delivery, including infrastructure, data pipelines, security, governance and scalability. You will ensure the environment remains robust, trusted and aligned with the highest standards of data protection and interoperability, including SATRE and … ISO27001, giving partners and the public confidence their data is safe. This hands-on role suits a leader who thrives on managing complexity and problem solving. Collaboration is key, working with partners across the NHS, local authorities, academia and national bodies. This is a rare opportunity to shape a regionally significant, nationally connected data platform, setting More ❯

Your new company A Principal Data Engineer/Architect is required on a permanent basis for a forward-thinking organisation at the heart of Leeds. The Data Services team are on a mission to unlock the value of data by delivering high-quality, secure, and accessible data services. With a focus on … modern cloud-based technologies and strong partnerships, they help colleagues navigate the complexities of a data-driven world. Your new role As a Principal Data Engineer, you will be instrumental in shaping the organisations strategic cloud data platform. You'll lead the design and implementation of scalable data pipelines, drive innovation in … data-centric products, and champion automation and predictive analytics. This is a senior technical leadership role where you'll establish best practices, ensure compliance, and deliver smart, customer-focused solutions. What you'll need to succeed You'll bring extensive experience in data engineering within Azure environments, with a strong track record in modernisation and large More ❯

computational biology, combining machine learning, cloud infrastructure, and scientific research to accelerate discoveries in life sciences. As a Staff Backend Engineer , you’ll build the distributed systems and data infrastructure that power the lab’s next-generation biology platform. From model serving to real-time data processing, your work will form the backbone of a platform … enabling scientists to explore and manipulate biological data in entirely new ways. What you’ll do Design and own backend architecture for large-scale, data-intensive applications. Develop and optimize APIs that handle complex biological and ML-driven workloads. Build and maintain data pipelines for ingesting, transforming, and serving scientific data at … and long-term scalability. Nice-to-haves Experience with MLOps and model-serving infrastructure. Background in high-performance computing or large-scale scientific workloads. Expertise in data pipeline architecture and real-time streaming systems. Knowledge of scientific or biological computing environments . This is a rare opportunity to join a deep-tech AI lab where backend engineering More ❯

computational biology, combining machine learning, cloud infrastructure, and scientific research to accelerate discoveries in life sciences. As a Staff Backend Engineer , you’ll build the distributed systems and data infrastructure that power the lab’s next-generation biology platform. From model serving to real-time data processing, your work will form the backbone of a platform … enabling scientists to explore and manipulate biological data in entirely new ways. What you’ll do Design and own backend architecture for large-scale, data-intensive applications. Develop and optimize APIs that handle complex biological and ML-driven workloads. Build and maintain data pipelines for ingesting, transforming, and serving scientific data at … and long-term scalability. Nice-to-haves Experience with MLOps and model-serving infrastructure. Background in high-performance computing or large-scale scientific workloads. Expertise in data pipeline architecture and real-time streaming systems. Knowledge of scientific or biological computing environments . This is a rare opportunity to join a deep-tech AI lab where backend engineering More ❯

computational biology, combining machine learning, cloud infrastructure, and scientific research to accelerate discoveries in life sciences. As a Staff Backend Engineer , you’ll build the distributed systems and data infrastructure that power the lab’s next-generation biology platform. From model serving to real-time data processing, your work will form the backbone of a platform … enabling scientists to explore and manipulate biological data in entirely new ways. What you’ll do Design and own backend architecture for large-scale, data-intensive applications. Develop and optimize APIs that handle complex biological and ML-driven workloads. Build and maintain data pipelines for ingesting, transforming, and serving scientific data at … and long-term scalability. Nice-to-haves Experience with MLOps and model-serving infrastructure. Background in high-performance computing or large-scale scientific workloads. Expertise in data pipeline architecture and real-time streaming systems. Knowledge of scientific or biological computing environments . This is a rare opportunity to join a deep-tech AI lab where backend engineering More ❯

Have you got the right qualifications and skills for this job Find out below, and hit apply to be considered. We are looking for a highly skilled Senior Data Engineering Developer with strong hands-on experience in Azure Data Factory , SQL development , and ETL tools . The ideal candidate will design and implement data pipelines, optimize performance, and collaborate with stakeholders in an Agile environment to deliver robust data solutions. Key Responsibilities: Design and Develop Pipelines: Build and maintain Azure Data Factory pipelines and implement CI/CD processes for automated deployments. SQL Development: Write and optimize complex stored procedures , functions , and queries for high-performance data … . Familiarity with Agile methodologies . Understanding of cloud concepts and data warehouse design . Preferred Qualifications: Experience with SAP BODS . Knowledge of Azure DevOps for pipeline automation. Strong problem-solving and communication skills. More ❯

Enterprise Data Architect – Azure/Snowflake £105K - £110K + + Bonus + Bens London – 1 day PW in office (EC3) As part of a data transformation programme, a major reinsurer is looking for an experienced Enterprise Data Architect to join them in London. The role will focus around helping to shape and scale their … data strategy, building MVP’s and designing Snowflake DWH. What You’ll Do: Design and manage enterprise data architecture using Azure and Snowflake Build and optimize data pipelines, warehouses, and lakes Work with engineering, analytics, and business teams to align on data needs Define best practices for data governance, quality … Help modernize legacy systems and move them to the cloud Stay up to date on new tools, trends, and technologies What We’re Looking For: 7+ years in data architecture or related roles Solid hands-on experience with Azure data services and Snowflake Strong skills in data modeling , SQL , and ETL/ELT design More ❯

Enterprise Data Architect – Azure/Snowflake £105K - £110K + + Bonus + Bens London – 1 day PW in office (EC3) As part of a data transformation programme, a major reinsurer is looking for an experienced Enterprise Data Architect to join them in London. The role will focus around helping to shape and scale their … data strategy, building MVP’s and designing Snowflake DWH. What You’ll Do: Design and manage enterprise data architecture using Azure and Snowflake Build and optimize data pipelines, warehouses, and lakes Work with engineering, analytics, and business teams to align on data needs Define best practices for data governance, quality … Help modernize legacy systems and move them to the cloud Stay up to date on new tools, trends, and technologies What We’re Looking For: 7+ years in data architecture or related roles Solid hands-on experience with Azure data services and Snowflake Strong skills in data modeling , SQL , and ETL/ELT design More ❯

Your new company A Principal Data Engineer/Architect is required on a permanent basis for a forward-thinking organisation at the heart of Leeds. The Data Services team are on a mission to unlock the value of data by delivering high-quality, secure, and accessible data services. With a focus on … modern cloud-based technologies and strong partnerships, they help colleagues navigate the complexities of a data-driven world. Your new role As a Principal Data Engineer, you will be instrumental in shaping the organisations strategic cloud data platform. You'll lead the design and implementation of scalable data pipelines, drive innovation in … data-centric products, and champion automation and predictive analytics. This is a senior technical leadership role where you'll establish best practices, ensure compliance, and deliver smart, customer-focused solutions. What you'll need to succeed You'll bring extensive experience in data engineering within Azure environments, with a strong track record in modernisation and large More ❯

m working with a fast-growing global hospitality group that’s redefining modern travel. With several properties across key international cities and airports, they’re expanding quickly, and data is at the heart of their next stage of growth. They’re now hiring a Growth Analytics Manager to join their central commercial team in London. This is a … newly created position designed to modernise how the business uses data across marketing, digital, and revenue. You’ll sit at the intersection of revenue, marketing, and digital, translating data into insight that drives bookings, optimises campaigns, and informs commercial strategy. Your work will directly support senior leadership and shape data-driven decisions across multiple … markets. 🚀 Performance Analytics & Data Strategy This role combines strategic thinking with hands-on delivery. You’ll use data to identify opportunities, improve how we capture and model information, and help build scalable reporting frameworks that bring clarity to business performance. Working closely with the commercial and marketing teams, you’ll consolidate data from multiple More ❯

m working with a fast-growing global hospitality group that’s redefining modern travel. With several properties across key international cities and airports, they’re expanding quickly, and data is at the heart of their next stage of growth. They’re now hiring a Growth Analytics Manager to join their central commercial team in London. This is a … newly created position designed to modernise how the business uses data across marketing, digital, and revenue. You’ll sit at the intersection of revenue, marketing, and digital, translating data into insight that drives bookings, optimises campaigns, and informs commercial strategy. Your work will directly support senior leadership and shape data-driven decisions across multiple … markets. 🚀 Performance Analytics & Data Strategy This role combines strategic thinking with hands-on delivery. You’ll use data to identify opportunities, improve how we capture and model information, and help build scalable reporting frameworks that bring clarity to business performance. Working closely with the commercial and marketing teams, you’ll consolidate data from multiple More ❯

m working with a fast-growing global hospitality group that’s redefining modern travel. With several properties across key international cities and airports, they’re expanding quickly, and data is at the heart of their next stage of growth. They’re now hiring a Growth Analytics Manager to join their central commercial team in London. This is a … newly created position designed to modernise how the business uses data across marketing, digital, and revenue. You’ll sit at the intersection of revenue, marketing, and digital, translating data into insight that drives bookings, optimises campaigns, and informs commercial strategy. Your work will directly support senior leadership and shape data-driven decisions across multiple … markets. 🚀 Performance Analytics & Data Strategy This role combines strategic thinking with hands-on delivery. You’ll use data to identify opportunities, improve how we capture and model information, and help build scalable reporting frameworks that bring clarity to business performance. Working closely with the commercial and marketing teams, you’ll consolidate data from multiple More ❯

Senior Data Consultant Azure/Microsoft Fabric/Synapse/Databricks Permanent Must be based in the UK and SC Cleared/SC Clearable (no sponsorship offered) In this role, you’ll be leading enterprise-scale data projects with a preferred Microsoft Partner that specialises in modern data platforms. You’ll be working with … well-known customers, helping them transform the way they use and manage data to deliver real business impact. As a Senior Data Consultant, you will be designing and delivering cutting-edge solutions across Azure Data services, Microsoft Fabric, and Databricks. This is a hands-on role where you’ll lead from the front, working … on enterprise projects that shape the future of data platforms. What you’ll be doing: Leading the design and implementation of modern data platform solutions for enterprise customers. Building and optimising data pipelines using Azure Data Factory , Microsoft Fabric, Synapse and Databricks . Guiding best practices in data architecture, modelling More ❯

Senior Data Consultant Azure/Microsoft Fabric/Synapse/Databricks Permanent Must be based in the UK and SC Cleared/SC Clearable (no sponsorship offered) In this role, you’ll be leading enterprise-scale data projects with a preferred Microsoft Partner that specialises in modern data platforms. You’ll be working with … well-known customers, helping them transform the way they use and manage data to deliver real business impact. As a Senior Data Consultant, you will be designing and delivering cutting-edge solutions across Azure Data services, Microsoft Fabric, and Databricks. This is a hands-on role where you’ll lead from the front, working … on enterprise projects that shape the future of data platforms. What you’ll be doing: Leading the design and implementation of modern data platform solutions for enterprise customers. Building and optimising data pipelines using Azure Data Factory , Microsoft Fabric, Synapse and Databricks . Guiding best practices in data architecture, modelling More ❯

Senior Data Consultant Azure/Microsoft Fabric/Synapse/Databricks Permanent Must be based in the UK and SC Cleared/SC Clearable (no sponsorship offered) In this role, you’ll be leading enterprise-scale data projects with a preferred Microsoft Partner that specialises in modern data platforms. You’ll be working with … well-known customers, helping them transform the way they use and manage data to deliver real business impact. As a Senior Data Consultant, you will be designing and delivering cutting-edge solutions across Azure Data services, Microsoft Fabric, and Databricks. This is a hands-on role where you’ll lead from the front, working … on enterprise projects that shape the future of data platforms. What you’ll be doing: Leading the design and implementation of modern data platform solutions for enterprise customers. Building and optimising data pipelines using Azure Data Factory , Microsoft Fabric, Synapse and Databricks . Guiding best practices in data architecture, modelling More ❯

these values are upheld only because of our people. Your role As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming solutions. Required: • Hands-on experience … with Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) • Strong proficiency in Java, Python, or Scala • Solid understanding of event-driven architecture and data streaming patterns • Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure • Familiarity with Docker, Kubernetes, and CI/CD pipelines • Excellent problem-solving and communication abilities Preferred: Candidates … Kafka Connect, Kafka Streams, KSQL, Schema Registry, REST Proxy, Confluent Control Center • Hands-on with Confluent Cloud services, including ksqlDB Cloud and Apache Flink • Familiarity with Stream Governance, Data Lineage, Stream Catalog, Audit Logs, RBAC • Confluent certifications (Developer, Administrator, or Flink Developer) • Experience with Confluent Platform, Confluent Cloud managed services, multi-cloud deployments, and Confluent for Kubernetes • Knowledge More ❯

these values are upheld only because of our people. Your role As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming solutions. Required: • Hands-on experience … with Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) • Strong proficiency in Java, Python, or Scala • Solid understanding of event-driven architecture and data streaming patterns • Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure • Familiarity with Docker, Kubernetes, and CI/CD pipelines • Excellent problem-solving and communication abilities Preferred: Candidates … Kafka Connect, Kafka Streams, KSQL, Schema Registry, REST Proxy, Confluent Control Center • Hands-on with Confluent Cloud services, including ksqlDB Cloud and Apache Flink • Familiarity with Stream Governance, Data Lineage, Stream Catalog, Audit Logs, RBAC • Confluent certifications (Developer, Administrator, or Flink Developer) • Experience with Confluent Platform, Confluent Cloud managed services, multi-cloud deployments, and Confluent for Kubernetes • Knowledge More ❯

these values are upheld only because of our people. Your role As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming solutions. Required: • Hands-on experience … with Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) • Strong proficiency in Java, Python, or Scala • Solid understanding of event-driven architecture and data streaming patterns • Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure • Familiarity with Docker, Kubernetes, and CI/CD pipelines • Excellent problem-solving and communication abilities Preferred: Candidates … Kafka Connect, Kafka Streams, KSQL, Schema Registry, REST Proxy, Confluent Control Center • Hands-on with Confluent Cloud services, including ksqlDB Cloud and Apache Flink • Familiarity with Stream Governance, Data Lineage, Stream Catalog, Audit Logs, RBAC • Confluent certifications (Developer, Administrator, or Flink Developer) • Experience with Confluent Platform, Confluent Cloud managed services, multi-cloud deployments, and Confluent for Kubernetes • Knowledge More ❯

partnering with an award-winning AI & analytics consultancy working across finance, retail, SaaS, and government sectors. They’re expanding their team with an Analytics Engineer passionate about turning data into scalable, real-world solutions. The role: You’ll design and maintain robust data pipelines, optimize cloud data warehouses, and enable analytics and modelling teams … high-quality data. Expect to work across diverse client projects, collaborating with both internal engineers and client tech teams. Key responsibilities: Build and maintain ETL pipelines and cloud data warehouses (AWS, GCP, Snowflake) Develop custom data connectors (e.g. Salesforce, SAP) Automate data cleansing and transformation workflows Support analytics and AI teams with clean, production … ready data About you: 3+ years in Analytics/Data Engineering Strong SQL and database design skills Proficient in Python or R for automation Hands-on with cloud platforms (AWS/GCP/Azure/Snowflake) Passion for data quality, scalability, and collaboration Nice to have: Experience with SaaS products, analytics tooling, or modern More ❯

partnering with an award-winning AI & analytics consultancy working across finance, retail, SaaS, and government sectors. They’re expanding their team with an Analytics Engineer passionate about turning data into scalable, real-world solutions. The role: You’ll design and maintain robust data pipelines, optimize cloud data warehouses, and enable analytics and modelling teams … high-quality data. Expect to work across diverse client projects, collaborating with both internal engineers and client tech teams. Key responsibilities: Build and maintain ETL pipelines and cloud data warehouses (AWS, GCP, Snowflake) Develop custom data connectors (e.g. Salesforce, SAP) Automate data cleansing and transformation workflows Support analytics and AI teams with clean, production … ready data About you: 3+ years in Analytics/Data Engineering Strong SQL and database design skills Proficient in Python or R for automation Hands-on with cloud platforms (AWS/GCP/Azure/Snowflake) Passion for data quality, scalability, and collaboration Nice to have: Experience with SaaS products, analytics tooling, or modern More ❯

partnering with an award-winning AI & analytics consultancy working across finance, retail, SaaS, and government sectors. They’re expanding their team with an Analytics Engineer passionate about turning data into scalable, real-world solutions. The role: You’ll design and maintain robust data pipelines, optimize cloud data warehouses, and enable analytics and modelling teams … high-quality data. Expect to work across diverse client projects, collaborating with both internal engineers and client tech teams. Key responsibilities: Build and maintain ETL pipelines and cloud data warehouses (AWS, GCP, Snowflake) Develop custom data connectors (e.g. Salesforce, SAP) Automate data cleansing and transformation workflows Support analytics and AI teams with clean, production … ready data About you: 3+ years in Analytics/Data Engineering Strong SQL and database design skills Proficient in Python or R for automation Hands-on with cloud platforms (AWS/GCP/Azure/Snowflake) Passion for data quality, scalability, and collaboration Nice to have: Experience with SaaS products, analytics tooling, or modern More ❯

Job Summary: We are looking for a highly skilled Senior Data Engineering Developer with strong hands-on experience in Azure Data Factory , SQL development , and ETL tools . The ideal candidate will design and implement data pipelines, optimize performance, and collaborate with stakeholders in an Agile environment to deliver robust data solutions. … Key Responsibilities: Design and Develop Pipelines: Build and maintain Azure Data Factory pipelines and implement CI/CD processes for automated deployments. SQL Development: Write and optimize complex stored procedures , functions , and queries for high-performance data processing. Agile Delivery: Work in an Agile model , participate in sprint planning, and ensure timely delivery of data … . Familiarity with Agile methodologies . Understanding of cloud concepts and data warehouse design . Preferred Qualifications: Experience with SAP BODS . Knowledge of Azure DevOps for pipeline automation. Strong problem-solving and communication skills. More ❯

few. This role is based in Finland, and can be located at either our Helsinki or Tampere offices, or remotely from the UK. Key Responsibilities Designing and optimizing data solutions in a cloud environment Integrating data pipelines with external services through APIs Enforcing data security measures, including encryption and access controls Designing data solutions adhering to regulatory requirements (e.g., GDPR, HIPAA)Implementing metadata repositories for tracking data lineage and dependencies Building data solutions leveraging different data ingestion methods and technologies Skills, Knowledge And Expertise Must have: Experience with cloud-based technologies (such as Azure) Proficiency in designing and implementing complex system integrations Experience with Python … and .NET Experience in implementing data solutions adhering to regulatory requirements and security measures Experience with Python with libraries such as Pandas In-depth knowledge of various database system technologies (relational, document, columnar, etc.) Understanding and experience with relational databases and implementation of OLTP and OLAP systems Professional experience in data modeling and database optimisation Nice More ❯

Role: Data & ML Engineer Location: Newcastle Upon Tyne Levels: Senior Analyst, Specialist Please Note: Due to the nature of client work you will be undertaking, you will need to be willing to go through a Security Clearance (Including BPSS) process as part of this role, which requires 5+ years UK address history at the point of application. Hybrid … you'll be working with cutting-edge technologies and will have the opportunity to develop a wide range of new skills on the job. Role Overview: As a Data & ML Engineer, you will design, build, and optimize scalable data pipelines and machine learning solutions. You’ll work with client teams to deliver intelligent data products, leveraging modern cloud and AI technologies. Key Responsibilities Design and implement robust data pipelines and ML workflows using Python, SQL, Spark, and Databricks. Develop and deploy machine learning models (including NLP, deep learning, and agentic AI) in production environments. Integrate data from diverse sources, including streaming and batch ingestion, using Azure Data More ❯