51 to 75 of 987 Data Pipeline Jobs in England

Data Architect (Azure) 6 Month Contract UK Based Via Umbrella Our UK leading life and pensions client are looking for a Data Architect to joun their team on an initial 6 month contract. Key Responsibilities Data Architecture & Design Define and maintain enterprise data architecture standards, models, and frameworks. Design data solutions leveraging Azure services such as Azure Data Lake, Azure SQL Database, Azure Synapse Analytics, Azure Data Factory, and Azure Databricks. Data Integration & ETL Develop and optimize data pipelines for ingestion, transformation, and storage using Azure Data Factory and Databricks. Governance & Security Implement data governance, security … and compliance practices aligned with financial services regulations (e.g., GDPR, PCI DSS). Performance & Scalability Ensure data solutions are optimized for performance and scalability across large datasets. Collaboration Work closely with data engineers, analysts, and business stakeholders to deliver robust data platforms. Innovation Stay current with emerging Azure technologies and best practices in data More ❯

Lead Data Engineer Lead Data Engineer required to join my Clients Technology Team and contribute to their Group Architecture Board in building the next generation of their eCommerce data platform. You will play a pivotal role in designing and maintaining a modern, cloud-based data architecture. Working closely with product, technology, and … wider business stakeholders, you will be crucial in developing scalable data pipelines, improving reliability, and enabling smarter, data-driven insights and decisions. You will have a direct voice in how we design, build, and evolve our platform and the technologies we adopt! We are looking for a pragmatic, innovative, and self-motivated problem solver who delivers … Architecture Specialist: Design and develop robust data models, ETL/ELT processes, and data marts that support complex analytics and operational use cases. Pipeline Optimization: Maintain and optimize data pipelines and warehouse environments to ensure top-tier performance, reliability, and scalability. Cross-Functional Collaboration: Effectively collaborate with cross-functional teams to More ❯

Lead Data Engineer Lead Data Engineer required to join my Client’s Technology Team and contribute to their Group Architecture Board in building the next generation of their eCommerce data platform. You will play a pivotal role in designing and maintaining a modern, cloud-based data architecture. Working closely with product, technology … and wider business stakeholders, you will be crucial in developing scalable data pipelines, improving reliability, and enabling smarter, data-driven insights and decisions. You will have a direct voice in how we design, build, and evolve our platform and the technologies we adopt! We are looking for a pragmatic, innovative, and self-motivated problem solver who … Architecture Specialist: Design and develop robust data models, ETL/ELT processes, and data marts that support complex analytics and operational use cases. Pipeline Optimization: Maintain and optimize data pipelines and warehouse environments to ensure top-tier performance, reliability, and scalability. Cross-Functional Collaboration: Effectively collaborate with cross-functional teams to More ❯

Job Description: Data Engineer (with Tableau Specialism) Responsibilities: * Design, develop, and manage data models, schemas, and metadata to support advanced analytics and reporting requirements. * Work closely with Data Analysts, Data Scientists, and Business Analysts to ensure data availability, accessibility, and usability across the organisation. * Implement data quality checks … integrity and reliability. * Optimise data workflows for performance, cost-efficiency, and maintainability using tools such as Azure Data Factory, AWS Data Pipeline, Databricks, or Apache Spark . * Integrate and prepare data for Tableau dashboards and reports , ensuring optimal performance and alignment with business needs. * Collaborate with visualisation teams to … develop, maintain, and enhance Tableau data sources (including Extracts, Hyper files, and live connections) and to support self-service analytics. * Ensure compliance with data governance, security, and privacy policies , maintaining adherence to organisational standards. * Document data architecture, pipelines, and Tableau data models to promote transparency, maintainability, and knowledge sharing. * Contribute to the More ❯

Essential Skills & Experience:  10+ years of experience in data engineering, with at least 3+ years of hands-on experience with Azure Databricks.  Strong proficiency in Python and Spark (PySpark) or Scala.  Deep understanding of data warehousing principles, data modelling techniques, and data integration patterns.  Extensive experience with Azure data services … including Azure Data Factory … Azure Blob Storage, and Azure SQL Database.  Experience working with large datasets and complex data pipelines.  Experience with data architecture design and data pipeline optimization.  Proven expertise with Databricks, including hands-on implementation experience and certifications.  Experience with SQL and NoSQL databases.  Experience with data quality and data governance More ❯

Essential Skills & Experience:  10+ years of experience in data engineering, with at least 3+ years of hands-on experience with Azure Databricks.  Strong proficiency in Python and Spark (PySpark) or Scala.  Deep understanding of data warehousing principles, data modelling techniques, and data integration patterns.  Extensive experience with Azure data services … including Azure Data Factory … Azure Blob Storage, and Azure SQL Database.  Experience working with large datasets and complex data pipelines.  Experience with data architecture design and data pipeline optimization.  Proven expertise with Databricks, including hands-on implementation experience and certifications.  Experience with SQL and NoSQL databases.  Experience with data quality and data governance More ❯

Principal Data Engineer - Core Systems Team Hybrid in London/Remote within UK The company Imagine a world where every small business has the power to thrive. That's the world we're building at iwoca. Small businesses aren't just statistics - they're the heartbeat of our communities, the character of our high streets, and the engine … leading fintech innovators. But we're just getting started. Our mission? To empower one million businesses with the financial tools they deserve. We combine cutting-edge technology and data science with genuine human understanding to make finance feel less like a barrier and more like a superpower. Whether it's managing cash flow or seizing unexpected opportunities, we … funds they need - often within minutes. The team You'll join the Core Systems team, who are responsible for driving innovation across the business by optimising development, building data systems, and continuously improving iwoca products. We follow Agile-inspired processes, using continuous integration and delivery, so that features go live in days or weeks, not months or years. More ❯

of this document, please get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “Application Support Request”. Role: Principal Data Engineer Job Type: Permanent Location: Norwich/London (Hybrid) Number of hours: 40 hours per week – full time Are you passionate about Data and Analytics? We have … an exciting role for you – Principal Data Engineer. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in … Snowflake SQL, Snowpipe, Streams & Tasks, and performance optimization Integration with AWS services and orchestration tools Expertise in data integration patterns, ETL/ELT, and data pipeline orchestration Experience with data quality frameworks, metadata management, and data lineage Hands-on experience with machine learning pipelines and generative AI engineering Familiarity with DevOps More ❯

of this document, please get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “Application Support Request”. Role: Principal Data Engineer Job Type: Permanent Location: Norwich/London (Hybrid) Number of hours: 40 hours per week – full time Are you passionate about Data and Analytics? We have … an exciting role for you – Principal Data Engineer. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in … Snowflake SQL, Snowpipe, Streams & Tasks, and performance optimization Integration with AWS services and orchestration tools Expertise in data integration patterns, ETL/ELT, and data pipeline orchestration Experience with data quality frameworks, metadata management, and data lineage Hands-on experience with machine learning pipelines and generative AI engineering Familiarity with DevOps More ❯

Distributed Systems Engineer - Data Platform - Logs and Audit Logs Hybrid About Us At Cloudflare, we are on a mission to help build a better Internet. Today the company runs one of the world's largest networks that powers millions of websites and other Internet properties for customers ranging from individual bloggers to SMBs to Fortune 500 companies. Cloudflare … Organisation is strategically composed of several key teams, each focusing on a distinct aspect of our comprehensive data platform: Data Delivery/Data Pipeline: This team is responsible for the design, development, and operation of our distributed data delivery pipeline. This system is a high-throughput, low-latency powerhouse, primarily written … and manage systems for handling comprehensive audit logs , ensuring they are delivered securely and adhere to strict compliance and performance standards. Scale and optimise the data delivery pipeline to handle massive data volumes with low latency, identifying and removing bottlenecks in data processing and routing. Work closely with Product and other engineering teams More ❯

Data Engineer Join the Team Powering the Future of Data at Vivedia Location: Sheffield - Hybrid (3 days per week) Salary : £50,000 to £60,000 depending on experience Department: Data Team At Vivedia , data isn’t just numbers — it’s the engine driving every decision, every innovation, and every customer experience. We … re growing, and we’re looking for a Data Engineer who’s ready to build the foundations of a smarter, more connected future. Why You’ll Love This Role You’ll play a pivotal role in designing, building, and optimizing the data systems that power our business. From robust pipelines to scalable platforms, your work will … help every team at Vivedia unlock insights, drive performance, and make data-driven decisions that matter. This is your chance to shape the future of our data ecosystem — and see your impact ripple across an entire organisation. What You’ll Do Build the backbone of our data universe Design, develop, and deploy scalable, secure More ❯

the Role We're working with a market-leading organisation that's undergoing a major transformation, moving from manual, Excel-based reporting to a fully automated, intelligence-driven data ecosystem. As Data Architect, you'll be responsible for designing and implementing the Azure-based data platform that becomes the single source of truth across … the business. This is a hands-on, strategic role where you'll build scalable, governed data architecture and shape how data is used across Finance, Operations, and Commercial functions. What You'll Be Doing Data Architecture & Platform Design Design and implement an enterprise data lake on Azure Data Lake Gen2 … using Bronze/Silver/Gold architecture. Build and maintain scalable ETL/ELT pipelines in Azure Data Factory to integrate data from core systems (AS400, Tagetik, CRM, Esker, Slimstock). Develop the overall data model, data dictionaries, and lineage documentation. Deliver a stable “batch-first” integration strategy with AS400 during its More ❯

for data modeling, governance, and security across all platforms. Troubleshoot and enhance existing pipelines to improve scalability and resilience. Sample Projects You Work On Financial Asset Management Pipeline: Build and manage data ingestion from third-party APIs, model data using dbt, and support machine learning workflows for asset pricing and prediction using Azure … with hands-on experience in production environments, emphasizing performance optimization and code quality. Python expertise: Advanced proficiency in Python for data engineering, data wrangling and pipeline development. Cloud Platforms : Hands-on experience working with Azure. AWS experience is considered, however Azure exposure is essential. Data Warehousing: Proven expertise with Snowflake – schema design, performance … tuning, data ingestion, and security. Workflow Orchestration: Production experience with Apache Airflow (Prefect, Dagster or similar), including authoring DAGs, scheduling workloads and monitoring pipeline execution. Data Modeling: Strong skills in dbt, including writing modular SQL transformations, building data models, and maintaining dbt projects. SQL Databases: Extensive experience with PostgreSQL, MySQL (or similar), including More ❯

for data modeling, governance, and security across all platforms. Troubleshoot and enhance existing pipelines to improve scalability and resilience. Sample Projects You Work On Financial Asset Management Pipeline: Build and manage data ingestion from third-party APIs, model data using dbt, and support machine learning workflows for asset pricing and prediction using Azure … with hands-on experience in production environments, emphasizing performance optimization and code quality. Python expertise: Advanced proficiency in Python for data engineering, data wrangling and pipeline development. Cloud Platforms : Hands-on experience working with Azure. AWS experience is considered, however Azure exposure is essential. Data Warehousing: Proven expertise with Snowflake – schema design, performance … tuning, data ingestion, and security. Workflow Orchestration: Production experience with Apache Airflow (Prefect, Dagster or similar), including authoring DAGs, scheduling workloads and monitoring pipeline execution. Data Modeling: Strong skills in dbt, including writing modular SQL transformations, building data models, and maintaining dbt projects. SQL Databases: Extensive experience with PostgreSQL, MySQL (or similar), including More ❯

Job Profile Summary We are seeking an experienced AWS Platform Engineer to join our Data Platforms team , designing, building, and managing secure, automated deployment solutions and cloud-native data environments. The Platform Engineer will collaborate closely with Data Engineers, Data Scientists, Front-End Engineers, and Designers to deliver robust, scalable, and maintainable … automation and templating skills. Hands-on experience with CI/CD and GitOps tooling , including GitHub Actions , Jenkins , ArgoCD , or FluxCD . Experience designing and supporting data pipeline orchestration (e.g., Airflow, Astronomer ) within secure, multi-cloud environments. Experience with Backstage , developing scaffolder templates , managing catalog integrations , and improving developer self-service capabilities. Programming/scripting proficiency in … MCP Server integrations for data-driven automation. Understanding of Platform as a Product , Backstage developer portals , and the developer experience lifecycle . Experience with data pipeline orchestration using Apache Airflow or Prefect . A passion for continuous learning and staying ahead of modern DevOps, Platform Engineering, and GitOps practices. More ❯

Job Profile Summary We are seeking an experienced AWS Platform Engineer to join our Data Platforms team , designing, building, and managing secure, automated deployment solutions and cloud-native data environments. The Platform Engineer will collaborate closely with Data Engineers, Data Scientists, Front-End Engineers, and Designers to deliver robust, scalable, and maintainable … automation and templating skills. Hands-on experience with CI/CD and GitOps tooling , including GitHub Actions , Jenkins , ArgoCD , or FluxCD . Experience designing and supporting data pipeline orchestration (e.g., Airflow, Astronomer ) within secure, multi-cloud environments. Experience with Backstage , developing scaffolder templates , managing catalog integrations , and improving developer self-service capabilities. Programming/scripting proficiency in … MCP Server integrations for data-driven automation. Understanding of Platform as a Product , Backstage developer portals , and the developer experience lifecycle . Experience with data pipeline orchestration using Apache Airflow or Prefect . A passion for continuous learning and staying ahead of modern DevOps, Platform Engineering, and GitOps practices. More ❯

As a Technical Lead, you will play a key role in architecting and implementing robust data solutions within Google Cloud Platform (GCP). Full-time Closes 24/12/2025 Working within the Data Engineering department, you will help to shape the technical direction of cloud-based solutions. Your focus will be defining the overall … architecture for data ingestion from our Data Lake, including processing, storage, and analysis within GCP. By leveraging your expertise of Google BigQuery architecture and its features, you will design and implement data models optimised for performance, scalability and best practices. You will act as the subject matter expert for development and optimisation to maintain … of data modelling, data transformation, data governance, and proficient in SQL and other data processing languages. Experience with data pipeline orchestration tools, preferably Cloud Composer. Broad understanding of core GCP services such as BigQuery, Cloud Storage, Kubernetes, Cloud Functions, Pub/Sub, and IAM. Experience with IaC tools such More ❯

Senior Data Architect is required by this leading organisation in their field as they look to improve their enterprise and information architectures, ensuring they are robust, future-ready with a capability to support current and future business needs. The focus will be to empower data-led and AI-enhanced decision making across the organisation. You will … be required to deliver a clear, scalable data framework aligned with the overall enterprise data strategy, with an emphasis on data mesh, enabling the use of AI/GenAI within the business. Responsibilities include - Communicating the enterprise data strategy and operating model to various teams across the business Roadmap definition/strategic … GCP Data mesh Data Governance Data Lakehouse, warehouse and virtualisation concepts MDM/Metadata management ETL/ELT processes and data pipeline builds Data readiness for AI Strong understanding of business architecture Be part of a team shaping the future of data-driven technology within the organisation. More ❯

Pay: £450 - £550 per day Location - London (Hybrid) | Python | ETL | Impact-Driven Team We are partnering with a leading client seeking an Azure Data Engineer to join their team on an initial 6-month contract . This hybrid role requires 2 days per week onsite , offering the opportunity to design, build, and maintain cutting-edge data platforms. Data Engineering & Architecture: Design, build, and maintain scalable data pipelines and ETL/ELT processes using Azure services. Develop and optimize data lake and data warehouse solutions (eg, Azure Data Lake Storage, Azure Synapse Analytics). Implement best practices in data modelling, partitioning, and performance … optimization. Support Real Time and batch data processing workloads. Data Quality, Governance & Security Implement data validation, monitoring, and quality frameworks to ensure clean and trustworthy data. Work with the data governance team to ensure compliance with standards, policies, and privacy regulations. Maintain metadata, lineage, and documentation for all data solutions. More ❯

Job Title: Lead Data Engineer Location: York/Manchester/Leeds (3 times a week) Salary: up to £62,000 + Excellent Benefits Type: Full-Time, Permanent WRK Digital is proud to partner exclusively with a well-known, high-profile organisation on a transformative data journey. We are seeking a Lead Data Engineer to … join its dynamic Data & Business Intelligence function. This is a pivotal role in a data-driven organisation, where high-quality, well-governed, and accessible data is central to strategic and operational decision-making. As part of this first-class Data and Analytics team, you’ll play a key role in shaping how … data powers every decision being made. As the Lead Data Platform Engineer , you will lead the design, development, and optimisation of the organisation’s enterprise data platform and its pipelines, enabling data-driven decision-making and innovation. You will act as the technical lead for a team of skilled data More ❯

Data Architect - Fully Remote role Data Architect sought by a well-established Data & Analytics consultancy. Our client is seeking a cloud professional to spearhead strategic leadership and technical expertise within their data solutions landscape, focussed on cloud data platforms, but including IoT analytics, data integration, and migration projects. … This opportunity is offered on a remote-first basis, but with an open invitation to their headquarters any time. Role Responsibilities: The Data Architect will be pivotal in shaping the approach to designing and developing data solutions using cloud technologies such as AWS and Azure. This position involves: Leading the design and implementation of innovative cloud … using Azure, AWS, or exceptional on-premise design expertise. At least 5 years in data engineering or business intelligence roles. Proficiency in ETL and data pipeline design, with a technology-agnostic approach. A solid understanding of data warehouse and data lake principles. Expert SQL skills and demonstrable data modelling More ❯

Purpose of the Job Design, build, and maintain robust data systems and pipelines that support data storage, processing, and analysis on the Cloud. Work with large datasets, ensuring data quality, scalability, and performance, while collaborating. Key Accountabilities Design and implement scalable, efficient, and secure data architectures, ensuring optimal data flow … You will own development and change projects to ensure requirements are met in the most cost-effective manner while minimising associated risk to expected standards. Responsibly for cloud data platform development, data modelling, shaping and technical planning You will be a mentor among the owning decision making and evaluation of requirement suitability, facilitate reliable estimates, technical … demand, including identification of additional temporary resource capability within projects Maintain appropriate process procedures, compliance and service level monitoring, performance reporting and vendor management. Implementing best practices around data security, privacy, and compliance for the teams compliance with cyber security and data protection and supporting along with BI lead Strong stakeholder management will be required for More ❯

Job Title: Data Engineer Location: Hybrid Contract Type: Permanent/Full-Time About the Role Are you passionate about technology and eager to make a real impact? At Buzz Bingo, we’re looking for a Data Engineer who thrives on innovation and enjoys working across a diverse technology stack. The systems you’ll support underpin both … in-club and online customer experiences, giving you the opportunity to influence how thousands of people interact with Buzz Bingo every day. What You’ll Do Data Pipeline Development: Design, implement, and maintain robust ETL/ELT pipelines for ingesting and transforming data from multiple sources. Data Modelling: Create and maintain models that … data solutions. Data Quality Assurance: Implement checks and monitoring processes to ensure accuracy and reliability. Documentation: Maintain detailed technical documentation for data architectures, pipeline designs, and operational procedures. Performance Tuning: Analyse and optimize workflows for performance and cost efficiency. Innovation: Stay current with emerging technologies and best practices to continuously improve our data More ❯

Data Engineer (with Data Analytics Background) Location: City of London Employment Type: Full-time Salary: £90,000-£100,000 Sector: Fintech We're looking for a well-rounded, communicative Data Engineer with a strong background in data analytics and experience within the Fintech sector . This role is ideal for someone who … began their career as a Data Analyst and has since transitioned into a more engineering-focused position, someone who enjoys understanding the business context just as much as building the data solutions behind it. You'll work extensively with Python , Snowflake , SQL , and dbt to design, build, and maintain scalable, high-quality data pipelines … and models that support decision-making across the business. This is a hands-on, collaborative role, suited to someone who's confident communicating with data, product, and engineering teams, not a 'heads-down coder' type. Top 4 Core Skills Python - workflow automation, data processing, and ETL/ELT development. Snowflake - scalable data architecture, performance More ❯

DATA PRODUCT MANAGER UP TO £100,000 FULLY REMOTE Please note, this company is unable to sponsor, and you must be a UK resident to apply THE COMPANY Join a pioneering AI-driven technology business leading innovation in the search intelligence space. The organisation’s platform empowers enterprise brands and agencies to optimise performance, reduce costs, and gain … visibility into competitor movements across paid search. Built by data scientists for marketing specialists, the product leverages advanced machine learning to deliver actionable insights and transform how businesses operate in a data-rich, fast-moving digital environment. With more than a decade of success and hundreds of global customers, this is a business at the forefront … of AI-powered marketing intelligence, offering an opportunity to work at the intersection of data, machine learning, and product innovation. THE ROLE As a Data Product Manager, you’ll drive the strategy, evolution, and optimisation of the company’s data platform and machine learning ecosystem. This role sits at the core of the product More ❯