26 to 50 of 854 Data Pipeline Jobs in England

Join our client in embarking on an ambitious data transformation journey using Databricks, guided by best practice data governance and architectural principles. To support this, we are recruiting for talented data engineers. As a major UK energy provider, our client is committed … warehousing. Able to write repeatable, production-quality code for data pipelines, utilizing templating and parameterization where needed. Can make data pipeline design recommendations based on business requirements. Experience with data migration is a plus. Open to new ways of working and new technologies. ...

undertaking one of the largest transformation programmes in government, modernising the digital systems that support over £7 trillion of property ownership. As a Data Engineer, you will support the development of HMLR's data engineering capability by helping to build and maintain reliable data … and analysing source systems to produce clear, actionable insights. Desirable Skills Knowledge of DevOps processes: (e.g. Terraform) Knowledge of data pipeline testing (e.g. end-to-end testing, data quality testing, monitoring & alerting, unit & contract testing) Knowledge of the data lifecycle (e.g. ...

undertaking one of the largest transformation programmes in government, modernising the digital systems that support over £7 trillion of property ownership. As a Data Engineer, you will support the development of HMLR's data engineering capability by helping to build and maintain reliable data … and analysing source systems to produce clear, actionable insights. Desirable Skills Knowledge of DevOps processes: (e.g. Terraform) Knowledge of data pipeline testing (e.g. end-to-end testing, data quality testing, monitoring & alerting, unit & contract testing) Knowledge of the data lifecycle (e.g. ...

undertaking one of the largest transformation programmes in government, modernising the digital systems that support over £7 trillion of property ownership. As a Data Engineer, you will support the development of HMLR's data engineering capability by helping to build and maintain reliable data … and analysing source systems to produce clear, actionable insights. Desirable Skills Knowledge of DevOps processes: (e.g. Terraform) Knowledge of data pipeline testing (e.g. end-to-end testing, data quality testing, monitoring & alerting, unit & contract testing) Knowledge of the data lifecycle (e.g. ...

ABOUT DIGIMASTERS Digimasters Ltd was founded in 2017 as a digital transformation consultancy focused on technology, business process optimisation and data analytics. Digimasters works across all industries and provides experience in organisations of all sizes. Primarily based in London, UK, we work in many regions including … Architecture, Engineering, and Construction (AEC), as well as other sectors, we have several roles supporting the delivery of technology, business change, and data programmes. THE ROLE We are looking for an experienced Data Engineer to join our delivery team on a contract basis, with a specific ...

. This platform underpins critical Monetary Analysis, Forecasting, and Modelling activities, making this position essential to their mission. Key Responsibilities Data Pipeline Development & Optimisation Design, develop, and maintain robust, scalable data pipelines for ingesting, transforming, and loading data from diverse sources (APIs … into solutions. Communicate technical concepts to technical and non-technical audiences . Participate in code reviews and knowledge-sharing sessions . Automation & DevOps Automate pipeline deployments and data engineering tasks . Build CI/CD pipelines with DevOps teams. Promote and implement DevOps best practices . Essential ...

Data Engineer - £350PD - Remote Required Technical Skills Data Pipeline & ETL Design, build, and maintain robust ETL/ELT pipelines for structured and unstructured data Hands-on experience with AWS Glue and AWS Step Functions Implementation of data validation, data quality frameworks, and reconciliation checks Strong error handling, monitoring, and retry strategies in production pipelines Experience with incremental data processing patterns (CDC, watermarking, upserts) AWS Data Services Amazon S3: data lake architectures, partitioning strategies, lifecycle policies DynamoDB: data modeling, secondary ...

Data Engineer - £350PD - Remote Required Technical Skills Data Pipeline & ETL Design, build, and maintain robust ETL/ELT pipelines for structured and unstructured data Hands-on experience with AWS Glue and AWS Step Functions Implementation of data validation, data quality frameworks, and reconciliation checks Strong error handling, monitoring, and retry strategies in production pipelines Experience with incremental data processing patterns (CDC, watermarking, upserts) AWS Data Services Amazon S3: data lake architectures, partitioning strategies, lifecycle policies DynamoDB: data modeling, secondary ...

Title: Data Engineer Location: York, 4x per week Salary: Up to £65,000 Why Apply? This is an opportunity to step into a high-impact Data Engineer role within a growing organisation that is investing heavily in its data capabilities. You'll play … central role in shaping a modern, cloud-based data platform that underpins analytics, reporting, and data products across the business. You will drive business value by designing, building, and maintaining a scalable, secure data platform. Delivering robust data pipelines and trusted datasets ...

recruiting a D2C Data & Business Intelligence Manager to join our D2C Insights team; the team that drives customer-focused, data-led decision making across our direct-to-consumer strategy, product, PR & content, and business development teams. The team are responsible for insights across customer research, customer … write complex queries and repeatable stored procedures. Experience in low-code solutions like DBT is highly desirable Experience of developing data pipeline and automations, for example via Python Data integration using APIs Ownership of systems critical data and string experience of maintenance, development ...

Azure Data Engineer - £500PD - Hybrid We are seeking an Azure Data Engineer with strong experience in Databricks to design, build, and optimize scalable data pipelines and analytics solutions on the Azure cloud platform. The ideal candidate will have hands-on expertise across Azure data services, data modeling, ETL/ELT development, and collaborative engineering practices. Key Responsibilities * Design, develop, and maintain scalable data pipelines using Azure Databricks (Python, PySpark, SQL). * Build and optimize ETL/ELT workflows that ingest data from various on-prem ...

seeking an experienced Data Architect to join our Group Technology team in Milton Keynes. You will help realise the value of the immense Connells Group dataset for the benefit of customers, colleagues and the overall business. You will use your expertise to define, evolve and communicate the existing … enterprise data architecture, to democratise safe access to data to help engineering teams create personal, relevant and timely customer experiences. The data architecture will also support colleagues in accessing data, getting insights and providing next best actions for faster and aligned decision ...

engineering mindset who enjoys improving data reliability, performance, and usability in a fast-moving fintech environment. Key Responsibilities Data Platform & Pipeline Engineering Design, build, and maintain scalable data pipelines to ingest, transform, and serve data from multiple internal and external sources. … cases. Orchestration & Workflow Management Develop and maintain data orchestration workflows to manage scheduled and event-driven pipelines. Improve monitoring and alerting around pipeline failures and data quality issues. Support deployment and operational best practices across the data platform. Collaboration & Delivery Work closely with ...

Company Nigel Wright are delighted to be partnering with the Institute of Directors in their search for a Senior Data Engineer.The Institute of Directors (IoD) is a thriving membership community for Directors in the UK and beyond, where you can connect with other leaders, develop your skills … multiple sources (internal systems, external datasets) Ensure data quality, cleansing and governance processes are implemented Monitor, troubleshoot and optimise data pipeline and data warehouse performance to ensure high availability and efficiency Liaise closely with business and IT stakeholders, including directors and senior leadership ...

LatentView Analytics is a leading global analytics and decision sciences provider, delivering solutions that help companies drive digital transformation and use data to gain a competitive advantage. With analytics solutions that provide a 360-degree view of the digital consumer, fuel machine learning capabilities and support artificial intelligence … technical and non-technical audiences A proactive, growth-oriented mindset, passionate about improving data accessibility and scalability Responsibility: Data Engineering & Pipeline Development: Design, build, and maintain ETL/ELT data pipelines to consolidate and transform customer success data from multiple international ...

LatentView Analytics is a leading global analytics and decision sciences provider, delivering solutions that help companies drive digital transformation and use data to gain a competitive advantage. With analytics solutions that provide a 360-degree view of the digital consumer, fuel machine learning capabilities and support artificial intelligence … technical and non-technical audiences A proactive, growth-oriented mindset, passionate about improving data accessibility and scalability Responsibility: Data Engineering & Pipeline Development: Design, build, and maintain ETL/ELT data pipelines to consolidate and transform customer success data from multiple international ...

Lead Data Engineer Lead Data Engineer required to join my Client’s Technology Team and contribute to their Group Architecture Board in building the next generation of their eCommerce data platform. You will play a pivotal role in designing and maintaining a modern, cloud … develop robust data models, ETL/ELT processes, and data marts that support complex analytics and operational use cases. Pipeline Optimization: Maintain and optimize data pipelines and warehouse environments to ensure top-tier performance, reliability, and scalability. Cross-Functional Collaboration: Effectively collaborate with ...

Data Engineer/London OR Newcastle/Hybrid/Contract We're recruiting a Data Engineer to join a growing data function, playing a key role in designing, building, and maintaining scalable data infrastructure that supports analytics, insight, and automation across … access controls, and security standards Support self-service analytics by enabling clean, well-structured datasets Proactively identify and resolve data issues and pipeline failures Skills & Experience Strong experience designing and building ETL workflows and data pipelines Experience integrating data from APIs, databases ...

Senior Data Engineer Location : Bristol, Swansea, Leeds, Nottingham, Newcastle, Oldham, Birmingham and Yeading. Salary : Up to £58,997 Job summary A DVSA Senior Data engineer is responsible for the design and implementation of numerous complex data flows to connect operational systems, data for analytics and BI systems. DVSA Senior Data Engineers: lead the build of data streaming systems optimize the code to ensure processes perform optimally lead work on database management recognize and share opportunities to re-use existing data flows coordinate project teams ...

Senior Data Engineer Location : Bristol, Swansea, Leeds, Nottingham, Newcastle, Oldham, Birmingham and Yeading. Salary : Up to £58,997 Job summary A DVSA Senior Data engineer is responsible for the design and implementation of numerous complex data flows to connect operational systems, data for analytics and BI systems. DVSA Senior Data Engineers: lead the build of data streaming systems optimize the code to ensure processes perform optimally lead work on database management recognize and share opportunities to re-use existing data flows coordinate project teams ...

Role: Consulting Data Engineer Location: Bristol , UK Hybrid 2 Day in a week at Onsite RoleType: Permanent/Full time Job Salary: Depends on experience Role Summary: As a Consulting Data Engineer, youll help design, build and maintain data pipelines and platforms that enable … unlock the value in their data. Are you comfortable working in an ambiguous environment, where you build strong working relationships, and use data to understand client problems? Are you inquisitive and comfortable with questioning and challenge constructively? Sometimes youll work with experienced engineers and data scientists ...

governance, and security across all platforms. Troubleshoot and enhance existing pipelines to improve scalability and resilience. Sample Projects You Work On Financial Asset Management Pipeline: Build and manage data ingestion from third-party APIs, model data using dbt, and support machine learning workflows for asset … production environments, emphasizing performance optimization and code quality. Python expertise: Advanced proficiency in Python for data engineering, data wrangling and pipeline development. Cloud Platforms: Hands-on experience working with Azure. AWS experience is considered, however Azure exposure is essential. Data Warehousing: Proven expertise ...

governance, and security across all platforms. Troubleshoot and enhance existing pipelines to improve scalability and resilience. Sample Projects You Work On Financial Asset Management Pipeline: Build and manage data ingestion from third-party APIs, model data using dbt, and support machine learning workflows for asset … production environments, emphasizing performance optimization and code quality. Python expertise: Advanced proficiency in Python for data engineering, data wrangling and pipeline development. Cloud Platforms : Hands-on experience working with Azure. AWS experience is considered, however Azure exposure is essential. Data Warehousing: Proven expertise ...

Data Engineer – Modern Data & AI Platforms London (Hybrid 2 days) | Contract/Permanent | 🌍 Global Consulting Environment Build the data foundations behind AI, automation, and real-world impact. We’re hiring a Data Engineer to join a fast-growing digital and data … operating across energy, manufacturing, chemicals, infrastructure, automotive, and commodities. This is a hands-on engineering role where you’ll design and run the data systems that power analytics, automation, and AI-driven solutions — working alongside consultants, analysts, and data scientists in a true delivery-focused environment. ...

Data Engineer – Modern Data & AI Platforms London (Hybrid 2 days) | Contract/Permanent | Global Consulting Environment Build the data foundations behind AI, automation, and real-world impact. We're hiring a Data Engineer to join a fast-growing digital and data … operating across energy, manufacturing, chemicals, infrastructure, automotive, and commodities. This is a hands-on engineering role where you'll design and run the data systems that power analytics, automation, and AI-driven solutions — working alongside consultants, analysts, and data scientists in a true delivery-focused environment. ...