26 to 50 of 829 Data Pipeline Jobs in England

Engineer, you will operate within an Agile delivery environment, working closely with the Data Product Manager and Data Architect to ensure your team maintains a pipeline of delivery against the Backlog; providing vital insight from our wide-ranging dataset to support executive and operational decision making that will underpin sustained growth of BFS business units … solutions. You will also have management responsibilities for a small team of Data Engineers, who you will coach, support and organise to ensure we sustain a predictable pipeline of delivery, whilst ensuring all appropriate governance and best practice is adhered to. Your responsibilities as our Senior Databricks Data Engineer will include: Understand the business/… Azure DevOps, collaborating on Sprint cycles, code deployment, version control, and development practices Develop and maintain data models, schemas, and documentation Monitor and troubleshoot data pipeline issues, ensuring timely resolution Stay up-to-date with the latest industry trends and technologies in data engineering and recommend improvements to existing systems or processes as More ❯

Intelligence in making their decisions. This leads to better business decisions with improved accuracy, reduced errors, and better outcomes across various aspects of the business. Team Description: The Data Ingestion and Pipelines (DIP) team is responsible for designing, building, and optimizing scalable data systems that integrate and process data from a variety of sources. … We develop efficient data pipelines that ensure seamless data flow into our data lake and transform it to support business intelligence and machine learning applications. Our work spans the entire data lifecycle; from ingesting data from clients, to developing complex ETL processes, to building systems for scraping external datasets (e.g. … you will play a key role in designing, developing, and maintaining scalable data infrastructure that supports our business intelligence and analytics efforts. Key Responsibilities: Data Pipeline Development: Design, develop, and maintain robust data pipelines and ETL processes to ingest, transform, and load data from diverse sources into our data More ❯

Join our client in embarking on an ambitious data transformation journey using Databricks, guided by best practice data governance and architectural principles. To support this, we are recruiting for talented data engineers. As a major UK energy provider, our client is committed to 100% renewable energy and sustainability, focusing on delivering exceptional customer experiences. … day a week being based in their Nottingham office, this is negotiable. It is a full-time role, 37 hours per week. Accountabilities: * Develop and maintain scalable, efficient data pipelines within Databricks, continuously evolving them as requirements and technologies change. * Build and manage an enterprise data model within Databricks. * Integrate new data sources into … such as data warehousing. * Able to write repeatable, production-quality code for data pipelines, utilizing templating and parameterization where needed. * Can make data pipeline design recommendations based on business requirements. * Experience with data migration is a plus. * Open to new ways of working and new technologies. * Self-motivated with the ability More ❯

Senior Data and BI Solutions Analyst page is loaded Senior Data and BI Solutions Analyst Apply locations Farringdon, London, United Kingdom time type Full time posted on Posted Yesterday job requisition id JR-82411 Job Summary: Company: Live Nation Department: International Data Location: Farringdon, London Reports to: Vice President, Data and Media … International Working Hours: Full time Contract Type: Initially fixed term until the end of 2025. Role Description The Senior Data & BI Analyst will play a critical role in enabling data access, platform operations, and analytical data modeling across Live Nation's international data functions. You will manage data workflows, ensuring … seamless data access and usability in Databricks, BigQuery, Tableau, and Looker. You will lead the development of data models and analytical structures to support reporting teams and enable self-service analytics capabilities. The role requires strong collaboration with data engineering teams and business stakeholders to manage data migration, integration, and transformation efforts More ❯

DATA ARCHITECT DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ARCHITECT WITH ENHANCED DV CLEARANCE Permanent job opportunity for a Data Architect Leading National Security SME Salary up to 100,000 + Bonus London based organisation in an easily accessible location To apply please call … or email dominic.barbet@searchability.com WHO WE ARE? We are recruiting multiple a Data Architect to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold enhanced DV Security Clearance. WHAT WILL THE DATA ARCHITECT BE DOING? You will be joining a leading SME who is working hard to … support National Security projects within UK Govt. Departments in London. As part of a team, you will be responsible for designing and implementing Data Solutions in Mission-Critical areas. WE NEED THE DATA ARCHITECT TO HAVE. Current DV clearance Enhanced Good at understanding complexity and abstracting that into a form that is consumable for a non More ❯

Gett, Kaizen Gaming, and TransferGo. Our products are recognised by industry leaders like Gartner's Magic Quadrant, Forrester Wave and Frost Radar. Our tech stack: Superset and similar data visualisation tools. ETL tools: Airflow, DBT, Airbyte, Flink, etc. Data warehousing and storage solutions: ClickHouse, Trino, S3. AWS Cloud, Kubernetes, Helm. Relevant programming languages for data engineering tasks: SQL, Python, Java, etc. What you will be doing: Designing and developing scalable and efficient data pipelines, ETL processes, and data integration solutions to support data ingestion, processing, and storage needs. Ensuring data quality and reliability by implementing data validation, data cleansing, and data … quality monitoring processes. Optimising database performance by tuning queries, implementing indexing strategies, and monitoring and analysing system performance metrics. Collaborating with cross-functional teams to gather requirements, understand data needs, and develop data solutions that align with business objectives. Staying up-to-date with emerging technologies and industry trends in data engineering, and identifying More ❯

Purpose of the Job: Design, build, and maintain robust data systems and pipelines that support data storage, processing, and analysis on the Cloud. Work with large datasets, ensuring data quality, scalability, and performance, while collaborating. closely with data scientists, analysts, and other engineering teams to understand their data needs and … provide them with high-quality, accessible data. They are responsible for ensuring that the underlying data infrastructure supports the organizations broader data and business goals, enabling more effective data-driven decision-making. Key Accountabilities: • Design and implement scalable, efficient, and secure data architectures, ensuring optimal data flow across systems in … and process across the team along with BI lead. • Influence the evolution of business and system requirements and contribute to the design of technical solutions to feed a delivery pipeline that increasingly employs Agile methods such as SCRUM and Kanban • You will be required to develop unit tested code and then support test cycles including post implementation validation. You More ❯

other categories like cakes, candles and cocktails. This is all part of our ambition to build Europe's direct to consumer gifting destination. ️ The Business Intelligence & Analytics & Wild Data is at the heart of what we do at Bloom & Wild Group. Our BI & Analytics team empowers growth by transforming data into actionable insights and we're … passionate about understanding customer behavior and identifying opportunities to delight them even more. We leverage SQL, data visualisation, and rigorous experimentation and analysis to uncover trends, predict user needs, and test hypotheses. We believe data drives positive change and empowers informed decisions and we value collaboration, continuous learning, and a data-driven mindset. Please … making them more cost effective & run faster. Implement DBT best practices for modularity, reusability, and incremental builds to significantly reduce Snowflake compute and storage costs. Monitor data pipeline performance and identify areas for optimisation to ensure efficient data processing. Create New Scalable Data Models: Develop new, robust, and well-documented data More ❯

serve as a subject matter expert providing technical leadership guidance and best practices across the team. You will play a critical role in designing developing and implementing complex data solutions on cloud platforms (primarily AWS) ensuring they meet the highest standards of quality scalability and performance. Serve as a subject matter expert in cloud data engineering … providing technical guidance and mentorship to the team. Drive the design development and implementation of complex data pipelines and ETL/ELT processes using cloud-native technologies (e.g. AWS Glue AWS Lambda AWS S3 AWS Redshift AWS EMR). Develop and maintain data quality checks data validation rules and data lineage documentation. … Collaborate with data analysts data scientists business stakeholders and product owners to understand their data needs and translate them into innovative and effective technical solutions. Troubleshoot and resolve complex data quality issues performance bottlenecks and production incidents. Participate in the evaluation selection and implementation of new data technologies and tools. More ❯

with a flexible, student-powered workforce. The platform enables partnersfrom local pubs to multinational chainsto optimise staffing in real-time, enhancing efficiency and profitability. The Role As a Data Engineer, you'll play a pivotal role in shaping the data infrastructure. Your responsibilities will include: Building and Maintaining Data Pipelines: Design and implement scalable … data scientists, software engineers, and internal stakeholders to understand data needs and deliver solutions that drive data-driven decisions. Monitoring and Troubleshooting: Oversee pipeline performance, address issues promptly, and maintain comprehensive data documentation. What Youll Bring Technical Expertise: Proficiency in Python and SQL; experience with data processing frameworks such … architecture, data modelling, and scalable data solutions. Backend Development: Willingness to develop proficiency in backend technologies (e.g., Python with Django) to support data pipeline integrations. Cloud Platforms: Familiarity with AWS or Azure, including services like Apache Airflow, Terraform, or SageMaker. Data Quality Management: Experience with data versioning and quality More ❯

been turning down headhunters for years. Whatever your priorities work/life balance, career progression, sustainability, volunteering youll find like-minded people driving change at Howden. Job Title: Data Architect Location: London/Hybrid Job Type: Full-time Job Summary Are you passionate about designing scalable, high-performance data architectures on Azure and Databricks ? Do you … thrive on solving complex data challenges, integrating modern data platforms, and defining best practices for enterprise data management? We are looking for a Data Architect to lead the design and implementation of cutting-edge data solutions in a cloud-native environment. You will play a key role in shaping data strategy, designing high-level and low-level architectures , and ensuring the seamless integration of data management tools. If you enjoy working with big data technologies, governance frameworks, and modern analytics platforms , this role is for you! Key Responsibilities Design and architect scalable, secure, and cost-effective Azure Databricks solutions for business and analytical workloads. More ❯

Description Continuing Defleet's data led journey and recognising the importance the Data & Analytics team performs in this regard, we are looking for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes and technology; can work closely with business teams; drives solutions … a focused mentality on business value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science … projects to tight deadlines Ability to work unsupervised and to manage a varied workload efficiently Minimum criteria You'll need all of these. Solid understanding of data pipeline/ELT development, including performance tuning Very good SQL skills Past experience and solid understanding of end to end Data Warehouse, Data Lake and BI More ❯

Data Engineer Lead - NatGas and Power page is loaded Data Engineer Lead - NatGas and Power Apply locations London posted on Posted 12 Days Ago job requisition id JR102268 Job Title: Data Engineer Lead - NatGas and Power Contract Type: Time Type: Job Description: Reporting to the Head of Data, the Data Engineering Lead will oversee the design, development, and maintenance of high-performance data systems that support trading, risk, and analytics functions across the Natural Gas and Power business. This role bridges technical execution and business impact, ensuring that data pipelines, platforms, and products are robust, scalable, and aligned with enterprise data strategy. … The ideal candidate will lead a team of data engineers, collaborate with trading desks and analysts, and ensure that data infrastructure supports pre-trade modeling, live execution, and post-trade analytics with precision and reliability. Main Responsibilities 1. Data Platform Ownership Lead the development and maintenance of scalable data pipelines and databases More ❯

Social network you want to login/join with: We are looking for an experienced Data Governance Lead to drive enterprise-wide data governance initiatives with a focus on modern cloud data platforms, specifically Databricks and Microsoft Azure. This role will define and enforce data policies, standards, and best practices that ensure … high data quality, security, and regulatory compliance across our data ecosystem. You will collaborate with cross-functional teams to embed governance into our cloud-based data architecture and analytics processes. Key Responsibilities: Develop and implement enterprise-level data governance frameworks, standards, and operating models, aligned with business objectives and compliance requirements. Collaborate … with data engineering and platform teams to integrate data governance within Databricks and Azure environments, including Data Lake, Synapse, and Purview. Define and enforce data classification, access management, and lineage tracking using Azure-native and third-party tools. Lead the Data Governance Council, facilitate stakeholder engagement, and ensure alignment across More ❯

Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Essential Skills & Experience: 10+ years of experience in data engineering, with at least 3+ years of hands-on experience with Azure Databricks. Strong proficiency in Python and Spark (PySpark) or Scala. Deep understanding of data warehousing principles, data modelling techniques, and data integration patterns. Extensive experience with Azure data services, including Azure Data Factory … Azure Blob Storage, and Azure SQL Database. Experience working with large datasets and complex data pipelines. Experience with data architecture design and data pipeline optimization. Proven expertise with Databricks, including hands-on implementation experience and certifications. Experience with SQL and NoSQL databases. Experience with data quality and data governance More ❯

Overview We're seeking a Senior Data Scientist to lead the development of advanced analytics and AI/ML solutions that unlock real value across our business. This is a contract role for 6 months . In this contract role, you'll work with proprietary and B2B research datasets to design, deliver, and scale data-driven … Research, and Technology, you'll help turn strategic ideas into working MVPs-ensuring high standards of methodology, quality, and business relevance throughout. You'll also help shape the data science environment by working alongside our tech teams to support a robust and flexible infrastructure, including sandbox environments for onboarding and evaluating new data sources. This is … refined and productionized in the future. Work with Tech colleagues to improve the Data Science workspace, including providing requirements for Data Lake, Data Pipeline, and Data Engineering teams. Expand on the tools and techniques already developed. Help us understand our customers (both internal and external) better so we can provide the More ❯

outlook are not only respected but expected. We want all our employees to feel that they can be themselves at work and that they are valued. Digital and Data The UKHSA Digital and Data Directorate provides strategic leadership and oversight for developing and managing a common and bespoke suite of performant, modern, secure, data and analytical tools, services, platforms and applications, ensuring access to high quality data and analytics services, internally and externally. There is a Market pay supplement available for this position of £10,000 up until the end of June 2026. Main duties of the job You will work in the Data Engineering and Enablement Division … that reports into the Digital and Data Directorate. Its an exciting time to join as we seek to create leading Health Protection data capabilities that enable data scientists and data analysts to develop insights that inform public health decisions with resilience platforms and curated data assets. The core activities of More ❯

outlook are not only respected but expected. We want all our employees to feel that they can be themselves at work and that they are valued. Digital and Data The UKHSA Digital and Data Directorate provides strategic leadership and oversight for developing and managing a common and bespoke suite of performant, modern, secure, data and analytical tools, services, platforms and applications, ensuring access to high quality data and analytics services, internally and externally. There is a Market pay supplement available for this position of £10,000 up until the end of June 2026. Main duties of the job You will work in the Data Engineering and Enablement Division … that reports into the Digital and Data Directorate. It's an exciting time to join as we seek to create leading Health Protection data capabilities that enable data scientists and data analysts to develop insights that inform public health decisions with resilience platforms and curated data assets. The core activities More ❯

Who We Are Graphite is a specialist team within Singulier focused exclusively on data transformation for PE-backed companies . We believe mid-sized and large companies are still underserved when it comes to data . For years, only big corporates could afford the platforms and teams needed to truly leverage their data. But over the … are short-cycle, high-impact, and always business-driven . We don't do "data for data's sake", every data product or pipeline we build has a direct line to a business decision. That's what makes us trusted by some of the best private equity funds in Europe. What You'll … work with you to remove blockers and deliver impact. Drive adoption : make sure the products you build are actually used, whether it's a dashboard, a data pipeline, or a reporting layer, by training and supporting business teams. Test and iterate : work with a hypothesis-driven approach, refining both the business framing and the data More ❯

with successful projects in key government departments like the Department for Work and Pensions, Ministry of Justice, HM Passport Office, and more. Overview We're seeking a seasoned Data Lead to own and deliver the data strategy for Govt client that uses services used by over 18m citizens encompassing three newly rebuilt benefits systems. You will … define where our data capabilities are today, set the future vision, and architect the roadmap to get us there-then design the data team to execute it. Key Responsibilities Lead the end-to-end Data Strategy for Bereavement & Care services. Map the "as-is" and "to-be" state of our data platforms … strategies in complex organisations. Technical Breadth : Cloud-based data platforms AWS must (Azure, AWS or equivalent) Modern ETL/ELT tools and data pipeline frameworks Data modelling, warehousing and transformation best practices Data science/ML lifecycle from prototype to production Government/Public Sector : Experience to GDS-equivalent More ❯

thefoundation for delivering our full suite of capabilities. Job Description Employment Type: Full-Time Location: UK Job Overview We are looking for a skilled Database Designer/Senior Data Engineer to join our data engineering team. This role involves the development and maintenance of data solutions in the cloud environment. The ideal candidate will … have a strong background in data processing and a solid understanding of cloud data services. Requirements Key Responsibilities Design and implement modern data platforms in cloud such as AWS or Azure. Develop data pipelines and data streaming processes. Ensure data solutions are scalable, reliable, and efficient. Collaborate with … data analysts and other stakeholders to meet data requirements. Optimize data storage and processing for performance and cost. Maintain data security and compliance standards. Minimum Qualifications Bachelor's degree in Computer Science , Information Technology, Engineering, or a related field. Minimum 3 years of experience as a Database Designer & Senior Data More ❯

progression, sustainability, or volunteering, you'll find like-minded people driving change at Howden. Role: Quality Assurance Engineer Objective: Ensure the quality, reliability, and governance of the Group Data Platform , covering data engineering, platform engineering, and data governance processes . Summary of the Role Howden Group Services is expanding its Group Data Platform and seeks a Quality Assurance Engineer to test, validate, and improve data pipelines, infrastructure, and governance processes. The ideal candidate will have experience in data testing, automation frameworks, and cloud-based data platforms , ensuring high-quality standards for data pipelines, storage, and platform components . This role requires a … processes . Develop and execute test cases for data ingestion, transformation, and storage . Implement automated testing frameworks to validate data integrity, schema consistency, and pipeline performance . Assist in testing platform engineering components , including CI/CD pipelines, infrastructure automation, and cloud-based services . Validate data governance policies , ensuring adherence to More ❯

health. EIT fosters a culture of collaboration, innovation, and resilience, valuing diverse expertise to drive sustainable solutions to humanity's enduring challenges. We are looking for a Senior Data Engineer to join the EIT Pathogen Program and play a key role in designing, implementing, and supporting the cloud-based data platform that underpins our mission. This … role offers the opportunity to shape the future of pathogen monitoring and diagnostics by building scalable, secure, and high-performance data pipelines. You'll work closely with cross-functional teams, including data architects, platform engineers, and product teams, to deliver the data infrastructure that powers advanced analytics and AI-driven solutions for global health … impact. Key Responsibilities: Ensure data in the platform is acquired, processed, curated, and made accessible to scientists, digital analytics products, bioinformatics, and AI at a high standard of quality and availability Ensure data access adheres to FAIR principles (Findable, Accessible, Interoperable, and Re-usable) Ensure data is secured and compliant with regulatory, legal, and More ❯

About the Role We are looking for a highly skilled Data Engineer … to support data integration, transformation, and orchestration initiatives for one of our leading telecom clients based in London. This role requires deep expertise in data pipeline development and data modeling, using tools such as DBT, Airflow, Fivetran, and Erwin. We need with minimum 8+ years of experience Key Responsibilities: Design, build, and maintain … scalable and robust data pipelines using Airflow, Fivetran, and DBT. Develop data models and document metadata using Erwin Data Modeler. Collaborate with business stakeholders and data analysts to understand data requirements and translate them into efficient engineering solutions. Optimize data flows and manage orchestration and scheduling using Apache More ❯

Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Data Engineering Principal Posting Date: 11 Aug 2025 Function: Data & AI Unit: Networks Location: 1 Braham Street, London, United Kingdom Internal Closing Date: 20/8/25 DevOps Data Storage Data Integration Programming …/Scripting Data Quality Cloud Computing Performance Monitoring Agile Methodologies Data Management Data Acquisition Data Risk Talent Management Decision Making Growth Mindset Performance Management Looking in: Leading inclusively and Safely I inspire and build trust through self-awareness, honesty and integrity. Owning outcomes I take the right decisions that benefit the broader … and loading from diverse sources, ensuring high standards of data quality, reliability, and performance. Own the development of automation and monitoring frameworks that capture operational KPIs and pipeline health metrics, enabling proactive performance management. Identify and resolve performance bottlenecks in data workflows, ensuring optimal resource utilisation and cost-efficiency. Collaborate closely with architects, Product Owners More ❯