1 to 25 of 1,571 Data Pipeline Jobs in England

Azure Data Platform Manager Putney, London | Hybrid £85,000+ Bonus + Excellent Benefits | Permanent Azure Data Platform | Azure Architecture | Data Platform Design | Databricks | Data Factory | Data Lake | Synapse Are you an experienced Azure Data Platform Manager, Azure Data Architect or Data Platform Lead with a strong background designing and delivering enterprise-scale Azure data platforms? We're looking for an experienced Azure Data Platform Manager to lead the design, development and optimisation of a modern Azure Data Platform ...

DescriptionWe’re passionate about using technology to drive sustainability. You too? Join us as a Data Architect for Technology Architecture at Ramboll Tech and help us become the leading Tech-Enabled Partner for Sustainable Change. We are seeking an experienced and results-driven Data Architect … integration with engineering systems (Great to have skill) Advanced knowledge of data modelling tools, data lakes, SQL, and pipeline design Excellent communication and interpersonal skills, with the ability to convey technical concepts to non-technical stakeholders Proficient in Microsoft Fabric platform (Great ...

well-prepared data to work with. This includes setting up stream processing for real-time data when required and automating pipeline orchestration for efficiency.Data Governance & Quality: Establish and enforce data governance policies and standards. This means defining practices for data quality … least one relational database is required, as well as deep knowledge of other data store types (especially graph databases) is highly needed.Data Pipeline Development: Hands-on experience developing data pipelines and integration workflows. This includes proficiency in ETL/ELT tools or frameworks (or custom ...

Remote/Hybrid: for London (4 days WFO, 1-day WFH mandatory) Experience 15+ years About the Role We are seeking a senior Data Architect to join the engineering organisation as part of Project Compass. This programme is delivering next-generation capabilities across Accounts (Real-Time Ledger), Payments … Engine, and Foreign Exchange – all of which generate, consume, and depend on high-quality, well-governed data at scale. The Data Architect will own the end-to-end data architecture across spanning Snowflake as the enterprise data warehouse and a landscape ...

engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation : Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources … effectively to both technical and non-technical audiences. Participate in code reviews and knowledge sharing sessions. Automation & DevOps: Implement automation for data pipeline deployments and other data engineering tasks. Work with DevOps teams to implement and Build CI/CD pipelines, for environmental deployments. Promote ...

Bristol, Cambridge, Cardiff, Edinburgh, Leeds, Manchester, Milton KeynesBusiness LineEnabling FunctionsJob TypePermanent/FTCDate published06-Aug-2026Req #24486Job descriptionConnect to your IndustryThe Deloitte UK Data Office is at the heart of our data strategy, driving the firm's ambition to harness the power of data for insightful decision-making and innovative solutions. We are responsible for establishing robust data governance frameworks, ensuring data integrity, and fostering a data-driven culture across the organisation. In an era where data fuels every algorithm and machine learning model ...

Bristol, Cambridge, Cardiff, Edinburgh, Leeds, Manchester, Milton KeynesBusiness LineEnabling FunctionsJob TypePermanent/FTCDate published06-Aug-2026Req #24486Job descriptionConnect to your IndustryThe Deloitte UK Data Office is at the heart of our data strategy, driving the firm's ambition to harness the power of data for insightful decision-making and innovative solutions. We are responsible for establishing robust data governance frameworks, ensuring data integrity, and fostering a data-driven culture across the organisation. In an era where data fuels every algorithm and machine learning model ...

Bristol, Cambridge, Cardiff, Edinburgh, Leeds, Manchester, Milton KeynesBusiness LineEnabling FunctionsJob TypePermanent/FTCDate published06-Aug-2026Req #24486Job descriptionConnect to your IndustryThe Deloitte UK Data Office is at the heart of our data strategy, driving the firm's ambition to harness the power of data for insightful decision-making and innovative solutions. We are responsible for establishing robust data governance frameworks, ensuring data integrity, and fostering a data-driven culture across the organisation. In an era where data fuels every algorithm and machine learning model ...

Bristol, Cambridge, Cardiff, Edinburgh, Leeds, Manchester, Milton KeynesBusiness LineEnabling FunctionsJob TypePermanent/FTCDate published06-Aug-2026Req #24486Job descriptionConnect to your IndustryThe Deloitte UK Data Office is at the heart of our data strategy, driving the firm's ambition to harness the power of data for insightful decision-making and innovative solutions. We are responsible for establishing robust data governance frameworks, ensuring data integrity, and fostering a data-driven culture across the organisation. In an era where data fuels every algorithm and machine learning model ...

Bristol, Cambridge, Cardiff, Edinburgh, Leeds, Manchester, Milton KeynesBusiness LineEnabling FunctionsJob TypePermanent/FTCDate published06-Aug-2026Req #24486Job descriptionConnect to your IndustryThe Deloitte UK Data Office is at the heart of our data strategy, driving the firm's ambition to harness the power of data for insightful decision-making and innovative solutions. We are responsible for establishing robust data governance frameworks, ensuring data integrity, and fostering a data-driven culture across the organisation. In an era where data fuels every algorithm and machine learning model ...

Bristol, Cambridge, Cardiff, Edinburgh, Leeds, Manchester, Milton KeynesBusiness LineEnabling FunctionsJob TypePermanent/FTCDate published06-Aug-2026Req #24486Job descriptionConnect to your IndustryThe Deloitte UK Data Office is at the heart of our data strategy, driving the firm's ambition to harness the power of data for insightful decision-making and innovative solutions. We are responsible for establishing robust data governance frameworks, ensuring data integrity, and fostering a data-driven culture across the organisation. In an era where data fuels every algorithm and machine learning model ...

Team Leader - Data Engineering & Integration - Commodities Data Location London Business Area Data Ref # 10052628 Description & Requirements Bloomberg runs on data. Our products are fueled by powerful information. We combine data and context to paint the whole picture for our clients, around … Finance, or related business/STEM fieldExperience leading or materially improving a data manufacturing, data operations, data pipeline, workflow engineering, or integration environment in a commodities, market data, financial data, or similarly complex domain.Solid understanding of commodities data ...

summaryThe BI & Data Engineer will work alongside the BI Lead to develop, maintain and support Greenwich Health's Business Intelligence, reporting and data infrastructure. The role is intended to provide significant overlap with the BI Lead's core technical and reporting responsibilities, improving resilience and reducing … dependency on a single individual, while bringing additional expertise in data engineering, automation and software development practices. The post holder will be expected to independently manage areas of the BI environment, troubleshoot data and reporting issues, develop new solutions and contribute to the ongoing improvement ...

About the role: The Data Quality Manager is responsible for ensuring that organisational data is accurate, complete, consistent, and fit for its intended use. The role provides leadership on data quality strategy, controls, and continuous improvement, enabling confident decision-making across reporting, analytics … operational processes.This role works closely with business, analytics, and technology teams to identify data quality risks, define controls, and drive sustainable improvements at source. It balances robust quality management with pragmatic delivery, ensuring data quality practices are embedded into everyday ways of working rather than treated ...

Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data … proficiency, including experience with AWS services such as AWS Glue, AWS Lambda, AWS S3, AWS Redshift, and Amazon EMR. Proven expertise in Python, SQL, Pipeline Orchestration and PySpark is also expected, as is experience with data lakehouse architectures and data warehousing solutions. Agile experience ...

relationships, and the variety of our skills and expertise that we bring to help them achieve their mission. We’re growing our Data & AI Architecture teams. If you are cleared to SC level and want to grow your career in this sector, we are very keen to hear … focus of the client engagement and your skillset, but could include and may require you to:Develop enterprise Conceptual, Logical, and Physical Data Models, conforming to national and international standards and conventions (e.g. ISO, UK Government Data Standards, NATO, etc).Provide leadership and guidance on enterprise ...

relationships, and the variety of our skills and expertise that we bring to help them achieve their mission. We’re growing our Data & AI Architecture teams. If you are cleared to SC level and want to grow your career in this sector, we are very keen to hear … focus of the client engagement and your skillset, but could include and may require you to:Develop enterprise Conceptual, Logical, and Physical Data Models, conforming to national and international standards and conventions (e.g. ISO, UK Government Data Standards, NATO, etc).Provide leadership and guidance on enterprise ...

relationships, and the variety of our skills and expertise that we bring to help them achieve their mission. We’re growing our Data & AI Architecture teams. If you are cleared to SC level and want to grow your career in this sector, we are very keen to hear … focus of the client engagement and your skillset, but could include and may require you to:Develop enterprise Conceptual, Logical, and Physical Data Models, conforming to national and international standards and conventions (e.g. ISO, UK Government Data Standards, NATO, etc).Provide leadership and guidance on enterprise ...

Data Engineer – Snowflake We are seeking an experienced Data Engineer with strong expertise in Snowflake, data analysis and data architecture to join our Data Services team and play a key role in delivering our Reporting & Analytics programme. This … exciting opportunity to help shape and develop an enterprise data platform, ensuring high-quality, reliable and accessible data supports business reporting and analytics across the organisation. The Role As a Data Engineer, you will be responsible for designing, developing and maintaining the enterprise data ...

Senior Analytics Engineer on the Cyber Analytics team, you will lead the design and implementation of trusted, well-documented and tested data products that transform raw security data into reliable, accessible and actionable insights. These foundations will enable reporting, advanced analytics, machine learning, GenAI … powered analytics experiences to help security teams investigate, understand and respond to threats more effectively. Working closely with cross-functional security and data teams, you will ensure data is accurate, governed and fit for purpose, while helping to design and enable analytics agents that allow users ...

Engineer to join our Data & AI practice. The successful candidate will bring solid experience in data migration, ETL/ELT pipeline development, and cloud-based data platforms, with a focus on AWS Data Lakehouse environments. This role is key to supporting … platformsDevelop ETL/ELT pipelines using: AWS GluePython/PySparkSQLYAML configurationsSupport execution of bulk data migrations and incremental/delta loadsAssist with pipeline repointing and migration to cloud environments Data Pipeline Testing & Validation (Core Focus) Test ETL/ELT data pipelines ...

evolving best practices. Key responsibilities and accountabilities Design and Maintain Data Pipelines: Develop and maintain robust, scalable, and efficient data pipeline architecture to support current and future business needs. Engineering and Integration: Assemble large, complex datasets from a variety of structured and unstructured sources, ensuring … Google Cloud Platform (GCP) big data technologies, such as BigQuery, Dataflow, Dataproc and Cloud Storage. Business Intelligence Enablement: Prepare and transform pipeline data to support downstream analytics and feed BI tools (DOMO), enabling data-driven decision-making across the organization. Cross-Functional Collaboration ...

install, configure and support Microsoft Fabric solutions for our clients across public and private sector environments.This role will support the delivery of modern data platforms, analytics services and integrated data solutions, helping customers make better use of their data through Microsoft Fabric, Power … Support governance and catalogue integration, including alignment with Microsoft Purview where required.· Establish monitoring, logging and operational support processes for Fabric workloads.· Troubleshoot platform, pipeline, data modelling, refresh, connectivity and performance issues.· Support testing, release management and transition into live service.· Contribute to technical assurance reviews, identifying ...

compliant, maintainable, and scalable solutions.Participate in code reviews, technical discussions, and platform improvement initiatives as an active contributor.Proactively identify data quality issues, pipeline risks, and improvement opportunities, and communicate them clearly in a fast‐paced environment.DutiesDevelop and maintain PySpark notebooks and jobs to ingest, transform, and curate … processing workflows, including use of PySpark.Proficiency in SQL for querying, transformation, and analytical data processing.Solid understanding of ETL/ELT pipelines, data transformation patterns, and data integration concepts.Experience analyzing enterprise data sources to identify data relationships, transformations, and business ...

Senior Data Management Professional - Data Engineer - Commodities Data Quality Location London Business Area Data Ref # 10051437 Description & Requirements Bloomberg runs on data. Our products are fueled by powerful information. We combine data and context to paint the whole picture … work together to improve reliability and delivery.Experience in a regulated or controlled data environment.Exposure to cloud-based data platforms and pipeline monitoring tools.Experience supporting implementation of automation, controls, or AI/ML-based data solutions within a defined validation framework.Does this sound like ...