1 to 25 of 1,799 Data Pipeline Jobs in England

Remote/Hybrid: for London (4 days WFO, 1-day WFH mandatory) Experience 15+ years About the Role We are seeking a senior Data Architect to join the engineering organisation as part of Project Compass. This programme is delivering next-generation capabilities across Accounts (Real-Time Ledger), Payments … Engine, and Foreign Exchange – all of which generate, consume, and depend on high-quality, well-governed data at scale. The Data Architect will own the end-to-end data architecture across spanning Snowflake as the enterprise data warehouse and a landscape ...

Title Data Solution Architect Reporting To Senior Director, IT Department IT Hours Core office hours Location White City, London (hybrid) About Autolus Autolus is a biopharmaceutical company, advancing innovative therapies at both clinical and commercial stages of development, focused on next-generation, programmed T cell therapies … highly active T cell therapies designed to better recognize cancer cells, break down their defence mechanisms, and eliminate these cells. Autolus has a pipeline of product candidates in development for the treatment of haematological malignancies, solid tumours, and autoimmune diseases. Why Autolus Our team is passionate in the pursuit ...

digital transformation consultancy working exclusively with higher education institutions across the UK. We help universities solve complex challenges across strategy, student records, data,changeand delivery. Our work often sits at the heart of major institutional transformation, helping partners improve the student journey, modernise operations and deliver change more … information, finance, HR, CRM, learning or other enterprise platforms. Experience with Azure DevOps, CI/CD, infrastructure as code and automated data pipeline deployment. Experience of data mesh, data products, advanced analytics or AI enablement. Experience in consultancy or transformation environments. #J ...

digital transformation consultancy working exclusively with higher education institutions across the UK. We help universities solve complex challenges across strategy, student records, data,changeand delivery. Our work often sits at the heart of major institutional transformation, helping partners improve the student journey, modernise operations and deliver change more … information, finance, HR, CRM, learning or other enterprise platforms. Experience with Azure DevOps, CI/CD, infrastructure as code and automated data pipeline deployment. Experience of data mesh, data products, advanced analytics or AI enablement. Experience in consultancy or transformation environments. #J ...

Data & AI Consulting – Public Sector Cognizant’s Data & AI Consulting practice partners with government agencies and public sector organizations to modernize data ecosystems, establish trusted data foundations, and accelerate digital transformation through cloud-based data platforms, analytics, and AI solutions. … teams help clients move beyond fragmented data landscapes by creating scalable, governed, and reusable data capabilities that enable enterprise-wide decision-making. This role offers an opportunity to shape one of the most significant public sector data modernization programs in the UK, establishing ...

Databricks ML and Azure ML to develop predictive models and drive business insights.* Proven expertise in Databricks, Apache Spark, and data pipeline development and strong understanding of data warehousing concepts and practices.* Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage … Minimum 10+ years of experience as a Data Engineer or similar role.* Proven expertise in the technologies below, and data pipeline development and strong understanding of data warehousing concepts and practices.* Excellent problem-solving and analytical skills and strong communication and teamwork skills.Security ...

summary We are seeking an experienced Senior Data Engineer to provide technical leadership and hands‐on expertise within the Southwest Secure Data Environment (SWSDE). SWSDE enables secure use of health and care data for research, innovation, service improvement and transformation. Working with … processing activities. Strong problem‐solving skills and ability to work effectively in complex, ambiguous and rapidly changing environments. Desirable Experience analysing platform performance, pipeline performance, data quality metrics or cloud based engineering workloads. Experience applying analytical techniques to support data validation, optimisation and continuous ...

summary We are seeking an experienced Senior Data Engineer to provide technical leadership and hands-on expertise within the Southwest Secure Data Environment (SWSDE). SWSDE enables secure use of health and care data for research, innovation, service improvement and transformation. Working with … processing activities. Strong problem-solving skills and ability to work effectively in complex, ambiguous and rapidly changing environments. Desirable Experience analysing platform performance, pipeline performance, data quality metrics or cloud based engineering workloads. Experience applying analytical techniques to support data validation, optimisation and continuous ...

configure and support Microsoft Fabric solutions for our clients across public and private sector environments. This role will support the delivery of modern data platforms, analytics services and integrated data solutions, helping customers make better use of their data through Microsoft Fabric, Power … Support governance and catalogue integration, including alignment with Microsoft Purview where required. Establish monitoring, logging and operational support processes for Fabric workloads. Troubleshoot platform, pipeline, data modelling, refresh, connectivity and performance issues. Support testing, release management and transition into live service. Contribute to technical assurance reviews, identifying ...

data‐enabled products. Establish and champion engineering best practices, including CI/CD, automated testing, version control, monitoring and alerting on pipeline failures. Work closely with Data Architects to implement target‐state data models and modern data engineering principles. Partner with … Factory Azure Synapse Analytics Microsoft Fabric Azure Data Lake Advanced SQL development skills. Proficiency in Python and modern data pipeline orchestration tools, including their monitoring and automation. Track record of building reliable, monitored production‐grade data pipelines. Experience integrating data ...

Role AI Engineer-AI Solutions Architect Experience (In Years) 9-12 Job Description EXL (NASDAQ: EXLS) is a global data and artificial intelligence ("AI") company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. EXL harnesses the power … experience architecting solutions on at least one major cloud data platform (e.g., AWS, Azure, GCP, Databricks, Snowflake), including data pipeline and integration design. Strong data modelling capability across conceptual, logical and physical models, with practical experience of data quality, metadata ...

Entity: Technology Job Family Group: IT&S Group Job Description: Role Summary We are seeking an experienced Senior Data Engineer to design, build and operate scalable data platforms, pipelines and products that enable data-driven decision making across Finance. This role combines strong software … engineering practices with modern cloud data technologies to deliver trusted, secure and high-quality data products. The successful candidate will work closely with business partners, product teams, architects, data managers and analytics specialists to transform complex business requirements into robust data solutions. ...

data-enabled products. Establish and champion engineering best practices, including CI/CD, automated testing, version control, monitoring and alerting on pipeline failures. Work closely with Data Architects to implement target-state data models and modern data engineering principles. Partner with … Factory Azure Synapse Analytics Microsoft Fabric Azure Data Lake Advanced SQL development skills. Proficiency in Python and modern data pipeline orchestration tools, including their monitoring and automation. Track record of building reliable, monitored production-grade data pipelines. Experience integrating data ...

Entity:TechnologyJob Family Group:IT&S GroupJob Description:Role SummaryWe are seeking an experienced Senior Data Engineer to design, build and operate scalable data platforms, pipelines and products that enable data-driven decision making across Finance. This role combines strong software engineering practices with … modern cloud data technologies to deliver trusted, secure and high-quality data products.The successful candidate will work closely with business partners, product teams, architects, data managers and analytics specialists to transform complex business requirements into robust data solutions. They will lead technical ...

Lead Data Engineer/Senior Data Engineer - AWS, Snowflake, CI/CD Location: Heathrow - 1-2 days per week onsite Contract: Immediate start until December 2026, likely extension into 2027 Rate: Up to £630 per day all-inclusive - Inside IR35/PAYE Lead Data … cloud data warehousing and modern data platform delivery. AWS data services, cloud-native architecture and data pipeline orchestration. DataOps, automated deployment, Infrastructure as Code and release automation. Agile software development, code reviews, test-driven development and engineering quality assurance. AI-assisted ...

business stakeholders to understand data requirements and deliver solutions that meet their needs.**Automation & CI/CD:** Automate data pipeline deployments, testing, and monitoring using CI/CD principles and tools.**Documentation:** Maintain clear and comprehensive documentation for data pipelines, models, and processes. … Troubleshooting:** Investigate and resolve data pipeline failures, performance bottlenecks, and data quality issues.**On-call Support: This role requires to be available for out-of-office on-call support on a rotation.****Required Qualifications:****Experience:** 7+ years of professional experience in data engineering ...

growing world. We leverage cutting-edge technology to optimize operations, enhance customer experience, and drive business growth. We are seeking a Senior Data Engineer to join our team and play a pivotal role. About The Role At Maersk, we are redefining global logistics through data, platform … data ecosystems Operational Excellence Ensure data solutions are reliable, scalable, performant, secure, and production‐ready Monitor, troubleshoot, and continuously improve pipeline performance, data quality, and platform stability Drive automation, observability, and supportability across data, analytics, and AI/ML solutions ...

Data and AI - Data Architect or Engineer Full-time Be part of a global consulting powerhouse, partnering with clients on their most critical strategic transformations. We are Wavestone. Energetic, solution-driven experts who focus as much on people as on performance and growth. Hand in hand … client-facing roles, or equivalent industry experience delivering data engineering and architecture solutions. Strong understanding of data engineering principles, including pipeline design, ETL/ELT, ingestion patterns, orchestration, and integration approaches. Experience designing or governing modern data architectures (lakehouse, warehouse, data ...

Methods is recruiting for a permanent Mid/Senior Data Engineer to join the Data and AI Capability Centre. This role will be mainly remote but require flexibility to travel to client sites, and our offices based in London, Sheffield, and Bristol. You will support complex … reused as part of an enduring data governance model. Experience implementing and advocating for test‐driven development methodologies in data pipeline workflows, including unit testing, integration testing, and data quality validation frameworks Proven experience leading technical aspects of data projects Strong ...

could mean reducing a data preparation process from hours to minutes; eliminating repetitive analyst intervention; improving data quality or pipeline reliability; increasing reuse of curated datasets and common transformation logic; reducing compute consumption; shortening the time required to develop analytical products; or releasing analytical capacity … solutions that demonstrably release capacity and accelerate analytical delivery. Provide senior technical leadership and engineering assurance set and champion standards for architecture, code, pipelines, data models, testing, documentation and engineering practices, constructively challenging solutions where greater rigour or efficiency is required. Establish modern engineering and deployment practices embed ...

Olympic Committee, and Mercedes-Benz. Our services span the full digital delivery lifecycle, including architecture, engineering, delivery management, user-centred design, business analysis, data, DevOps, and AI. We operate as a collaborative and inclusive organisation that empowers our people to take ownership, innovate, and develop their expertise. … experience with SQL and at least one programming language such as Python, Scala, or Java. ETL/ELT design and data pipeline orchestration. Streaming and event-driven data architectures. Agile and DevOps delivery methodologies applied to data platforms (DataOps). Expertise in data ...

Data Architect - Manager Location: London - Hybrid Salary: £80,000- £90,000 We are seeking an experienced AI & Data Architect to join a leading change and transformation consultancy, delivering modern data and analytics solutions across complex client environments. This role will focus … data architecture, cloud data engineering, data governance and AI-enabled data solutions , providing technical leadership across data initiatives. Key Responsibilities as a AI & Data Architect - Manager Design and implement end-to-end data solutions from ingestion ...

Manager - AI & Data Architect £70,000 to 90,000 GBP Bonus Hybrid WORKING Location: Central London, Greater London - United Kingdom Type: Permanent Manager - AI & Data Architect Location: London | Hybrid Salary: Up to £90,000 + bonus We're working with a leading change and transformation consultancy … that is looking to hire an experienced AI & Data Architect into its Technology & Data practice. This is an excellent opportunity for a Data Architect from a consultancy background who enjoys working directly with clients, solving complex business problems and designing modern, scalable data ...

Senior Data Engineer County Durham - Flexible working arrangements £60,000 plus great benefits 2 Year Fixed Term We are looking for a Senior Data Engineer on a 2 year fixed term appointment to play a key role in designing, building and maintaining a modern data environment that supports analytics, reporting and wider business decision-making. The role will focus on developing scalable data pipelines, robust data models and reliable data platforms, ensuring that data is accurate, accessible, secure and fit for purpose. This position will ...

Senior Data Engineer LEEDS | ASSET MANAGEMENT | COMPETITIVE PACKAGE Border to Coast Pensions Partnership is one of the UK's largest pension pools and the largest asset manager outside London and Edinburgh. Owned by 18 Local Government Pension Scheme partner funds, we manage approximately £120 billion of assets … Pension Scheme. Integrity, collaboration and sustainability are at the heart of how we work, and we are continuing to invest in our technology, data and innovation capabilities to support our long-term strategic ambitions. Our client is an FCA regulated asset manager with a reputation for taking ...