1 to 25 of 799 Data Pipeline Jobs in England

standards, and delivery excellence. Coach offshore data engineering teams to understand the rationale for technical approaches in data architecture and pipeline design, surfacing and dealing with ambiguity and conflicting demands, escalating appropriately to resolve prioritization conflicts. Build collaborative relationships with Data Scientists, Data … cost management and optimization Knowledge of data quality frameworks, data governance practices, and metadata management Understanding of data pipeline architecture, ETL/ELT patterns, and data modeling principles Familiarity with infrastructure as code (Terraform) and CI/CD for data ...

Remote/Hybrid: for London (4 days WFO, 1-day WFH mandatory) Experience 15+ years About the Role We are seeking a senior Data Architect to join the engineering organisation as part of Project Compass. This programme is delivering next-generation capabilities across Accounts (Real-Time Ledger), Payments … Engine, and Foreign Exchange – all of which generate, consume, and depend on high-quality, well-governed data at scale. The Data Architect will own the end-to-end data architecture across spanning Snowflake as the enterprise data warehouse and a landscape ...

summary Join Essex ICB as our Head of Data Engineering (Data Architecture & Engineering) and help shape how data improves health and care for a population of 2 million people. This strategic leadership role is central to developing secure, scalable data platforms that … support population health management, integrated care and evidence-based decision making. You will lead enterprise data architecture and engineering capabilities, ensuring trusted, high-quality and timely data flows across the health and care system. Working with senior leaders, clinicians, analysts and partners, you will translate strategic ...

Minimum 10+ years of experience as a Data Engineer or similar role. Proven expertise in the technologies below, and data pipeline development and strong understanding of data warehousing concepts and practices. Excellent problem-solving and analytical skills and strong communication and teamwork skills. … Databricks ML and Azure ML to develop predictive models and drive business insights. Proven expertise in Databricks, Apache Spark, and data pipeline development and strong understanding of data warehousing concepts and practices. Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage ...

life balance. That’s waiting for you at Sainsbury’s. Think about the scale it takes to feed the nation. The level of data, transactions and variety involved. Then you’ll realise this is a modern software engineering environment, because it has to be. We’ve made significant … standards, and delivery excellence. Coach offshore data engineering teams to understand the rationale for technical approaches in data architecture and pipeline design, surfacing and dealing with ambiguity and conflicting demands, escalating appropriately to resolve prioritization conflicts. Build collaborative relationships with Data Scientists, Data ...

Select how often (in days) to receive an alert: Create Alert Competitive salary | UK: hybrid: London + remote At NTT DATA, we know that with the right people on board, anything is possible. The quality, integrity, and commitment of our employees are key factors in our company … analytics. Collaborate with data architects, analysts, and business stakeholders to understand data requirements and deliver solutions. Optimize data pipeline performance, scalability, reliability, and data quality. Implement data governance, validation, and security best practices. Troubleshoot production data issues ...

Data Architect Inside IR35 up to £600+ Nottingham Hybrid Summary We're undertaking a fast paced data transformation into Databricks at E.ON Next using best practice data governance and architectural principles, and we are growing our data engineering capability within the Data … data storage concepts and logical data structures i.e. data warehousing. - Able to make recommendations for data pipeline design based on business requirements. - Be open to new ways of working, and open to working with new technologies. - Be able to set your ...

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising … warehousing concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability to communicate technical concepts ...

Manchester (Data Engineer, Senior Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer … proficiency, including experience with AWS services such as AWS Glue, AWS Lambda, AWS S3, AWS Redshift, and Amazon EMR. Proven expertise in Python, SQL, Pipeline Orchestration and PySpark is also expected, as is experience with data lakehouse architectures and data warehousing solutions. Agile experience ...

Kaluza’s evolving data & architecture strategy - they build and own the infrastructure, tooling and governance for Kaluza's internal data pipeline, from data ingestion, data cataloguing to data storage and exposing data externally. What will … pipelines, strategic data architectural decisions, and high‐quality "data mart" objects across functions like product, finance, or strategy. Pipeline Specialist: You possess extensive experience in engineering robust ETL/ELT processes and data pipelines, with a focus on curating, transforming ...

observable data pipelines supporting critical Commodities datasets Modernize legacy workflows, reduce technical debt, and improve performance, reliability, and maintainability. Design automated pipeline controls for validation, monitoring, schema change, exception handling, and data integrity. Develop workflow orchestration, alerting, observability, and remediation processes. Translate business and client … Finance or other STEM related field or degree‐equivalent qualifications 4+ years of experience designing and building scalable data solutions, ETL pipelines, data workflows, and monitoring frameworks. Strong hands‐on experience with Python or similar programming/scripting languages. Experience with querying structured, semi‐structured ...

Olympic Committee, and Mercedes-Benz. Our services span the full digital delivery lifecycle, including architecture, engineering, delivery management, user-centred design, business analysis, data, DevOps, and AI. We operate as a collaborative and inclusive organisation that empowers our people to take ownership, innovate, and develop their expertise. … experience with SQL and at least one programming language such as Python, Scala, or Java. ETL/ELT design and data pipeline orchestration. Streaming and event-driven data architectures. Agile and DevOps delivery methodologies applied to data platforms (DataOps). Expertise in data ...

About the Role An established professional services organisation is seeking a Data Engineer with experience in enterprise data platforms, data analysis and data architecture to join its growing Data Services function. The successful candidate will support the delivery … modern Reporting & Analytics programme by designing, developing and maintaining an enterprise data platform. The role focuses on building scalable data solutions, ensuring reliable data movement from operational systems into a Snowflake environment, and developing robust data models that underpin enterprise reporting ...

Data Engineer Location: London (Hybrid) Salary: Up to £75,000 + Bonus + Benefits Technology: SQL, Python, Spark - Azure, AWS, GCP - ETL/ELT - Data Governance The Opportunity Are you a Data Engineer looking for an opportunity to work on large-scale data transformation programmes whilst helping shape enterprise-wide data strategy? We're partnering with an organisation that is making significant investments in its data capabilities and digital transformation journey. Data sits at the heart of business decision-making, making this an excellent opportunity ...

Week) 550 per day (Outside IR35) 6-Month Initial Contract We're working with a large, technology-driven organisation undergoing a significant data transformation programme and seeking an experienced Data Architect to play a pivotal role in shaping its enterprise data landscape. This … exciting opportunity to help unlock the value of a complex and diverse data estate, enabling the creation of unified customer and property data views, supporting system integrations and migrations, and establishing best-in-class data architecture and governance practices. The Role As a Data ...

capital and derivative valuation adjustments. Using the latest analytics and technology such as a fully vectorized pricing library, Machine Learning, and a Big Data stack for scalability, our products and solutions are used by the largest tier-one banks to smaller niche firms. Our risk analytics solutions … London to join the Market Data and Integration team within Risk Analytics. The role will focus on workflow design, data pipeline requirements, integration patterns, validation controls, and operational improvements that support scalable risk analytics delivery. Responsibilities The Senior Product Analyst will work with product, financial ...

capital and derivative valuation adjustments. Using the latest analytics and technology such as a fully vectorized pricing library, Machine Learning, and a Big Data stack for scalability, our products and solutions are used by the largest tier-one banks to smaller niche firms. Our risk analytics solutions … London to join the Market Data and Integration team within Risk Analytics. The role will focus on workflow design, data pipeline requirements, integration patterns, validation controls, and operational improvements that support scalable risk analytics delivery. Responsibilities The Senior Product Analyst will work with product, financial ...

everyone has access to healthcare today and for generations to come. Join Roche, where every voice matters. The Position Job Description The Principal Data Architect, Information Architect, and Lead Data Modeler drives the strategic vision, structural design, and semantic definition of the organization’s enterprise data ecosystem. This role bridges the gap between high-level business strategy and technical execution, leading the design of scalable data architectures, comprehensive information blueprints, and robust enterprise data models. As a Principal Data Architect, you will champion data democratization, mentor ...

Senior Data Manager £90k - £120k per annum + Bonus and Benefits London, Manchester or Glasgow/Hybrid Are you ready to help organisations transform how they use data and AI? Do you thrive on designing cloud-native platforms, solving complex technical challenges and turning emerging … technologies into real business value? This is your chance to join a market-leading technology consultancy at the forefront of Data & AI transformation. You'll work with major organisations to design and deliver next-generation data platforms that enable AI, advanced analytics and intelligent automation, while ...

Senior Data Scientist Welwyn Garden City, Hertfordshire or Slough, Berkshire | Hybrid (2 Days Office) | Python | SQL | PySpark | Azure | Databricks | Machine Learning | Statistics | Time Series Forecasting | Propensity Models Role: Senior Data Scientist, Lead Data Scientist, ML Scientist, AI Data Scientist, Statistical Data Scientist, Predictive Analytics Key Skills: Senior Data Scientist, Data Scientist, Machine Learning, Artificial Intelligence, Predictive Analytics, Statistical Modelling, Python, SQL, PySpark, Azure, Databricks, MLflow, GitHub Actions, CI/CD, Time Series Forecasting, Propensity Modelling, Feature Engineering, Data Engineering, Azure Machine Learning, Azure ...

Data Pipeline & Systems Manager (Digital Marketing) Salary: £45,000 - £55,000 Employment Type: Full time Location: Camden (London), 2 days a week in the office This is a fantastic opportunity for a data-minded professional who wants to own the infrastructure behind a growing marketing … impact organisations, sustainable brands, or arts & cultural institutions. Whatever the cause, we help clients do good, better. What does being a Data Pipeline & Systems Manager at ethix look like? You'll own the agency's data pipeline end to end: pulling data ...

platforms so they are reliable, secure, and easy to change. You will work across engineering and operations to automate delivery, improve data pipeline observability, and embed good governance so analytics and AI workloads can run at scale. You will be part of the Data Platforms … restricted environments. Delivering data applications in an automated and continuous fashion. Utilising tools like Airflow for orchestration and automating data pipeline deployments using DevOps tools and techniques (Docker, Containers, Terraform, Kubernetes) Building data pipelines using both cloud-native and open-source data ...

Essential Skills Strong SQL skills, including complex joins, aggregations, subqueries and query optimisation Strong understanding of ETL/ELT concepts and data pipeline design Hands-on experience with Apache Kafka or similar streaming platforms Strong knowledge of AWS data services and managed databases Experience with … from internal and third-party APIs Strong data modelling and data warehousing knowledge Ability to troubleshoot data, pipeline, performance and reliability issues Active SC clearance OR BPSS Desirable Skills Experience working in DDaT-aligned digital delivery environments Experience with Swagger/OpenAPI ...

Will Be Working WithThe Data Platforms team is part of the Insights and Data Global Practice and has seen strong growth and continued success across a variety of projects and sectors. Data Platforms is the home of the Data Engineers, Platform Engineers … Solutions Architects and Business Analysts who are focused on driving our customers digital and data transformation journey using the modern cloud platforms.We specialise on using the latest frameworks, reference architectures and technologies using AWS, Azure and GCP along with various data platforms like Databricks, Snowflake, Quantexa ...

Data Architect Shape the future of enterprise data architecture within a modern cloud environment. We are seeking an experienced Data Architect to play a key role in designing, developing, and evolving a modern data platform. This position offers the opportunity to drive … strategic data initiatives, implement Data Mesh principles, and help create scalable, secure, and high-performing data solutions that support business growth. The Role As a Data Architect, you will be responsible for defining and governing data platform architecture, ensuring data ...