301 to 325 of 1,053 Data Pipeline Jobs in England

Data Engineering and Integration Manager (Remote) - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end … data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning … ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning More ❯

Data Engineering and Integration Manager (Remote) - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end … data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning … ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning More ❯

Data Delivery and Integration Manager (Remote) - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end … data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning … ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning More ❯

Data Delivery and Integration Manager (Remote) - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end … data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning … ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning More ❯

Data Delivery and Integration Manager (Remote) - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end … data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning … ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning More ❯

Data Engineering and Integration Manager (Remote) - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end … data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning … ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning More ❯

Data Delivery and Integration Manager (Remote) - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end … data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning … ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning More ❯

Data Delivery and Integration Manager (Remote) - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end … data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning … ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning More ❯

Data Engineering and Integration Manager (Remote) - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end … data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning … ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning More ❯

Data Delivery and Integration Manager (Remote) - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end … data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning … ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning More ❯

Data Operations Lead Location: Watford - 3 days per week Salary: up to £83,000 + up to 15% bonus My client is seeking a hands-on Technical Lead to take ownership of data operations for a large-scale cloud-based reporting environment. You'll oversee offshore engineers, manage end-to-end data workflows, and … ensure the smooth delivery of daily data loads across multiple systems. Key Responsibilities Lead daily data operations and ensure end-to-end completion of data loads. Monitor and debug Airflow workflows, resolving issues efficiently. Manage a team of offshore data engineers, providing technical direction and support. Collaborate with stakeholders to troubleshoot data discrepancies and root-cause issues in reports. Maintain and improve data lineage and flow across AWS and Power BI reporting stacks. Work closely with business and technical stakeholders to improve data reliability and transparency. Identify opportunities for automation and process optimisation once BAU stability is achieved. Technical Environment AWS (data storage and More ❯

Senior Data Engineer London £65-85k + 15% bonus A London-based software company on a mission to make data work smarter. Their products power thousands of businesses, and as they grow, they’re building a data stack that scales with their ambition. They’re looking for a Data Engineer who … s excited about designing modern data systems, experimenting with new tech, and helping shape how data flows through everything they build. What You’ll Do Build and own data pipelines that connect product, analytics, and operations Design scalable architectures using tools like dbt , Airflow , and Snowflake/BigQuery Work with engineers and product teams … to make data easily accessible and actionable Help evolve their data warehouse and ensure high data quality and reliability Experiment with automation, streaming data, and ML-ready datasets Influence technical decisions across the stack — they love new ideas What You Bring Hands-on experience in Python and SQL Experience with modern data More ❯

Data Engineer – AI & Agentic Systems London (Hybrid) - one day p/week in office £70,000-80,000 + bonus Are you passionate about data engineering, AI innovation, and building systems that power real-world intelligence? We’re an established political intelligence leader transforming into an AI-driven, technology-first organisation . Following a major modernisation … platform , built advanced multi-agent AI systems , and are now scaling our roadmap to power the next generation of agentic applications . We’re looking for a skilled Data Engineer to join our growing Engineering team — someone who thrives on designing high-performance data systems and enabling AI applications to operate with speed, accuracy, and context. … ecosystem . What You Bring 4–7 years’ experience in Data Engineering , ideally in cloud-native or AI-oriented environments. Strong Python skills for data pipeline and service development. Proficiency with AWS (Lambda, S3, Glue) and orchestration tools (Airflow, Dagster, etc.). Familiarity with relational and vector databases (PostgreSQL, Pinecone, MySQL). Understanding of API More ❯

Data Engineer – AI & Agentic Systems London (Hybrid) - one day p/week in office £70,000-80,000 + bonus Are you passionate about data engineering, AI innovation, and building systems that power real-world intelligence? We’re an established political intelligence leader transforming into an AI-driven, technology-first organisation . Following a major modernisation … platform , built advanced multi-agent AI systems , and are now scaling our roadmap to power the next generation of agentic applications . We’re looking for a skilled Data Engineer to join our growing Engineering team — someone who thrives on designing high-performance data systems and enabling AI applications to operate with speed, accuracy, and context. … ecosystem . What You Bring 4–7 years’ experience in Data Engineering , ideally in cloud-native or AI-oriented environments. Strong Python skills for data pipeline and service development. Proficiency with AWS (Lambda, S3, Glue) and orchestration tools (Airflow, Dagster, etc.). Familiarity with relational and vector databases (PostgreSQL, Pinecone, MySQL). Understanding of API More ❯

Data Engineer – Hybrid - London We’re working with a growing technology-driven business looking to add a Data Engineer to their team. This is a great opportunity to join a company that values clean, scalable data systems and a culture of collaboration and curiosity. You’ll play a key role in building and maintaining … the data pipelines, models, and architectures that power analytics and product innovation. The ideal candidate is someone who thrives on solving data challenges and enjoys turning complex datasets into well-structured, reliable systems. What you’ll be doing Designing, developing, and maintaining end-to-end data pipelines Building and optimising data models … and warehouse solutions Performing ETL processes to ensure data quality and consistency Collaborating with teams across engineering, analytics, and product Supporting business intelligence and analytics efforts What we’re looking for Strong background in Data Engineering and Data Modelling Solid experience with ETL processes and Data Warehousing Proficiency with SQL and at More ❯

Data Engineer – Hybrid - London We’re working with a growing technology-driven business looking to add a Data Engineer to their team. This is a great opportunity to join a company that values clean, scalable data systems and a culture of collaboration and curiosity. You’ll play a key role in building and maintaining … the data pipelines, models, and architectures that power analytics and product innovation. The ideal candidate is someone who thrives on solving data challenges and enjoys turning complex datasets into well-structured, reliable systems. What you’ll be doing Designing, developing, and maintaining end-to-end data pipelines Building and optimising data models … and warehouse solutions Performing ETL processes to ensure data quality and consistency Collaborating with teams across engineering, analytics, and product Supporting business intelligence and analytics efforts What we’re looking for Strong background in Data Engineering and Data Modelling Solid experience with ETL processes and Data Warehousing Proficiency with SQL and at More ❯

Data Engineer - £50,000 - £130,000 plus bonus - Newcastle upon Tyne, United Kingdom (Hybrid) Are you a talented Data Engineer with a passion for building robust data platforms and pipelines? Join a fast-growing, high-calibre team in the heart of Newcastle, where you’ll work on impactful projects that shape how data … join a newly established venture at an early stage. You’ll help define the culture, shape the technical roadmap, and work alongside some of the brightest minds in data and finance. If you thrive in a fast-paced, collaborative environment and enjoy solving complex problems, this could be the perfect next step. Key Responsibilities Build and Maintain Data Pipelines: Design and develop sophisticated pipelines to ingest data from external vendors, sell-side partners, and other sources into a central data platform Platform Development & Testing: Enhance and test the data platform to ensure it meets evolving business needs and maintains high reliability Ensure Data Integrity: Maintain the availability and More ❯

Data Scientist - data and analytics +6 months +Fully remote working +Inside IR35 +£450 - £525 a day We're looking for an experienced Data Scientist to play a key role in turning complex data into clear, actionable insights. You'll be responsible for the full data lifecycle - from collection and … a highly collaborative role, working closely with our existing team to deliver high-quality results and meet project deadlines. The role: Collect, clean, and preprocess structured and unstructured data from multiple internal and external sources. Perform exploratory data analysis (EDA) to identify trends, patterns, and anomalies. Design and implement data pipelines for model-ready … datasets in collaboration with data engineering teams. Apply feature engineering and selection techniques to improve model accuracy and interpretability. Develop and validate machine learning and statistical models for prediction, classification, clustering, or optimization. Apply supervised and unsupervised learning techniques using libraries such as Scikit-learn, TensorFlow, or PyTorch. Implement NLP, time-series forecasting, or optimization algorithms based on More ❯

Job Title: Lead Data Engineer Duration: long-term contract Location: UK Based Hybrid (x2-3 days from Birmingham) Visa: No sponsorship available/No PSW Overview: We’re looking for a hands-on Lead Data Engineer to design, build, and optimize scalable data pipelines and infrastructure for global banking projects. You’ll lead a … team, drive engineering best practices, and ensure data reliability, security, and compliance. Key Responsibilities: Lead and mentor a team of data engineers, establishing best practices in data engineering. Design, build, and maintain scalable, secure , and reliable data pipelines and architectures. Develop and optimize ETL processes, integrating diverse data sources into … unified platforms. Ensure data quality, governance, and compliance with regulatory requirements. Collaborate with data scientists, analysts, and IT teams to support analytical and business goals. Monitor, troubleshoot , and enhance data performance and infrastructure. Key Skills & Experience: Strong experience with SQL/NoSQL databases, data warehousing, and big data (Hadoop, Spark More ❯

Senior Data Engineer - Manchester - Salary £80,000 + Bonus The Company: We're partnered with an ambitious business based in Manchester that is investing heavily in its data transformation journey. As part of this growth, we're looking for a Senior Data Engineer to play a key role in building a new Group BI … platform. The Role: You'll lead the migration from an existing on-premise SQL environment to a greenfield AWS data platform. Acting as a senior member of the team, you'll guide and mentor colleagues as they upskill in cloud technologies, ensuring best practices are embedded throughout. This is a great opportunity to join a business and work … candidates with a blend of the following: Strong knowledge of AWS data services (Glue, S3, Lambda, Redshift, etc.) Solid understanding of ETL processes and data pipeline management Proficiency in Python and PySpark Experience working with SQL-based platforms Previous involvement in migrating on-premise solutions to cloud is highly desirable Excellent collaboration skills and ability More ❯

Senior Data Engineer - London - Hybrid - £80,000 - £95,000 My client are a leader in the financial services industry, and are continuing to expand their data engineering practice. They are now on the look out for an experienced Senior Data Engineer to join the team, bringing technical expertise in Snowflake, AWS, DBT, and Terraform. … from home) 29 Days Annual Leave + Bank Holidays Free Company Shares Private medical care And many more Role and Responsibilities: Design, develop, and maintain scalable, high-performance data pipelines using Snowflake on AWS. Build and optimise Snowflake environments: Warehouses, schemas, roles, security policies. Snowpipe, Streams & Tasks. Partitioning, clustering, and performance tuning Develop robust ELT pipelines using dbt … for modelling and transformation. Orchestrate workflows using Airflow, ensuring reliable and monitored data delivery. Implement infrastructure and environment provisioning using Terraform. Apply strong data quality, testing, and observability practices throughout the pipeline. Work with analytics & data science teams to provide well-modelled, documented datasets. Establish and maintain CI/CD pipelines for data More ❯

Senior Data Engineer - London - Hybrid - £80,000 - £95,000 My client are a leader in the financial services industry, and are continuing to expand their data engineering practice. They are now on the look out for an experienced Senior Data Engineer to join the team, bringing technical expertise in Snowflake, AWS, DBT, and Terraform. … from home) 29 Days Annual Leave + Bank Holidays Free Company Shares Private medical care And many more Role and Responsibilities: Design, develop, and maintain scalable, high-performance data pipelines using Snowflake on AWS. Build and optimise Snowflake environments: Warehouses, schemas, roles, security policies. Snowpipe, Streams & Tasks. Partitioning, clustering, and performance tuning Develop robust ELT pipelines using dbt … for modelling and transformation. Orchestrate workflows using Airflow, ensuring reliable and monitored data delivery. Implement infrastructure and environment provisioning using Terraform. Apply strong data quality, testing, and observability practices throughout the pipeline. Work with analytics & data science teams to provide well-modelled, documented datasets. Establish and maintain CI/CD pipelines for data More ❯

Azure Data Engineer - 3-Month Contract - £450-£500/day - Outside IR35 Location: Remote (UK-based) Duration: 3 months Rate: £400-£450 per day (Outside IR35) Role Overview We are looking for an experienced Azure Data Engineer to join a short-term project focused on building and optimising cloud-based data solutions. This role … requires strong technical expertise in Azure services and modern data engineering practices, with the ability to deliver high-quality solutions in a fast-paced environment. Key Responsibilities Design and implement scalable data pipelines using Azure Data Factory , Databricks , and Synapse Analytics . Develop and optimise ETL processes for structured and semi-structured data. Work … with SQL and Python for data transformation and modelling. Integrate data from multiple sources, ensuring accuracy, consistency, and performance. Collaborate with stakeholders to understand requirements and deliver actionable insights. Apply best practices for data governance , security, and performance tuning. Required Skills Proven experience as an Azure Data Engineer in enterprise environments. Strong More ❯

Azure Data Engineer - 3-Month Contract - £450-£500/day - Outside IR35 Location: Remote (UK-based) Duration: 3 months Rate: £400-£450 per day (Outside IR35) Role Overview We are looking for an experienced Azure Data Engineer to join a short-term project focused on building and optimising cloud-based data solutions. This role … requires strong technical expertise in Azure services and modern data engineering practices, with the ability to deliver high-quality solutions in a fast-paced environment. Key Responsibilities Design and implement scalable data pipelines using Azure Data Factory , Databricks , and Synapse Analytics . Develop and optimise ETL processes for structured and semi-structured data. Work … with SQL and Python for data transformation and modelling. Integrate data from multiple sources, ensuring accuracy, consistency, and performance. Collaborate with stakeholders to understand requirements and deliver actionable insights. Apply best practices for data governance , security, and performance tuning. Required Skills Proven experience as an Azure Data Engineer in enterprise environments. Strong More ❯

We are looking for a Senior Data Analyst to join our Credit Risk Portfolio Management team - a key function responsible for understanding and forecasting the financial health of the customer base. The role requires the use of advanced analytics to provide deep insights into credit risk and performance to inform our risk management strategy. This role is ideal … to develop and maintain debt forecasts to track performance vs. plan, forecast risk and deep dive into the drivers of variations to plan Developing scenario models to enable data-based decisioning within operational and strategic planning cycles Staying up to date with emerging analytical techniques and technologies, partnering with Data Science to deliver … advanced segmentation and behavioural analysis Delivering and consulting on the advanced analytics required to support project delivery across the wider Credit Management function e.g. simulation models, data pipeline mock ups, statistically robust testing Translating analytical outputs into clear recommendations for business stakeholders, influencing decisions across debt prevention and collections strategy Liaising with Data Engineers to More ❯