126 to 150 of 991 Data Pipeline Jobs in England

AWS Data Engineer | £ 75 ,000 - £90,000 | Central London (Hybrid - 3 days on-site) We're proud to partner with a high-growth fintech on the lookout for an AWS Data Engineer to join their fast-paced, data-driven organisation. This role is a great opportunity for someone who's eager to make an … impact and get hands-on with modern tools. You'll design, build, and optimise scalable data pipelines and warehouse solutions while collaborating across teams to ensure reliable, secure, and efficient data infrastructure for the organisation. What you'll be doing: Design, develop, and maintain scalable data architectures and ETL pipelines Build and manage data models and data warehouse solutions (Airflow, dbt, and Redshift) Write clean, efficient Python and SQL code for data processing and transformation Integrate data from internal and third-party APIs and services Optimise data pipelines for performance, scalability, and reliability Collaborate with data scientists, analysts, and engineering teams to More ❯

AWS Data Engineer | £ 75 ,000 - £90,000 | Central London (Hybrid - 3 days on-site) We're proud to partner with a high-growth fintech on the lookout for an AWS Data Engineer to join their fast-paced, data-driven organisation. This role is a great opportunity for someone who's eager to make an … impact and get hands-on with modern tools. You'll design, build, and optimise scalable data pipelines and warehouse solutions while collaborating across teams to ensure reliable, secure, and efficient data infrastructure for the organisation. What you'll be doing: Design, develop, and maintain scalable data architectures and ETL pipelines Build and manage data models and data warehouse solutions (Airflow, dbt, and Redshift) Write clean, efficient Python and SQL code for data processing and transformation Integrate data from internal and third-party APIs and services Optimise data pipelines for performance, scalability, and reliability Collaborate with data scientists, analysts, and engineering teams to More ❯

Data Engineer (Python SQL AWS) Remote UK to £50k Would you like to work on complex and interesting AI based systems with a team of tech entrepreneurs? You could be joining a growing start-up that is utilising Machine Learning and AI technology to revolutionise fish farming, improving fish health and growth; their carbon neutral technology is already … making a difference in Scotland, Chile, Canada, Australia, Spain and Norway and the company has ambitious growth plans. As a Data Engineer you will design, build and implement robust data pipelines that transform raw IoT sensor data into actionable insights for fish farmers worldwide. You'll work on scalable data infrastructure, from … coding skills including PostgreSQL, MySQL and NoSQL databases Ideally you will have experience with some of the following technology that is also in the tech stack: data pipeline orchestration tools (e.g. Airflow, Prefect, Dagster), cloud data platforms (e.g. AWS, S3, Glue, Athena, Redshift, Kinesis), data warehouse concepts and dimensional modelling, data More ❯

Head of Data Engineering Hybrid - Kent (3 Days per Week) Up to £130,000 + 30% Bonus + Benefits Are you an experienced data leader ready to take ownership of a large-scale data transformation? We're working with a leading UK financial services group that's on a major journey to modernise its … data estate - and they're looking for a Head of Data Engineering to lead the migration from on-premise to a modern, Azure-based cloud platform. This is a high-impact leadership role, ideal for someone who combines strategic vision with hands-on technical credibility and thrives on building, scaling, and delivering enterprise-grade data … solutions. Why this role? Lead the migration of legacy on-premise systems to Azure , driving one of the organisation's most strategic technology programmes. Shape and execute the data engineering roadmap , delivering scalable, secure, and compliant data solutions. Build and mentor a high-performing engineering team , embedding modern cloud-first practices. Hybrid flexibility: 3 days per More ❯

Robert Half Technology are assisting a market leading real estate organisation to recruit a Data Engineer on a contract basis - Hybrid Working - London based - Outside IR35 In this role, you will manage and optimise the data infrastructure, driving insights and supporting our decision-making processes. Your expertise will be crucial in contributing to our organisation's … data-driven success. As a key member of our team, you will have the opportunity to work on exciting projects and make a significant impact on our business Role The Data Engineer will design, develop, and maintain data infrastructure to ensure reliability, scalability, and performance. Collaborate with data scientists and analysts to … integrity. Implement efficient data models and schemas for storage and retrieval. Optimise data processes for improved performance and efficiency. Troubleshoot and resolve data pipeline issues swiftly and effectively. Keep abreast of industry trends and emerging technologies in data engineering, and continuously improve your skills and knowledge. Profile The Data More ❯

Robert Half Technology are assisting a market leading real estate organisation to recruit a Data Engineer on a contract basis - Hybrid Working - London based - Outside IR35 In this role, you will manage and optimise the data infrastructure, driving insights and supporting our decision-making processes. Your expertise will be crucial in contributing to our organisation's … data-driven success. As a key member of our team, you will have the opportunity to work on exciting projects and make a significant impact on our business Role The Data Engineer will design, develop, and maintain data infrastructure to ensure reliability, scalability, and performance. Collaborate with data scientists and analysts to … integrity. Implement efficient data models and schemas for storage and retrieval. Optimize data processes for improved performance and efficiency. Troubleshoot and resolve data pipeline issues swiftly and effectively. Keep abreast of industry trends and emerging technologies in data engineering, and continuously improve your skills and knowledge. Profile The Data More ❯

Robert Half Technology are assisting a market leading real estate organisation to recruit a Data Engineer on a contract basis - Hybrid Working - London based - Outside IR35 In this role, you will manage and optimise the data infrastructure, driving insights and supporting our decision-making processes. Your expertise will be crucial in contributing to our organisation's … data-driven success. As a key member of our team, you will have the opportunity to work on exciting projects and make a significant impact on our business Role The Data Engineer will design, develop, and maintain data infrastructure to ensure reliability, scalability, and performance. Collaborate with data scientists and analysts to … integrity. Implement efficient data models and schemas for storage and retrieval. Optimize data processes for improved performance and efficiency. Troubleshoot and resolve data pipeline issues swiftly and effectively. Keep abreast of industry trends and emerging technologies in data engineering, and continuously improve your skills and knowledge. Profile The Data More ❯

providing a broad range of knowledge on which to develop their careers and progress in the direction they choose. The Role: We are looking for an experienced Senior Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with a fantastic team of technology experts. … You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability. About you: Our team is our strongest asset, you will be an excellent team player … interpersonal and team working skills Self motivated, enthusiastic and committed The ideal candidates will share our values and be aligned with our ways of working Key Responsibilities: Develop Data Engineering solutions for our clients/projects Design and build data models, schemas to support business requirements Develop and maintain data ingestion and processing systems More ❯

providing a broad range of knowledge on which to develop their careers and progress in the direction they choose. The Role: We are looking for an experienced Senior Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with a fantastic team of technology experts. … You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability. About you: Our team is our strongest asset, you will be an excellent team player … interpersonal and team working skills Self motivated, enthusiastic and committed The ideal candidates will share our values and be aligned with our ways of working Key Responsibilities: Develop Data Engineering solutions for our clients/projects Design and build data models, schemas to support business requirements Develop and maintain data ingestion and processing systems More ❯

Details We are looking for a detail-oriented and proactive Data Engineer to join our team and play a key role in transforming raw operational and commercial data into actionable insights. This role will work across multiple data sources, including NetSuite, Shopify, SnapFulfil WMS and others to support strategic decision-making across finance, operations … and ecommerce. This is a new role whereby the candidate will help to steer the direction of the data stack to be used (Snowflake/SQL/Fabric etc). The ideal candidate will have hands-on experience in managing modern data platforms, a strong understanding of data pipelines, and the ability to create … and develop clear, business-relevant insights. Key Responsibilities: Build and maintain robust data models in a data warehouse/lake using data from NetSuite, Shopify, and SnapFulfil WMS amongst many others. Develop and automate reports and dashboards that support business needs across finance, operations, supply chain, and ecommerce. Clean, transform, and validate large datasets More ❯

Data Engineer £60,000 – £75,000 Hybrid (1 day per week in Leeds) My client is an established and fast-growing e-commerce business based in the heart of Leeds. Over the past few years, they’ve invested heavily in digital transformation and are now entering a new phase of growth — building a modern, data-driven … foundation to power decision-making across every part of the business. They’re now looking for an experienced Data Engineer to help design and implement their new data environment from the ground up. This is a rare opportunity to shape the architecture, tooling, and best practices within a company that’s genuinely open to new ideas … automated, analytics-led environment. Skills & Experience Proven experience as a Data Engineer within a modern data or cloud environment. Strong knowledge of ETL/ELT pipeline design and data modelling. Experience with Snowflake (or similar cloud-based data warehouse solutions). Familiarity with integration and automation tools such as Boomi, Celigo More ❯

Senior Data Engineer (Python/AWS) Full-time | London, UK Hybrid working: 2-3 days per week on-site Must be SC cleared, or eligible to obtain SC-level security clearance Job description We are looking for a developer with expertise in Python, AWS Glue, step function, EMR cluster and redshift, to join our AWS Development Team. You … be required as part of the interview process. Key responsibilities Hands-on experience in Python programming is essential Responsible for Build, Test and Maintain optimal AWS data pipeline architecture. Building AWS glue, step function, AWS Lambda functions and unit test Work with fellow developers, data architects, data analysts and data scientists … application infrastructure, suggesting changes to it Define and document best practices and strategies regarding application deployment and infrastructure maintenance Define service capacity planning strategies Implement the application's CICD pipeline using the AWS CICD stack Project tasks deliverables and management Deliver on project progress and ensure adherence to client expectation Communications, including deck writing Delivery of output Gathering of More ❯

Job Description We want to expand our Data Science function further within our well-established strong data-driven Centralised Analytical department. Our Data Science mission is to build machine learning models in the production environment relative to Marketing, Customer Insights, and Safer Gambling and establish a strong culture of data-driven decision … making in our organisation's strategy. We are looking for an experienced Machine Learning Engineer to support the delivery of ML products. You will work closely with the Data Science team, to understand the data and product requirements. You will also collaborate the Data & Ops team, to stay on top of key changes that … Scientists and ML engineers. Therefore, it is an excellent opportunity to grow, contribute and challenge yourself. Core Responsibilities Development and maintenance of the ML data pipeline, with the proper quality controls and contingency plans in place Model deployment & serving, ensuring that solutions align with internal best practices and have a high degree of automation Cost More ❯

Lake, Data Hubs, Data Services) using Terraform. Build and maintain CI/CD pipelines using GitHub Actions for infrastructure and data pipeline automation Collaborate with data engineering teams to integrate CDP with existing Big Data workflows. Write and maintain automation scripts using Shell and Python. Manage infrastructure … in the cluster. Employ security using an authentication and authorization system such as Kerberos. Knowledge of changes required for migrating to Cloudera cloud version CDP Knowledge of Cloudera data services (CDW, CDE, CDF, CAI) Design Native Cloud Application Architectures and optimize applications for AWS Network connectivity, Direct Connect, VPN, VPC, Security group … NACL, Route 53 Must have in depth AWS development experience (Containerization – Glue, Docker, Amazon EKS, Lambda, EC2, S3, Amazon DocumentDB, PostgreSQL) Strong knowledge of DevOps and CI/CD pipeline (GitHub, Jenkins) Scripting capability and the ability to develop AWS environments as code Hands-on AWS experience with at least 1 implementation (preferred in an Enterprise scale environment) Experience More ❯

Lake, Data Hubs, Data Services) using Terraform. Build and maintain CI/CD pipelines using GitHub Actions for infrastructure and data pipeline automation Collaborate with data engineering teams to integrate CDP with existing Big Data workflows. Write and maintain automation scripts using Shell and Python. Manage infrastructure … in the cluster. Employ security using an authentication and authorization system such as Kerberos. Knowledge of changes required for migrating to Cloudera cloud version CDP Knowledge of Cloudera data services (CDW, CDE, CDF, CAI) Design Native Cloud Application Architectures and optimize applications for AWS Network connectivity, Direct Connect, VPN, VPC, Security group … NACL, Route 53 Must have in depth AWS development experience (Containerization – Glue, Docker, Amazon EKS, Lambda, EC2, S3, Amazon DocumentDB, PostgreSQL) Strong knowledge of DevOps and CI/CD pipeline (GitHub, Jenkins) Scripting capability and the ability to develop AWS environments as code Hands-on AWS experience with at least 1 implementation (preferred in an Enterprise scale environment) Experience More ❯

A global IT services, consulting, and business solutions company has partnered with a leading financial services organisation to hire an experienced Data Architect for a 6-month contract. In this role, you'll design and implement enterprise-scale Data Lake solutions, define architectural standards, and guide best practices across large-scale digital transformation programmes. You'll … collaborate with cross-functional teams to ensure scalable, secure, and high-performance data systems that align with business objectives. This is a hybrid role requiring 2 days per week on-site in Central London. Ready to shape the future of data architecture in financial services? Apply now to join a high-impact team at the forefront … of transformation. Key Responsibilities Design and develop enterprise-grade data architecture frameworks supporting Data Lakes and Big Data platforms Create conceptual, logical, and physical data models for robust, scalable storage solutions Define and maintain the overall structure of data flows and models across multiple platforms Oversee integration of diverse data More ❯

Lead Data Engineer Opportunity for a Lead Data Engineer to join a market leading Software House company in London Salary up to £150,000 + fantastic benefits including our share options, collaborative working culture and exciting growth opportunities and more Apply online or contact Chelsea Hackett via Chelsea.hackett@searchability.com WHAT WILL YOU BE DOING? As a … Lead Data Engineer, you’ll take ownership of the entire data function — designing, scaling, and optimising the data platform that powers AI-driven products and insights. You’ll lead a small team of data engineers, set technical direction, and shape the company’s data strategy while staying hands-on with … Engineer in a fast-scaling tech or data-driven environment Strong proficiency in Python (or Scala/Java) and SQL Deep experience with data pipeline orchestration tools (Airflow, dbt, Dagster, Prefect) Strong knowledge of cloud data platforms (AWS, GCP, or Azure) and data warehousing (Snowflake, BigQuery, Redshift) Hands-on experience More ❯

Lead Data Engineer Opportunity for a Lead Data Engineer to join a market leading Software House company in London Salary up to £150,000 + fantastic benefits including our share options, collaborative working culture and exciting growth opportunities and more Apply online or contact Chelsea Hackett via Chelsea.hackett@searchability.com WHAT WILL YOU BE DOING? As a … Lead Data Engineer, you’ll take ownership of the entire data function — designing, scaling, and optimising the data platform that powers AI-driven products and insights. You’ll lead a small team of data engineers, set technical direction, and shape the company’s data strategy while staying hands-on with … Engineer in a fast-scaling tech or data-driven environment Strong proficiency in Python (or Scala/Java) and SQL Deep experience with data pipeline orchestration tools (Airflow, dbt, Dagster, Prefect) Strong knowledge of cloud data platforms (AWS, GCP, or Azure) and data warehousing (Snowflake, BigQuery, Redshift) Hands-on experience More ❯

Senior Data Engineer (Databricks) Full Time/Permanent £70,000 - £80,000 + car allowance, generous bonus, private medical and other extensive benefits Hybrid - 1 day a week in the Oxfordshire head office required The Company: My client is an industry leading and award-winning financial services organisation who operate on a global scale. They are headquartered in … Oxfordshire, UK and also have offices throughout the UK, Europe and the US. The Role: We are looking for a driven and experienced Senior Data Engineer with extensive Databricks experience to join a rapidly growing in house Data team during an exciting period of change. This is a role where you can really make your mark … an Agile delivery environment, working closely with the Head of Data, Data Product Manager and Data Architect to ensure your team maintains a pipeline of delivery against the Backlog; providing vital insight from a wide-ranging dataset to support executive and operational decision making that will underpin sustained growth of business units domestically More ❯

Databricks Engineer - £400PD - Remote About the Role We are seeking a highly skilled Azure Data Engineer with deep, hands-on Databricks experience to join our growing data engineering team. In this role, you will design, build, and optimise scalable data pipelines and lakehouse architectures on Azure, enabling advanced analytics and data-driven … decision making across the business. Key Responsibilities Design, develop, and maintain ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake. Build and optimise data lakehouse architectures on Azure Data Lake Storage ( ADLS ) . Develop high-performance data solutions using Azure Synapse, Azure Data Factory, and Databricksworkflows Implement best practices for … security, and quality across all pipelines. Collaborate with data scientists, analysts, and cross-functional teams to deliver reliable, production-grade data models. Monitor and tune pipeline performance to ensure efficiency, reliability, and cost optimisation. Participate in CI/CD processes and infrastructure-as-code solutions using tools like Terraform, GitHub Actions, or Azure DevOps Required More ❯

Databricks Engineer - £400PD - Remote About the Role We are seeking a highly skilled Azure Data Engineer with deep, hands-on Databricks experience to join our growing data engineering team. In this role, you will design, build, and optimise scalable data pipelines and lakehouse architectures on Azure, enabling advanced analytics and data-driven … decision making across the business. Key Responsibilities Design, develop, and maintain ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake. Build and optimise data lakehouse architectures on Azure Data Lake Storage ( ADLS ) . Develop high-performance data solutions using Azure Synapse, Azure Data Factory, and Databricks workflows Implement best practices … security, and quality across all pipelines. Collaborate with data scientists, analysts, and cross-functional teams to deliver reliable, production-grade data models. Monitor and tune pipeline performance to ensure efficiency, reliability, and cost optimisation. Participate in CI/CD processes and infrastructure-as-code solutions using tools like Terraform, GitHub Actions, or Azure DevOps Required More ❯

Data Software Engineer Role Opportunity for a Data Software Engineer to join a scaling startup in the AI and Healthcare technology sector Salary up to £110k + Equity Paddington-based (4–5 days per week in-office) Tech environment: Python | Spark | Databricks | AWS | PostgreSQL | Scala | Data Pipelines | AI Infrastructure If you wish to keep … your CV/data private, feel free to WhatsApp your details/CV to me, Dan – 07704 152638 WHO WE ARE: We’re a fast-growing AI-driven technology company on a mission to transform how data and automation power smarter care and decision-making. Our intelligent platform leverages advanced AI, automation, and scalable data systems to unlock powerful insights and efficiency across the healthcare ecosystem. Backed by strong Series A funding, we’re expanding our technical team and looking for a Data Software Engineer to help shape and scale our AI infrastructure. WHAT YOU WILL BE DOING: Lead the development of an AI-driven data orchestration platform used to More ❯

Data Software Engineer Role Opportunity for a Data Software Engineer to join a scaling startup in the AI and Healthcare technology sector Salary up to £110k + Equity Paddington-based (4–5 days per week in-office) Tech environment: Python | Spark | Databricks | AWS | PostgreSQL | Scala | Data Pipelines | AI Infrastructure If you wish to keep … your CV/data private, feel free to WhatsApp your details/CV to me, Dan – 07704 152638 WHO WE ARE: We’re a fast-growing AI-driven technology company on a mission to transform how data and automation power smarter care and decision-making. Our intelligent platform leverages advanced AI, automation, and scalable data systems to unlock powerful insights and efficiency across the healthcare ecosystem. Backed by strong Series A funding, we’re expanding our technical team and looking for a Data Software Engineer to help shape and scale our AI infrastructure. WHAT YOU WILL BE DOING: Lead the development of an AI-driven data orchestration platform used to More ❯

Craft: Data, Analytics & Strategy Job Description: Data Engineer – Core Data Models & Reporting King is a worldwide leader in mobile gaming, home to some of the most iconic casual games in history, including Candy Crush Saga, Farm Heroes Saga and Bubble Witch Saga. You will work alongside talented people from many crafts, in offices designed … for creativity, collaboration and fun in a team-first hybrid mode. With petabytes of data and billions of events generated every day, data sits at the heart of everything we do. The Core Data Models & Reporting team transforms this data into reliable, impactful and well-documented data products that support … a small collaborative team currently spread across Barcelona, London and Stockholm, working with engineers and analysts across Shared Tech and beyond. You will help build and maintain core data pipelines, improve existing products, and design clean, trustworthy data models that empower hundreds of users across King. Your Role Within the Kingdom Work closely with stakeholders to More ❯

New Permanent Opportunity available with a leading National Security Organisation for an eDV cleared Lead Data Engineer in Gloucester Gloucester location – hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL … to the National Security sector, delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You’ll work with cutting-edge technologies, including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework and are set for significant growth. What will the … Lead Data Engineer be Doing? You will develop mission-critical data solutions for National Security clients, working with cutting-edge technologies such as AI/DS, Cyber, Cloud, DevOps/SRE, and Platform Engineering. You'll collaborate directly with customers across National Security, Defence, and Intelligence to solve complex, high-stakes challenges. The role involves designing More ❯