501 to 525 of 1,061 Data Pipeline Jobs in England

Cloud Data & Full Stack Engineer - SC Cloud, Data Location: UK Wide Salary: £72,000 - £100,000 (depending on experience) + attractive benefitsFlexibility: Happy to consider candidates who can commute into London from other UK locationsSecurity: Essential that you can undergo security clearanceAbout the RoleWe're looking for a Cloud Data & Full Stack Engineer to … join our team and help build scalable, cloud-native platforms and applications that enable analytics, automation, and digital transformation. This role combines advanced data engineering with full stack development, giving you the chance to work on cutting-edge solutions that make a real impact.Key Responsibilities* Data Engineering: Design and implement data pipelines, lakes, and … warehouses using tools like Spark, Airflow, or dbt.* API & Microservices Development: Build secure, efficient APIs and microservices for data integration.* Full Stack Development: Deliver responsive, high-performance web applications using React (essential), plus Angular or Vue.js.* Back-End Expertise: Develop server-side logic with Java and Node.js; Python or Ruby experience is a bonus.* Cloud & Containers: Deploy microservices More ❯

the world discovers critical minerals. About us The biggest risk to all human progress is securing a sufficient, diversified supply of critical minerals. To meet energy transition and data centre demands, over the next 25 years we will need to mine the same amount of copper as we have ever mined in all of human history. Today’s … Cambridge University spin-out using explainable AI to transform the way that critical mineral mines are found and developed. Our uncertainty-aware models map subsurface resources from multimodal data, helping mining companies make faster and more accurate drilling decisions. This can halve drilling costs, double exploration areas, and bring critical mineral projects online sooner. We have just closed … The role We are looking for a full-time Data Scientist/Machine Learning Engineer with experience in graph-based ML models to lead data pipeline and model development. You will: · Build & automate data processing pipelines. · Implement & optimise graph-based ML models. · Create visualisations for geospatial data. · Explore and develop new product features. More ❯

the world discovers critical minerals. About us The biggest risk to all human progress is securing a sufficient, diversified supply of critical minerals. To meet energy transition and data centre demands, over the next 25 years we will need to mine the same amount of copper as we have ever mined in all of human history. Today’s … Cambridge University spin-out using explainable AI to transform the way that critical mineral mines are found and developed. Our uncertainty-aware models map subsurface resources from multimodal data, helping mining companies make faster and more accurate drilling decisions. This can halve drilling costs, double exploration areas, and bring critical mineral projects online sooner. We have just closed … The role We are looking for a full-time Data Scientist/Machine Learning Engineer with experience in graph-based ML models to lead data pipeline and model development. You will: · Build & automate data processing pipelines. · Implement & optimise graph-based ML models. · Create visualisations for geospatial data. · Explore and develop new product features. More ❯

Lead Data Engineer £100,000 – £120,000 Hybrid – Surrey (1 day in office every fortnight) This is a high-impact Lead Data Engineer role, where you’ll work across a cutting-edge data stack (AWS, Databricks, Spark, dbt) to design scalable platforms and products that enable self-service analytics, advanced modelling, and AI-driven … decision-making. You’ll report into the Head of Data Engineering, supporting a team of engineers through mentorship, coaching, and technical guidance. The role is less about admin-style management and more about making engineers better — building capability, driving best practices, and acting as a foundational support. Key responsibilities include: Leading data engineering projects and managing … sub-teams Designing, optimising, and scaling data platforms in AWS/Databricks Driving coding standards, frameworks, and best practices Building and supporting modern data pipelines and products Coaching and mentoring engineers to raise technical excellence Partnering with product managers, data & AI engineers to deliver solutions to major business problems, including Generative AI applications What More ❯

Our client, a global asset management firm is seeking to hire an ESG Data Scientist to join their Sustainable Research team. This role will play a key part in developing the tools, infrastructure and analytics that drive the firm’s ESG and sustainability capabilities. Key Responsibilities: Build analytics tools and machine learning models to assess ESG and sustainability … characteristics of companies Design and implement scalable, high-performance sustainability data systems and infrastructure Develop, maintain and enhance dashboards and tools for investment teams Build data pipelines integrating multiple sources into a unified, high-quality and trusted data environment Collaborate with investment and technology teams to prototype new metrics and deploy AI-driven insights … that enhance ESG integration and sustainability performance measurements Monitor and improve data quality, investigating and resolving data issues Engage with internal stakeholders across the firm to understand business needs and translate them into technical solutions Contribute to vendor evaluations and development of data governance standards Candidate Requirements: Minimum 4 years of experience in a More ❯

Our client, a global asset management firm is seeking to hire an ESG Data Scientist to join their Sustainable Research team. This role will play a key part in developing the tools, infrastructure and analytics that drive the firm’s ESG and sustainability capabilities. Key Responsibilities: Build analytics tools and machine learning models to assess ESG and sustainability … characteristics of companies Design and implement scalable, high-performance sustainability data systems and infrastructure Develop, maintain and enhance dashboards and tools for investment teams Build data pipelines integrating multiple sources into a unified, high-quality and trusted data environment Collaborate with investment and technology teams to prototype new metrics and deploy AI-driven insights … that enhance ESG integration and sustainability performance measurements Monitor and improve data quality, investigating and resolving data issues Engage with internal stakeholders across the firm to understand business needs and translate them into technical solutions Contribute to vendor evaluations and development of data governance standards Candidate Requirements: Minimum 4 years of experience in a More ❯

Senior Data Engineer – Contract | Edinburgh (2 days onsite) £500/day (Likely Outside IR35) 3 months initially Bright Purple is delighted to be working with an exciting, product-focused consultancy delivering some of the UK’s most high-profile and widely used consumer applications . Their client list features some of the biggest names in tech and beyond. … We’re seeking an experienced Senior Data Engineer to join their growing Data Practice on a 3-month engagement, helping shape and deliver scalable, cloud-native data solutions for household-name clients. What you’ll be doing Designing, building and maintaining robust data pipelines Automating and orchestrating workflows (AWS Glue, Azure Data … optimising modern data architectures (e.g. Databricks, Snowflake) Collaborating with multidisciplinary teams to deliver real business value What we’re looking for Strong experience with Python, SQL , and pipeline tools such as dbt or Airflow Proven background in data modelling, warehousing, and performance optimisation Hands-on experience with cloud data services (Glue, Lambda, Synapse More ❯

to help the engineering team refactor the ‘research-level’ code into production-ready code. You will be responsible for expanding and optimizing our cloud infrastructure and data pipeline architecture, as well as optimising data flow and collection throughout our custom-built Clinical Management Interface (CMI). You will work closely with the Data … seamless integration with their pipelines and clearly document all your work. Essential requirements: - Minimum 3 years professional software development experience - Expert proficiency in Python in software development and data science/processing - Strong working knowledge of R - Proven experience in refactoring "research-level" code into production-ready software - Proven experience of collaborating effectively in cross-functional team environment More ❯

Robotics Software Design Engineer - C PostgreSQL Are you an experienced Software Engineer with a strong background in C++ development and data systems for robotics? Are you based in the Cambridge area, or keen to join one of the UK's leading hubs for robotics and technology innovation? If so, our client an innovative "tech for good" start-up … Developing and optimising C++ code to acquire, report, and aggregate data in real time on constrained robotics hardware platforms Taking full ownership of the data pipeline from robot to cloud PostgreSQL databases Defining and implementing strategies for data ingestion and analysis including how, when, and where data is stored and transferred … Designing and maintaining the cloud interface for robotic data system Collaborating with robotics, electronics, and software teams in an Agile environment To apply for this Robotics Software Design Engineer - C PostgreSQL you should have: A degree or master's in Software Engineering, Computer Science, Robotics, or a related field Proven experience developing in modern C++ (C++14 or later More ❯

Robotics Software Design Engineer - C++/PostgreSQL Are you an experienced Software Engineer with a strong background in C++ development and data systems for robotics? Are you based in the Cambridge area, or keen to join one of the UK's leading hubs for robotics and technology innovation? If so, our client an innovative 'tech for good' start … Developing and optimising C++ code to acquire, report, and aggregate data in real time on constrained robotics hardware platforms Taking full ownership of the data pipeline from robot to cloud PostgreSQL databases Defining and implementing strategies for data ingestion and analysis including how, when, and where data is stored and transferred … Designing and maintaining the cloud interface for robotic data system Collaborating with robotics, electronics, and software teams in an Agile environment To apply for this Robotics Software Design Engineer - C++/PostgreSQL you should have: A degree or master's in Software Engineering, Computer Science, Robotics, or a related field Proven experience developing in modern C++ (C++14 or More ❯

Lead Data Engineer Salary: £90,000 - £115,000 Location: West London (3 Days in Office) Using data science at their core, they transform complex property and customer data into insights that enhance targeting, retention, and performance. The Opportunity This flexible, data-driven start-up places Data Science at the heart … of its business, using cutting-edge UK property data to deliver powerful insights for real estate partners and retailers. By leveraging advanced analytics, predictive modelling, and customer segmentation, the company helps clients better understand and engage with their audiences, improving marketing precision, timing, and overall performance. With a strong technical foundation and a collaborative team led by experienced … data leaders, the company is building efficient, automated data pipelines and scalable systems to power intelligent decision-making. This is an exciting opportunity for forward-thinking professionals to join a growing team, shape best practices, and make a real impact in a fast-evolving data and technology environment. The Role and Responsibilities This is More ❯

The Senior Data/BI Engineer will play a pivotal role in developing and optimising data pipelines, ensuring the seamless flow of information across the organisation. The successful candidate will also be heavily involved in supporting our cloud migration project. Client Details Based in Manchester City Centre, we are a leader in our field in the … serve over 35,000 customers with services like electrical testing, asset management, non-destructive testing (NDT), and inspections for infrastructure, manufacturing, and healthcare facilities. Description The Successful Senior Data Engineer will be responsible for but not limited to: · Development and implement data and reporting solutions from our Dynamics, in-house and 3rd party sources, using the … latest Microsoft technologies: Azure Synapse Analytics & Azure Data Factory, Azure Data Lake, Azure SQL Database Support older Microsoft Technologies whilst we are in transition: SSIS and SSRS. Supporting change and migration efforts. Work with other members of the team or directly with business users to understand and document business requirements, Undertake/support the monitoring of More ❯

The Senior Data/BI Engineer will play a pivotal role in developing and optimising data pipelines, ensuring the seamless flow of information across the organisation. The successful candidate will also be heavily involved in supporting our cloud migration project. Client Details Based in Manchester City Centre, we are a leader in our field in the … serve over 35,000 customers with services like electrical testing, asset management, non-destructive testing (NDT), and inspections for infrastructure, manufacturing, and healthcare facilities. Description The Successful Senior Data Engineer will be responsible for but not limited to: · Development and implement data and reporting solutions from our Dynamics, in-house and 3rd party sources, using the … latest Microsoft technologies: Azure Synapse Analytics & Azure Data Factory, Azure Data Lake, Azure SQL Database Support older Microsoft Technologies whilst we are in transition: SSIS and SSRS. Supporting change and migration efforts. Work with other members of the team or directly with business users to understand and document business requirements, Undertake/support the monitoring of More ❯

The Finance Systems & IT Support Analyst acts as the dedicated technical specialist for all Finance-related systems, providing expert-level support, system administration, and data management across platforms such as Microsoft Dynamics, SQL Server, Visual Studio, Power Bi, Metabase and associated tools. In addition to Finance systems expertise, this role provides general IT function, contributing to the stability … ensuring smooth operation and timely issue resolution. Support and administer Microsoft Dynamics, Evision and related financial applications. Develop and maintain SQL scripts, queries, and reports to support Finance data analysis and system integrations. Manage data pipelines and transformations using DBT and other tools to ensure data accuracy and integrity. Maintain and optimise Metabase dashboards … reports) Proficient in SQL for query writing, data manipulation, and reporting. Working knowledge of Metabase and Power BI. Experience with DBT for data transformation and pipeline management. Excellent troubleshooting, communication, and documentation skills. Desirable: Exposure to ERP or finance system integrations and data warehousing concepts. Experience supporting or developing APIs or data More ❯

The Finance Systems & IT Support Analyst acts as the dedicated technical specialist for all Finance-related systems, providing expert-level support, system administration, and data management across platforms such as Microsoft Dynamics, SQL Server, Visual Studio, Power Bi, Metabase and associated tools. In addition to Finance systems expertise, this role provides general IT function, contributing to the stability … ensuring smooth operation and timely issue resolution. Support and administer Microsoft Dynamics, Evision and related financial applications. Develop and maintain SQL scripts, queries, and reports to support Finance data analysis and system integrations. Manage data pipelines and transformations using DBT and other tools to ensure data accuracy and integrity. Maintain and optimise Metabase dashboards … reports) Proficient in SQL for query writing, data manipulation, and reporting. Working knowledge of Metabase and Power BI. Experience with DBT for data transformation and pipeline management. Excellent troubleshooting, communication, and documentation skills. Desirable: Exposure to ERP or finance system integrations and data warehousing concepts. Experience supporting or developing APIs or data More ❯

Areti is currently seeking five Senior Data Scientists/Analysts to join one of the UK’s fastest-growing Series A-funded tech startups based in London . This is an exciting opportunity to be part of a dynamic, mission-driven company working on high-impact Defence and Government projects. Extensive training provided – including Palantir – making this a … career-defining role . 🌳🌳🌳 The Role: You will work within a tight-knit, agile team tackling real-world problems using cutting-edge data science and engineering techniques. Key Responsibilities: Develop and deploy machine learning models Solve complex data problems in a big data environment Build scalable data pipelines and APIs Ideal Candidate … Will Have: Previous experience as a Data Scientist or Data Engineer Strong command of Python (including libraries such as scikit-learn, NumPy, matplotlib) Experience in deep learning frameworks such as TensorFlow or PyTorch Knowledge of SQL and relational databases; experience with Big Data environments Familiarity with API development and NoSQL databases Understanding of CI More ❯

Areti is currently seeking five Senior Data Scientists/Analysts to join one of the UK’s fastest-growing Series A-funded tech startups based in London . This is an exciting opportunity to be part of a dynamic, mission-driven company working on high-impact Defence and Government projects. Extensive training provided – including Palantir – making this a … career-defining role . 🌳🌳🌳 The Role: You will work within a tight-knit, agile team tackling real-world problems using cutting-edge data science and engineering techniques. Key Responsibilities: Develop and deploy machine learning models Solve complex data problems in a big data environment Build scalable data pipelines and APIs Ideal Candidate … Will Have: Previous experience as a Data Scientist or Data Engineer Strong command of Python (including libraries such as scikit-learn, NumPy, matplotlib) Experience in deep learning frameworks such as TensorFlow or PyTorch Knowledge of SQL and relational databases; experience with Big Data environments Familiarity with API development and NoSQL databases Understanding of CI More ❯

At Flexera, the TI Platform is transforming into a leading, data-driven ecosystem that empowers customers and partners through innovative, usage-based solutions. Our mission is to deliver unparalleled value by leveraging advanced data strategies and AI/ML capabilities, focusing on IT asset management. We are seeking a visionary Principal Product Manager to shape and … execute our data and AI/ML strategy, driving the platform’s 2026 objectives. Role Overview The Principal Product Manager, Data and AI/ML Strategy, will lead the development and execution of the TI Platform’s data strategy and AI/ML initiatives. This role will define how data drives value … with cross-functional teams, including engineering, marketing, and GTM functions, you will prioritize investments and ensure the platform delivers differentiated, scalable solutions for customer use cases. Responsibilities Define Data Strategy : Develop and refine a comprehensive data strategy that supports usage-based pricing, cost alignment, data correlation, aligning with 2026 objectives. Lead AI/ML More ❯

Software Engineer – Python/Data/Cloud (Mid-Level) London OR Manchester (hybrid) Salary £50k-80k We’re looking for a Mid-Level Software Engineer to join a high-performing squad building large-scale, data-intensive systems primarily in Python . You’ll work on distributed data pipelines that process hundreds of millions to … billions of rows , contributing to backend development, data engineering workflows, and system performance. You’ll collaborate closely with senior engineers and an Engineering Manager. The product itself is an AI/ML driven SaaS platform and your contributions will train new models, enabling new features and have large greenfield elements to it. What You’ll Be Working On … Build and maintain backend services and data processing components in Python . Work on large-scale data pipelines operating over huge datasets (hundreds of millions to billions of records). Write performant SQL for data transformations, ETL workflows, and analytical use cases. Contribute to discussions on architecture and design, focusing on scalability, cost, reliability More ❯

Software Engineer – Python/Data/Cloud (Mid-Level) London OR Manchester (hybrid) Salary £50k-80k We’re looking for a Mid-Level Software Engineer to join a high-performing squad building large-scale, data-intensive systems primarily in Python . You’ll work on distributed data pipelines that process hundreds of millions to … billions of rows , contributing to backend development, data engineering workflows, and system performance. You’ll collaborate closely with senior engineers and an Engineering Manager. The product itself is an AI/ML driven SaaS platform and your contributions will train new models, enabling new features and have large greenfield elements to it. What You’ll Be Working On … Build and maintain backend services and data processing components in Python . Work on large-scale data pipelines operating over huge datasets (hundreds of millions to billions of records). Write performant SQL for data transformations, ETL workflows, and analytical use cases. Contribute to discussions on architecture and design, focusing on scalability, cost, reliability More ❯

Senior Data Engineer Location: Trowbridge (Hybrid, 2 days in office) Salary: £70,000 Be part of a forward-thinking data and analytics team shaping the future of our client's operations across the UK, Ireland, and North America. This is a fantastic opportunity to lead data infrastructure projects, including a major cloud migration to … Azure, and support strategic analytics initiatives for both B2C and B2B businesses. Key Responsibilities: Manage and optimize cloud-based data infrastructure (Azure). Lead the migration of data environments to Azure. Maintain high-quality, secure data pipelines with a strong focus on governance. Mentor and support a Data Engineer apprentice. Collaborate across … teams to enhance reporting, analytics, and business intelligence solutions. What You Bring: 5+ years of experience in SQL production environments and data engineering. Strong expertise in SQL, T-SQL, Azure, DataBricks, and SSIS. Experience with data integration, modeling, and performance optimization. Problem-solving mindset and a collaborative approach. Desirable: Experience handling data from APIs More ❯

Analytics Engineer - London - Hybrid - Up to £85,000 My client are looking for an experienced Analytics Engineer to help shape, scale, and optimise their data platform. In this role, you’ll design and maintain modern data warehouse architecture using the Medallion (Bronze/Silver/Gold) model, build high-quality transformation pipelines, and deliver governed, reliable … times per week in London office) 25 days annual leave plus bank holidays And many more Role and Responsibilities Design and maintain a scalable, modular Medallion-layered data warehouse in BigQuery. Build, test, document, and deploy dbt/dataform models with clean, reusable SQL transformations. Orchestrate and monitor data pipelines to ensure quality, reliability, and timely … delivery. Integrate and maintain data quality checks, observability, cataloguing, and lineage. Drive strong CI/CD practices (e.g., GitHub Actions) for seamless testing, review, and deployment. Assist analysts with insight-driven Tableau dashboards in collaboration with business stakeholders. Support broader data governance and contribute to a trusted analytics environment. Work cross-functionally with engineers, analysts, and More ❯

Analytics Engineer - London - Hybrid - Up to £85,000 My client are looking for an experienced Analytics Engineer to help shape, scale, and optimise their data platform. In this role, you’ll design and maintain modern data warehouse architecture using the Medallion (Bronze/Silver/Gold) model, build high-quality transformation pipelines, and deliver governed, reliable … times per week in London office) 25 days annual leave plus bank holidays And many more Role and Responsibilities Design and maintain a scalable, modular Medallion-layered data warehouse in BigQuery. Build, test, document, and deploy dbt/dataform models with clean, reusable SQL transformations. Orchestrate and monitor data pipelines to ensure quality, reliability, and timely … delivery. Integrate and maintain data quality checks, observability, cataloguing, and lineage. Drive strong CI/CD practices (e.g., GitHub Actions) for seamless testing, review, and deployment. Assist analysts with insight-driven Tableau dashboards in collaboration with business stakeholders. Support broader data governance and contribute to a trusted analytics environment. Work cross-functionally with engineers, analysts, and More ❯

Data Engineer | On-site | West Midlands | £50,000–£70,000 | DV Clearance Required We are looking for multiple Data Engineers to join a growing technical team, working on complex data-driven projects that make a real difference. You’ll be part of a close-knit engineering function helping to design, build, and maintain robust … data pipelines and applications that deliver value from day one. What you’ll be doing: Designing and developing bespoke end-to-end data projects Building and maintaining efficient data pipelines Working closely with data scientists, analysts, and engineers to ensure seamless data integration Supporting front-end application development and API … mitigating potential issues to ensure system reliability What we’re looking for: Strong Python skills (or similar programming experience) Solid understanding of relational databases Awareness of APIs and data integration techniques Experience working with diverse stakeholders to capture and refine requirements Exposure to front-end application design and implementation You’ll need: DV clearance (Developed Vetting) or the More ❯

Senior Data Engineer (SQL BigQuery GCP) London/WFH to £110,000 Are you a data technologist with Media Streaming experience? You could be progressing your career in a senor, hands-on role at one of Europe's most successful streaming and social media platforms. What's in it for you: Salary to £110k Employee stock … time if desired (x1 month in London) A sociable office environment with free snacks, drinks and lunch if you are in the office Your role: As a Senior Data Engineer you'll design, build and maintain high-performance services for content modelling, serving and integration, develop data pipelines (both batch and streaming) using cloud native tools … and collaborate on rearchitecting the content model to support rich metadata. You'll also build and implement APIs and data services to expose the data to other teams across the business and work with IaC (Terraform) and CI/CD pipelines for deployment and automation. Location/WFH: You'll be able to work from home More ❯