651 to 675 of 1,010 Data Pipeline Jobs in England

and cloud deployment. Key Experience: Develop Python code for backend logic, automation, and machine learning model integration. Design and maintain robust APIs, optimising data pipelines for ML tasks. Collaborate on the setup and maintenance of CI/CD pipelines, Docker containerisation, and cloud deployment. Key Skills: 5+ years More ❯

Lead Data Engineer - London/Hybrid (3days per week onsite) - Up £120K + 10% Bonus TogetherWeTech is hiring a Lead Data Engineer for our exciting iGaming scale-up. As a Lead Data Engineer, you'll be an integral hire in the company's transition … to bringing all its tech in-house. This means, becoming their first-ever Lead Data Engineer, designing and building robust, scalable, and high-performance real-time data. Key Benefits: 10% Bonus Private Health Insurance Personal development training budget Quarterly rewards Annual trips for company conferences Key Requirements & Responsibilities … Design, develop, and optimise real-time data pipelines and infrastructure. Build efficient data models for real-time analytics. Proven experience in managing real-time data pipelines across multiple initiatives. Expertise in distributed streaming platforms (Kafka, Spark Streaming, Flink). Experience with GCP (preferred), AWS More ❯

Lead Data Engineer - London/Hybrid (3days per week onsite) - Up £120K + 10% Bonus TogetherWeTech is hiring a Lead Data Engineer for our exciting iGaming scale-up. As a Lead Data Engineer, you'll be an integral hire in the company's transition … to bringing all its tech in-house. This means, becoming their first-ever Lead Data Engineer, designing and building robust, scalable, and high-performance real-time data. Key Benefits: 10% Bonus Private Health Insurance Personal development training budget Quarterly rewards Annual trips for company conferences Key Requirements & Responsibilities … Design, develop, and optimise real-time data pipelines and infrastructure. Build efficient data models for real-time analytics. Proven experience in managing real-time data pipelines across multiple initiatives. Expertise in distributed streaming platforms (Kafka, Spark Streaming, Flink). Experience with GCP (preferred), AWS More ❯

We are looking for a Data Engineer to help us build structured, high-quality data solutions for our Content Understanding teams. Our teams process petabytes of data using tools such as BigQuery and Dataflow, and where needed we develop our own data … tooling to support and evolve our music catalog. Location London Job type Permanent What You'll Do Take ownership over, maintain and improve data pipelines that are integral to our success Evaluate and optimize our offerings for efficiency and reliability at scale Identify areas of architectural improvement to … remove the potential for human error Collaborate with product and engineering teams to understand data requirements and create innovative solutions to challenging problems Understand the analytics data we collect from our systems and how it relates to the business value being produced Who You Are Proven More ❯

seamless human-AI interaction. Build and deploy open-source models in cloud environments, optimizing inference and serving costs. Improve and maintain data pipeline reliability and participate in on-call rotations. Debug and fix issues in ML pipelines, even when the cause is obscure. Collaborate with cross-functional … Optimize prompts, refine model outputs, and experiment with novel prompting strategies. Implement backend endpoints to bridge AI capabilities into our production stack. Label data and refine model training workflows. Hire and manage part-time annotators to improve data quality. Create quick prototypes using Dash/Streamlit … GCP is a big plus. DevOps experience is a big plus. Prompt engineering expertise and creative problem-solving mindset. Experience with processing multimodal data (text, images, audio) is a plus. Perks and Benefits: Fully Remote: Work from anywhere with flexible hours. In-person Meetups and regular team-building More ❯

You will need to login before you can apply for a job. View more categories View less categories Sector Data Science Role Senior Executive Contract Type Permanent Hours Full Time Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it … can transform enterprise operations? Do you possess strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Are you eager to work in a dynamic, fast-growing category? If yes, you might be the ideal candidate for the Data and Analytics role in Global … agenda requires scalable digitization, thought leadership, decision-making, technical expertise, and the ability to navigate complex challenges while leading a team of top data and analytics professionals. With Digital First, PN is adopting a product-based model to develop business-facing digital capabilities. The role involves developing and More ❯

Octopus Energy, a leading force in the energy sector, is seeking a Data Engineer to join their Energy Markets team. This role sits at the intersection of energy trading, forecasting, and technological innovation, supporting the company's mission towards Net Zero transition. The position offers a unique opportunity … operational and reporting pipelines across regions Maintain critical data pipelines supporting trading, forecasting, risk and PPA processes Develop automations and alerts for pipeline monitoring Set up and maintain processes for capturing, preparing and loading data into the data lake Design and build operational … Engineer Strong aptitude with SQL, Python and Airflow Experience in Kubernetes, Docker, Django, Spark and related monitoring tools Experience with dbt for pipeline modelling Ability to shape needs into requirements and design scalable solutions Quick understanding of new domain areas and data visualization Team player More ❯

pipelines. This person will possess a strong background in DevOps practices, machine learning principles, and cloud computing platforms. You will work closely with data scientists and software engineers to streamline the deployment and monitoring of machine learning models, ensuring efficiency and reliability in ML operations. We hire based … with version control systems (e.g., Git). • Familiarity with CI/CD tools and practices. • Strong problem-solving and analytical skills. • Understanding of data structures and algorithms. • Ability to design and develop scalable, efficient, and maintainable software systems. • Experience with microservice architecture, API development. Machine Learning (ML): • Deep … machine learning principles, algorithms, and techniques. • Experience with popular ML frameworks and libraries like TensorFlow, PyTorch, scikit-learn, or Apache Spark. • Proficiency in data preprocessing, feature engineering, and model evaluation. • Knowledge of ML model deployment and serving strategies, including containerization and microservices. • Familiarity with ML lifecycle management, including More ❯

DATA ENGINEER LONDON BASED £75,000-95,000 PER ANNUM This growing e-commerce trading company are searching for a new Data Engineer. You will be responsible for building and maintaining a new AWS serverless platform. You will also be responsible for building and maintaining data pipelines, using Python. THE COMPANY This E-commerce trading company have been growing since their formation. They are expanding their Data and Analytics team as the CEO has realised how important Data and Technology are to the business and is investing further in Machine … Learning variables. THE ROLE You will be joining an expanding Data and Analytics team, which currently has more than 20 employees. You will be responsible for building and maintaining a new AWS serverless data platform. Improve best coding practices within the Business. Stream real-time Data More ❯

delighted to be supporting a well-known business in Manchester on an exclusive basis. We're searching for a Solutions Architect with a Data background, that wants to be part of an exciting transformation journey. Solution Architect duties: Gaining in-depth knowledge of existing business legacy systems and … systems with built-in security to comply with regulatory requirements and company standards. Assessing and prioritising business needs and new requirements within the data architecture strategy to support evolving reporting and analytics. Driving innovation by leading solution development and facilitating technical workshops to align on architecture and design. … Defining and managing relationships between data sources while overseeing the impact of future or proposed changes. As a Solutions Architect you will have: 7+ years of experience migrating systems and data platforms from on-premises data centres to public cloud environments (Azure preferred but More ❯

together individuals with Mathematics, Physics and Computer Science backgrounds who are passionate about applying rigorous scientific methods to financial challenges. As a fundamentally data-driven business, our success is heavily linked to the acquisition, processing, and analysis of vast datasets. High-quality, well-managed data forms … the critical foundation for our quantitative research, strategy development, and automated trading systems. As a Data Engineer within our Quantitative Platform team, you will play a pivotal role in building and maintaining the data infrastructure that fuels our research and trading strategies. You will be responsible … diverse datasets - including market, fundamental, and alternative sources - ensuring their timely acquisition, rigorous cleaning and validation, efficient storage, and reliable delivery through robust data pipelines. Working closely with quantitative researchers and technologists, you will tackle complex challenges in data quality, normalization, and accessibility, ultimately providing the More ❯

pipelines. This person will possess a strong background in DevOps practices, machine learning principles, and cloud computing platforms. You will work closely with data scientists and software engineers to streamline the deployment and monitoring of machine learning models, ensuring efficiency and reliability in ML operations. We hire based … with version control systems (e.g., Git). Familiarity with CI/CD tools and practices. Strong problem-solving and analytical skills. Understanding of data structures and algorithms. Ability to design and develop scalable, efficient, and maintainable software systems. Experience with microservice architecture, API development. Machine Learning (ML): Deep … machine learning principles, algorithms, and techniques. Experience with popular ML frameworks and libraries like TensorFlow, PyTorch, scikit-learn, or Apache Spark. Proficiency in data preprocessing, feature engineering, and model evaluation. Knowledge of ML model deployment and serving strategies, including containerization and microservices. Familiarity with ML lifecycle management, including More ❯

Data Analyst 📍 West London (3 days a week on-site) 💸 £55,000 - £60,000 About the Company A leading name in the UK property sector is on the hunt for a mid-level Data Analyst to join their growing data team. With a strong … foundation in Business Intelligence and a forward-thinking approach to tech, this company has spent the last five years investing heavily in their data infrastructure and are now gearing up to take things even further - including AI implementation over the next 6-12 months. 🚀 They're working on … internal data projects with real commercial impact and are looking for someone who can not only crunch the numbers, but also tell the story behind them. The Role You'll take the lead on key analytics initiatives, working end-to-end across data pipelines, visualisation, and More ❯

Contract Opportunity: Senior AWS Machine Learning Data Engineer Location: London | Duration: 6 Months (Extension Possible) | Start Date: ASAP Rate: Up to £600 a day (Inisde IR35) Are you a cloud-native data engineer with a passion for building intelligent systems? I'm looking for a Senior … AWS Machine Learning Data Engineer to a cutting-edge team on a contract basis, working on high-impact ML solutions that scale. About the Role: In this role, you'll lead the design and implementation of data pipelines and ML infrastructure on AWS. You'll collaborate … with data scientists, architects, and product teams to deliver production-grade ML systems across a variety of domains — from predictive analytics to real-time personalization. ? What You'll Do: Architect and build scalable, secure, and maintainable data pipelines on AWS (Glue, Lambda, Step Functions, S3, Redshift More ❯

Data Engineering Manager £70,000 - £80,000 Hybrid - 2x per week in Portsmouth/London We are representing a large company operating across Scotland and the south of England, that concentrates on the maintenance and upgrade of critical infrastructure to ensure reliable energy supply. They are looking for … an Data Engineering Manager to head up their successful, dynamic team. As the Data Engineering Manager, you will own the data engineering strategy and roadmap, design and architect data pipelines, and manage and optimise the data platform. You will lead … alongside individuals from a 3rd party. We are looking for: Proven experience in managing teams, providing technical guidance and coaching Experience developing the Data strategy, vision, and control budgets Experience with AWS, SQL, and Python If this sounds of interest, please apply today More ❯

Data Engineering Manager £70,000 - £80,000 Hybrid - 2x per week in Portsmouth/London We are representing a large company operating across Scotland and the south of England, that concentrates on the maintenance and upgrade of critical infrastructure to ensure reliable energy supply. They are looking for … an Data Engineering Manager to head up their successful, dynamic team. As the Data Engineering Manager, you will own the data engineering strategy and roadmap, design and architect data pipelines, and manage and optimise the data platform. You will lead … alongside individuals from a 3rd party. We are looking for: Proven experience in managing teams, providing technical guidance and coaching Experience developing the Data strategy, vision, and control budgets Experience with AWS, SQL, and Python If this sounds of interest, please apply today More ❯

Data Engineer Term: Full-time, Permanent Location: High Wycombe with hybrid remote working available Salary: £50000 - £65000 pa depending on experience + excellent benefits Focusrite are looking for an experienced data engineer to join our business intelligence team. You'll help us build and maintain a … robust yet flexible data stack, delivering high quality information where it's needed (and keeping it secure where it's not!). We make extensive use of SQL, dbt, Snowflake and Power BI, as well as various other tools. We work closely together using pair programming, peer review … to learn new things, independently and from each other. We are looking for someone who: Is an SQL expert, able to quickly identify data issues with a pithy query. Has opinions about permissions, schemas, APIs and models, and can share them collaboratively. Knows how to structure, profile and More ❯

Join a leading force in the music industry, empowering artists at every stage of their careers. We're looking for a Lead Data Engineer to spearhead the development and optimisation of our cutting-edge Analytic Data Platform (ADP). You’ll design scalable data solutions, lead a talented team of engineers, and collaborate across tech and business teams to deliver impactful data products. Your work will directly support strategic decision-making and innovation across the company. What you’ll do: Architect and build efficient, reliable data pipelines and … products. Lead and mentor a growing data engineering team. Collaborate with DevOps, QA, IT Ops, analysts, and business experts. Champion best practices in data design, development, and cloud architecture. Stay on top of the latest tools and trends, especially in AWS and open-source data More ❯

products including e-liquids, vape kits, accessories, and CBD items. As the business continues to grow, they’re now looking to add a Data Analyst to their expanding team in North London. As a Data Analyst, the main goal is to turn data into … actionable insights that support strategic, data-driven decisions. This involves gathering, cleaning, analysing, and interpreting data to uncover trends and patterns that drive improved business performance and revenue growth. In this role: You will… Collect, clean, and analyse data from multiple sources to support … strategic decision-making Automate workflows and build efficient data pipelines to improve data collection and processing Identify trends and insights through data analysis, surveys, and competitor research Collaborate with stakeholders to define KPIs and track performance through dashboards and visual reports Ensure data More ❯

and cloud deployment. Key Experience: Develop Python code for backend logic, automation, and machine learning model integration. Design and maintain robust APIs, optimising data pipelines for ML tasks. Collaborate on the setup and maintenance of CI/CD pipelines, Docker containerisation, and cloud deployment. Key Skills: 5+ years More ❯

Conduct independent research to identify opportunities and inefficiencies in financial markets. Create portfolio optimisation tools and risk management models. Maintain and improve codebases, data pipelines, and database integrations. Enhance automation of processes and integrate AI-driven solutions where applicable. Collaborate with IT and investment teams to optimise internal More ❯

Conduct independent research to identify opportunities and inefficiencies in financial markets. Create portfolio optimisation tools and risk management models. Maintain and improve codebases, data pipelines, and database integrations. Enhance automation of processes and integrate AI-driven solutions where applicable. Collaborate with IT and investment teams to optimise internal More ❯

Role: Azure Data Engineer HYBRID WORKING: 1-2 Days in Burton upon Trent Salary: £55,000 - £66,000 (dependent on experience) Insight into the Company: This market leading hospitality company are looking to bring in an Azure Data Engineer, to sit in support their Data … will have used ADF extensively and have expertise with Azure tools. The project you would be involved in will focus on bringing the data in source systems onto Azure Data Lake, in addition to liaising with Data Scientists with their ML and AI work … no experience needed but would be great to have). Role and Responsibilities: You will design, build and upgrade data pipelines You will work in CI/CD and with Software/DevOps teams in the organisation You will have expertise in azure – from collecting, to transforming to More ❯

Role: Senior Product Manager (Data Foundations) Location: London (2-3 days per week in our Holborn office) Employment Type: Full-time, as an employee Prosapient is a global Expert Network firm. We provide clients with rapid access to high-quality, relevant expert insights through a combination of world … and most successful female co-founded businesses. At proSapient, we’re building the foundations of next-generation expert intelligence. As we grow our data capabilities, we’re looking for a data-savvy product leader to shape how proprietary and third-party data powers our … platform. From driving integrations to building scalable pipelines, you’ll play a central role in turning raw data into meaningful, actionable insights that enable faster, smarter decisions for our users. The key focus of the role includes: · Owning our data foundations product domain end-to-end More ❯

Role: Senior Product Manager (Data Foundations) Location: London (2-3 days per week in our Holborn office) Employment Type: Full-time, as an employee Prosapient is a global Expert Network firm. We provide clients with rapid access to high-quality, relevant expert insights through a combination of world … and most successful female co-founded businesses. At proSapient, we’re building the foundations of next-generation expert intelligence. As we grow our data capabilities, we’re looking for a data-savvy product leader to shape how proprietary and third-party data powers our … platform. From driving integrations to building scalable pipelines, you’ll play a central role in turning raw data into meaningful, actionable insights that enable faster, smarter decisions for our users. The key focus of the role includes: · Owning our data foundations product domain end-to-end More ❯