501 to 525 of 1,001 Data Pipeline Jobs in England

Data Scientist Remote (UK-Based) Up to £45,000 The Company This UK-based start-up has grown rapidly in just two years. With a team of ~30 people, they are scaling quickly, supported by recent funding and a strong growth pipeline. They specialise in predictive analytics, tracking … KPIs for a wide range of companies and industries. Their insights empower investors to make informed decisions by providing performance data ahead of public reports. The Role As a Data Scientist, you’ll play a pivotal role in developing and refining KPI prediction models, working with … real-world data to create actionable insights. Clean and process data to ensure accuracy and usability. Build and maintain linear regression models for KPI tracking. Access APIs and integrate software tools to enhance workflows. Collaborate with the revenue team to generate insightful reports. Support internal product More ❯

Data Scientist Remote (UK-Based) Up to £45,000 The Company This UK-based start-up has grown rapidly in just two years. With a team of ~30 people, they are scaling quickly, supported by recent funding and a strong growth pipeline. They specialise in predictive analytics, tracking … KPIs for a wide range of companies and industries. Their insights empower investors to make informed decisions by providing performance data ahead of public reports. The Role As a Data Scientist, you’ll play a pivotal role in developing and refining KPI prediction models, working with … real-world data to create actionable insights. Clean and process data to ensure accuracy and usability. Build and maintain linear regression models for KPI tracking. Access APIs and integrate software tools to enhance workflows. Collaborate with the revenue team to generate insightful reports. Support internal product More ❯

Location: London, Hybrid 💰 Rate: Up to £600 per day 📆 Contract: 6 months (Outside IR35, potential to go perm) 🛠 Tech Stack: Azure Data Factory, Synapse, Databricks, Delta Lake, PySpark, Python, SQL, Event Hub, Azure ML, MLflow We’ve partnered with a new AI-first professional services consultancy that’s … a founding team of contractors with the view to scale into permanent leadership as the business grows. They’re now hiring a Senior Data Engineer to build robust, scalable data solutions powering AI, analytics, and future client delivery. If you love creating high-performance data … clean, governed data layers for ML, analytics, and application use 🔹 Supporting LLM/AI data workflows through structured and unstructured pipeline design 🔹 Contributing to reusable data engineering components across client and internal use cases 🔹 Collaborating with data scientists, architects, and product More ❯

Location: London, Hybrid 💰 Rate: Up to £600 per day 📆 Contract: 6 months (Outside IR35, potential to go perm) 🛠 Tech Stack: Azure Data Factory, Synapse, Databricks, Delta Lake, PySpark, Python, SQL, Event Hub, Azure ML, MLflow We’ve partnered with a new AI-first professional services consultancy that’s … a founding team of contractors with the view to scale into permanent leadership as the business grows. They’re now hiring a Senior Data Engineer to build robust, scalable data solutions powering AI, analytics, and future client delivery. If you love creating high-performance data … clean, governed data layers for ML, analytics, and application use 🔹 Supporting LLM/AI data workflows through structured and unstructured pipeline design 🔹 Contributing to reusable data engineering components across client and internal use cases 🔹 Collaborating with data scientists, architects, and product More ❯

A fantastic opportunity has arisen for a Data Analyst to join a business in Pocklington. In this key role, you will be responsible for capturing, analysing, and reporting data to optimise supply chain efficiency, biological asset management, and commercial decision-making. This position offers the chance … to provide valuable insights that drive business performance and strategic growth. The Role Reporting to the Head of Optimisation, the Data Analyst will generate data-driven insights to enhance performance across the business. This is an excellent opportunity for a data professional to contribute … and exciting opportunities for career development within a dynamic, forward-thinking environment. You will be involved in cutting-edge data projects that are shaping the future of food production. Key Responsibilities: Ensure accurate and timely data capture across the entire supply chain. Develop and maintain automated More ❯

Implementation Engineer Outside IR35 Remote £400-£500 3 Months Initially We are seeking an Implementation Engineer who possesses a strong foundation in data and business analysis. This role requires logical thinking and the ability to understand and interpret data. The ideal candidate will have experience configuring tools and … than extensive coding expertise. In this role, you will work primarily with the clients platform, which utilises ETL packages. A solid understanding of data analysis will significantly benefit your performance in this position. Key Responsibilities: Collaborate with clients to analyse data-driven business processes in detail … ensuring a clear understanding of the data and its implications. Document findings to prepare for implementation Configure, extend, deploy, test, and validate complete solutions for our customers from end to end. Conduct data analysis, exploration, testing, and validation while interacting with clients to comprehend data More ❯

performance, implementing improvements based on analysis. Document and standardize ML processes, pipelines, and model specifications. Collaborate with cross-functional teams spanning research, engineering, data science, product managers and other stakeholders to understand business needs and identify opportunities for ML applications. Work closely with engineering teams to integrate ML … frameworks (e.g., TensorFlow or PyTorch). Solid understanding of various machine learning algorithms (e.g., classification, regression, clustering) and their practical applications. Proficient in data manipulation and analysis using tools like SQL and Pandas. Broad ML skillset and are happy to work … on all aspects of ML problems. Not only modeling, but also feature work in data pipelines, some implementation in data pipeline workflows, experimentation setup and analysis. Experience with model evaluation metrics and techniques for ensuring model quality and generalization. Experience with cloud platforms (e.g., GCP More ❯

performance, implementing improvements based on analysis. Document and standardize ML processes, pipelines, and model specifications. Collaborate with cross-functional teams spanning research, engineering, data science, product managers and other stakeholders to understand business needs and identify opportunities for ML applications. Work closely with engineering teams to integrate ML … frameworks (e.g., TensorFlow or PyTorch). Solid understanding of various machine learning algorithms (e.g., classification, regression, clustering) and their practical applications. Proficient in data manipulation and analysis using tools like SQL and Pandas. Broad ML skillset and are happy to work … on all aspects of ML problems. Not only modeling, but also feature work in data pipelines, some implementation in data pipeline workflows, experimentation setup and analysis. Experience with model evaluation metrics and techniques for ensuring model quality and generalization. Experience with cloud platforms (e.g., GCP More ❯

re located within a commutable distance of one of our offices so that we're able to interact and collaborate in person. Our Data Environment Our Data teams are aligned to divisions covering the following Banking Services & Products, Customer Identity & Financial Crime and Data & ML Engineering. Our Data teams are excited about delivering meaningful and impactful insights to both the business and more importantly our customers. Hear from the team in our latest blogs or our case studies with Women in Tech . We are looking for talented data … problems and challenges, who can work across teams do great things here at Starling, to continue changing banking for good. Responsibilities: Analyse source data from source databases (PostgreSQL) to understand structures, relationships and semantics. Design and implement streaming data pipelines using AWS EMR and PySpark to More ❯

edge ideas, best-in-class products and solutions, and unparalleled access to capital and liquidity. What We do/The Team The FX Data Analytics & AI Technology team, within Citi's FX Technology organization, seeks a highly motivated Senior Java Data Engineer. The FX Data Analytics & Gen AI Technology team provides data, analytics, and tools to Citi FX sales and trading globally and is responsible for defining and executing the overall data strategy for FX. The successful candidate will be responsible for developing and implementing data-driven … models, and engineering robust data and analytics pipelines, to unlock actionable insights from our vast amount of global FX data. The role will be instrumental in executing the overall data strategy for FX and will benefit from close interaction with a wide range of stakeholders across More ❯

Select how often (in days) to receive an alert: VIE Data Scientist Databricks About Crown Crown Holdings, Inc. , is a world leader in the metal packaging production process. We design and manufacture a wide range of innovative and sustainable metal packaging solutions and products. Our clients are some … to our long-term future. About this opportunity Your work environment : Our European Information Systems and Services (EISS) department is looking for a Data Scientist Databricks Engineer on a VIE contract for 12-24 months based at Wantage (UK). With a good background in data engineering, you will support our IT Teams in the development and maintenance of data dashboards using Microsoft technologies (including Power BI, Azure Data Factory) and Databricks. The ideal candidate will be capable to learn or have a first experience in designing scalable data More ❯

Machine Learning Engineer, JP Science and Data Job ID: Amazon Japan G.K. - A43 We are seeking a Machine Learning Engineer to architect and implement end-to-end machine learning systems that scale across Amazon's largest vendors. In this role, your primary focus will be on combining strong … new generation of Paid Services. You will work directly with Applied Scientists to productionize ML models, Software Development Engineers to build scalable infrastructure, Data/BI Engineers to implement scalable ML-ready data pipelines, and Product Managers to drive the roadmap and vision for Paid Services. … scientists to design and develop scalable ML infrastructure that supports model training, deployment, and monitoring across hundreds of vendors. Implement efficient data pipeline and architectures that enable automated ML workflows for our eCommerce partners. Build ML debugging and analysis tools to ensure model reliability and performance. Utilizing More ❯

compute solutions to enable efficient processing and real-time interactions. Event-Driven Architecture : Build and maintain systems that facilitate scalable and real-time data processing. Efficient Workflow Management : Implement solutions to streamline complex AI processes and facilitate automation. Real-Time Communication : Enhance … communication frameworks to improve user experience across our platforms. Document Management Solutions : Develop indexing and retrieval systems for efficient document handling. Data Pipeline Creation : Design ETL pipelines to collect and process data from a variety of sources. Infrastructure Decision-Making : Advocate for architectural decisions that … ensure scalability, reliability, and cost efficiency. Support for Research Teams : Provide infrastructure and tools that empower our AI and data research initiatives. Tech Stack: Full-Stack Development : TypeScript, React, Next.js, Tailwind, Prisma Database Management : PostgreSQL, MongoDB, Redis Cloud Solutions : AWS, Google Cloud, Serverless Architectures Data Pipelines More ❯

compute solutions to enable efficient processing and real-time interactions. Event-Driven Architecture : Build and maintain systems that facilitate scalable and real-time data processing. Efficient Workflow Management : Implement solutions to streamline complex AI processes and facilitate automation. Real-Time Communication : Enhance … communication frameworks to improve user experience across our platforms. Document Management Solutions : Develop indexing and retrieval systems for efficient document handling. Data Pipeline Creation : Design ETL pipelines to collect and process data from a variety of sources. Infrastructure Decision-Making : Advocate for architectural decisions that … ensure scalability, reliability, and cost efficiency. Support for Research Teams : Provide infrastructure and tools that empower our AI and data research initiatives. Tech Stack: Full-Stack Development : TypeScript, React, Next.js, Tailwind, Prisma Database Management : PostgreSQL, MongoDB, Redis Cloud Solutions : AWS, Google Cloud, Serverless Architectures Data Pipelines More ❯

quality. With a strong focus on operational efficiency and digital transformation, we're looking for a Business Intelligence (BI) Analyst to help drive data-informed decisions across our shop floor and wider business operations. Role Overview As a BI Analyst, you will be responsible for developing, maintaining, and … optimizing data pipelines and reporting systems that deliver actionable insights to stakeholders across the business. A key part of your role will involve understanding the manufacturing process and shop floor activities in real-time, which requires full-time on-site presence and collaboration with production teams. Key Responsibilities … Design, build, and maintain data pipelines that integrate production, sales, and operational data. Develop and manage Power BI dashboards and reports tailored to shop floor and business needs. Translate raw data from systems like Navision/Business Central (Nav to BC) into meaningful insights. Support the More ❯

quality. With a strong focus on operational efficiency and digital transformation, we're looking for a Business Intelligence (BI) Analyst to help drive data-informed decisions across our shop floor and wider business operations. Role Overview As a BI Analyst, you will be responsible for developing, maintaining, and … optimizing data pipelines and reporting systems that deliver actionable insights to stakeholders across the business. A key part of your role will involve understanding the manufacturing process and shop floor activities in real-time, which requires full-time on-site presence and collaboration with production teams. Key Responsibilities … Design, build, and maintain data pipelines that integrate production, sales, and operational data. Develop and manage Power BI dashboards and reports tailored to shop floor and business needs. Translate raw data from systems like Navision/Business Central (Nav to BC) into meaningful insights. Support the More ❯

Prestigious opportunity with a Market Leading Global Retail organisation for a Senior Data Engineer to join our success story in Blackburn. Following a period of significant growth, we are expanding our team to further drive the business forward. You will be responsible for:- Designing, building and maintaining scalable … data pipelines using Python, MS SQL server and robust data pipelines to transform and store data. Managing the process of developing and implementing data models, schemas and architecture solutions. Working with stakeholders, data scientists and analysts to understand data requirements. … Providing insights into data trends and opportunities. Work on processes to improve efficiency, reduce latency and ensure high data availability. Monitoring, logging and alerting mechanisms to identify and resolve data-related issues. If you possess a combination of some of the following skills, then More ❯

exciting point in our journey, leveraging Generative AI (GenAI) , Large Language Models (LLMs) , and advanced Retrieval-Augmented Generation (RAG) techniques to build intelligent, data-driven systems that deliver powerful PR insights. You'll also work on developing agentic workflows that autonomously orchestrate tasks, enabling scalable and dynamic solutions. … Our data stack is modern and efficient, designed to process large-scale information, automate analysis pipelines, and integrate seamlessly with AI-driven workflows. This is an excellent opportunity to make a significant impact on projects that push the boundaries of AI-powered insights and automation. If you're … managed AI/ML services. Hands-on experience with Docker, Kubernetes, and container orchestration. Expertise with Databricks, including ML workflows and data pipeline management. Familiarity with tools like MLflow, DVC, Prometheus, and Grafana for versioning and monitoring. Experience implementing security and compliance standards for AI systems. Strong More ❯

Senior Data Engineer | Bristol | Permanent Full-Time | Hybrid Working Peaple Talent are pleased to be working with a returning client in Bristol looking to recruit for a Senior Data Engineer. This is a full-time permanent role, and would require hybrid working in Bristol. This Senior … growth by sharing knowledge and improving collective engineering practices. In-depth knowledge of data modelling best practices and common patterns used in pipeline architecture. Confident in version control with Git and familiar with setting up CI/CD workflows using platforms like Azure DevOps or similar tools. … Airflow for managing complex data workflows. Practical familiarity with low-code or no-code platforms such as Talend and SnapLogic for streamlined pipeline development. Strong experience working with cloud-based data services, especially within AWS environments, utilizing tools like Lambda, S3, Redshift, Glue, Athena and More ❯

is central to that mission-reinventing how users find and connect with content in new and relevant ways. We're looking for a Data Engineer to join a squad passionate about delivering pioneering search experiences powered by Machine Learning (ML) and Large Language Models (LLMs). In this … role, you'll help craft the team's data strategy and build the systems that power smarter, more intuitive discovery on Spotify. You'll work alongside a dedicated mix of ML and Backend Engineers to tackle some of Spotify's most exciting challenges in retrieval, ranking, and personalization. … If you're excited by data systems, ML-powered products, and the opportunity to impact how millions of people explore audio content-this is the role for you. What You'll Do Design, build, and maintain scalable, reliable data pipelines that support advanced search capabilities. Partner More ❯

power the training of the world's most capable AI frontier models, pushing the boundaries of scale, performance, and product deployment. The AI Data team at Microsoft AI is responsible for all aspects of data preparation to support our model pre-training operations, including collecting data from the source, extracting and transforming the most useful data, and understanding the impact of changes to data by training and evaluating new models. We are an interdisciplinary team of engineers and scientists, learning from each other, and collaborating to create the best models … next generation of systems that will transform the field. In particular, we are looking for candidates who: Are passionate about the role of data in large-scale AI model training Will thrive in a highly collaborative, fast-paced environment Have a high degree of craftsmanship and pay close More ❯

Customer Platform Data Analytics Lead Remote (with regular travel to a London-based office) Competitive Salary + Benefits Full Time | Permanent A fast-scaling, well-funded FinTech in the insurance and payments space is looking for a Customer Platform Data & Analytics Lead to head up a … growing team of talented data engineers. This is a unique opportunity to lead the embedded analytics function within a SaaS product environment, shaping architecture and best practices while remaining hands-on with complex engineering tasks. You'll join a high-performing, collaborative team at a company backed by … and you’ll have real influence as they continue to scale. What You’ll Do Lead, mentor and manage a squad of 5 data & analytics engineers. Define technical standards and drive excellence in engineering practices. Architect and oversee the development of cloud-native data infrastructure and More ❯

Customer Platform Data Analytics Lead Remote (with regular travel to a London-based office) Competitive Salary + Benefits Full Time | Permanent A fast-scaling, well-funded FinTech in the insurance and payments space is looking for a Customer Platform Data & Analytics Lead to head up a … growing team of talented data engineers. This is a unique opportunity to lead the embedded analytics function within a SaaS product environment, shaping architecture and best practices while remaining hands-on with complex engineering tasks. You'll join a high-performing, collaborative team at a company backed by … and you’ll have real influence as they continue to scale. What You’ll Do Lead, mentor and manage a squad of 5 data & analytics engineers. Define technical standards and drive excellence in engineering practices. Architect and oversee the development of cloud-native data infrastructure and More ❯

Data Engineer Azure Stack | £60,000–£70,000| Leeds – Hybrid (2 days/week) A leading professional services firm is looking for a hands-on Data Engineer to join them at a pivotal moment in their data journey. This is a unique opportunity to … own and shape the development of a modern Azure-based data platform from the ground up — replacing legacy reporting tools, consolidating business-critical data sources, and paving the way for Microsoft Fabric adoption. The organisation is mid-way through a modernisation programme. They’ve moved away … from outdated SAP BO reports and started building a scalable data foundation using Azure Synapse, ADF, and Power BI, with support from a Microsoft partner. They are now looking for someone to take ownership of the platform and guide the business through the next phase of growth. What More ❯

A leading Global Technology Consultancy in the City of London is now looking for a Lead Data Engineer to join the business on a permanent basis. The role is offering a base of £110,000 (potential flexibility) + bonus and shares. Their HQ is in the City of … London and they have adopted a hybrid working model. The ideal Lead Data Engineer will have a background from either an IT Technology provider or IT Consultancy and enjoys working with clients to solve real world data problems. In this exciting role, you'll partner with … clients to transform raw data into powerful insights, ensuring top-tier performance, reliability, and compliance with data governance standards. The Lead Data Engineer will be well versed in the latest Data Tools/Gen AI and can utilise them to delivery high More ❯