226 to 250 of 728 Data Pipeline Jobs in the UK

remote Benefits: Healthcare and great holidays The Role As a Machine Learning Operations Engineer, you will be instrumental in designing, deploying, and maintaining machine learning systems that drive data-driven decision-making in the pensions and financial services sector. Using Azure's cloud ecosystem, you will build scalable ML workflows that support actuarial modelling, risk prediction, and client … classification, regression, ensemble methods, survival models) to improve predictions and automate core processes. 2. MLOps & Model Lifecycle Management * Own the end-to-end ML lifecycle using Azure ML pipelines, Data Factory (ADF), and ML tracking tools.* Implement CI/CD pipelines with Azure DevOps, ensuring robust version control, testing, and seamless deployment.* Monitor production ML systems for performance … data drift, and anomalies using Azure Monitor or other observability tools.* Schedule and automate model retraining pipelines to maintain performance over time. 3. Data Engineering & Preprocessing * Develop and maintain scalable ETL/ELT data pipelines using Azure Data Factory, Data Lake, and SQL.* Prepare and preprocess large datasets to ensure More ❯

About BMLL We are the leading independent provider of harmonised Level 3 historical data and analytics to the world's most sophisticated capital market participants. BMLL offers banks, brokers, asset managers, hedge funds and global exchange groups immediate and flexible access to the most granular Level 3, T+1 order book data and advanced analytics, enabling them … working, weekly team lunches and plenty of office snacks! For more information, please visit our website, or visit our or About the Role: At BMLL we process financial data in a process we call parsing. We continually add new … financial datasets to our platform whilst upgrading and improving existing ones. Parsing occurs in well defined data pipelines built using a distributed architecture. The engineering of the pipeline is as important as the data transformation process, and we are constantly working to improve its performance and reliability. We curate the data to ensure More ❯

Job Title : Data Engineer - Snowflake | DBT | SQL £700/day (Umbrella) London - 3 days per week on-site 6 months (Initial Contract) Are you ready to play a key role in shaping the future of a high-impact enterprise data platform? Join a fast-growing data team working on a greenfield data warehousing project at one of the world's most respected financial institutions. This is an opportunity to work on cutting-edge data infrastructure using Snowflake, DBT, and Sigma, supporting business-critical data needs and enabling meaningful insights at scale. You'll be part of a collaborative team split across London and Ireland, contributing to … a platform that directly supports secure, scalable data sharing and real-time decision-making. What You'll Be Doing : Model and build robust, scalable data pipelines and warehouse structures using Snowflake and DBT Collaborate with stakeholders to ensure data solutions meet customer and business needs Develop and optimise data models to support More ❯

Job Title : Data Engineer - Snowflake | DBT | SQL £700/day (Umbrella) London - 3 days per week on-site 6 months (Initial Contract) Are you ready to play a key role in shaping the future of a high-impact enterprise data platform? Join a fast-growing data team working on a greenfield data warehousing project at one of the world's most respected financial institutions. This is an opportunity to work on cutting-edge data infrastructure using Snowflake, DBT, and Sigma, supporting business-critical data needs and enabling meaningful insights at scale. You'll be part of a collaborative team split across London and Ireland, contributing to … a platform that directly supports secure, scalable data sharing and real-time decision-making. What You'll Be Doing : Model and build robust, scalable data pipelines and warehouse structures using Snowflake and DBT Collaborate with stakeholders to ensure data solutions meet customer and business needs Develop and optimise data models to support More ❯

This is an exciting contract opportunity for an SC Cleared Azure Data Engineer with a strong focus on Databricks to join an experienced team in a new customer engagement working at the forefront of data analytics and AI. This role offers the chance to take a key role in the design and delivery of advanced Databricks … solutions within the Azure ecosystem. Responsibilities: Design, build, and optimise end-to-end data pipelines using Azure Databricks, including Delta Live Tables. Collaborate with stakeholders to define technical requirements and propose Databricks-based solutions. Drive best practices for data engineering. Help clients realise the potential of data science, machine learning, and scaled data … support their personal development. Take ownership for the delivery of core solution components. Support with planning, requirements refinements, and work estimation. Skills & Experiences: Proven experience designing and implementing data solutions in Azure using Databricks as a core platform. Hands-on expertise in Delta Lake, Delta Live Tables and Databricks Workflows. Strong coding skills in Python and SQL, with More ❯

Senior Data Engineer London, UK About the Role We're looking for a Senior Data Engineer to lead the design and delivery of modern, cloud-based data solutions. You'll play a key role in transforming enterprise data platforms, enabling global data alignment, and driving business value through scalable architecture … and advanced analytics. Key Responsibilities Design and implement end-to-end data pipelines using Azure and Databricks. Modernize legacy data warehouses and unify data across global regions. Optimize performance, cost, and scalability of data platforms. Mentor junior engineers and promote best practices. Collaborate with cross-functional teams to translate business needs into … technical solutions. Core Skills Cloud & Platforms : Azure, AWS, SAP Data Engineering : ELT, Data Modeling, Integration, Processing Tech Stack : Databricks (PySpark, Unity Catalog, DLT, Streaming), ADF, SQL, Python, Qlik DevOps : GitHub Actions, Azure DevOps, CI/CD pipelines Please click here to find out more about our Key Information Documents. Please note that the documents provided contain More ❯

Senior Data Engineer London, UK About the Role We're looking for a Senior Data Engineer to lead the design and delivery of modern, cloud-based data solutions. You'll play a key role in transforming enterprise data platforms, enabling global data alignment, and driving business value through scalable architecture … and advanced analytics. Key Responsibilities Design and implement end-to-end data pipelines using Azure and Databricks. Modernize legacy data warehouses and unify data across global regions. Optimize performance, cost, and scalability of data platforms. Mentor junior engineers and promote best practices. Collaborate with cross-functional teams to translate business needs into … technical solutions. Core Skills Cloud & Platforms : Azure, AWS, SAP Data Engineering : ELT, Data Modeling, Integration, Processing Tech Stack : Databricks (PySpark, Unity Catalog, DLT, Streaming), ADF, SQL, Python, Qlik DevOps : GitHub Actions, Azure DevOps, CI/CD pipelines Please click here to find out more about our Key Information Documents. Please note that the documents provided contain More ❯

Senior Data Engineer London, UK About the Role We're looking for a Senior Data Engineer to lead the design and delivery of modern, cloud-based data solutions. You'll play a key role in transforming enterprise data platforms, enabling global data alignment, and driving business value through scalable architecture … and advanced analytics. Key Responsibilities Design and implement end-to-end data pipelines using Azure and Databricks. Modernize legacy data warehouses and unify data across global regions. Optimize performance, cost, and scalability of data platforms. Mentor junior engineers and promote best practices. Collaborate with cross-functional teams to translate business needs into … technical solutions. Core Skills Cloud & Platforms : Azure, AWS, SAP Data Engineering : ELT, Data Modeling, Integration, Processing Tech Stack : Databricks (PySpark, Unity Catalog, DLT, Streaming), ADF, SQL, Python, Qlik DevOps : GitHub Actions, Azure DevOps, CI/CD pipelines Please click here to find out more about our Key Information Documents. Please note that the documents provided contain More ❯

DATA ENGINEER/MANCHESTER/HYBRID/£60,000 - £67,000 PLUS BENEFITS WEX Europe Services Ltd are the owner of the Esso Card Fuel Card Portfolio, and with offices across Europe and the US are one of the Europe’s largest providers of fuel cards. As a Data Engineer at WEX, you’ll be responsible … for building and maintaining the bridge between our data and the rest of the organization. You’ll work with stakeholders to understand business requirements and then implement SQL-first transformation workflows to deploy analytics code. You’ll help ensure the integrity, reliability, and usability of data for stakeholders, so they can make critical data … are a critical thinker with strong analytical and problem-solving abilities. You are self-motivated and able to work independently with minimum supervision. We are seeking an experienced Data Engineer to play a critical role in the development of WEX's data & analytics capabilities. You will be part of an organization focusing on the development and More ❯

DATA ENGINEER/MANCHESTER/HYBRID/£60,000 - £67,000 PLUS BENEFITS WEX Europe Services Ltd are the owner of the Esso Card Fuel Card Portfolio, and with offices across Europe and the US are one of the Europe’s largest providers of fuel cards. As a Data Engineer at WEX, you’ll be responsible … for building and maintaining the bridge between our data and the rest of the organization. You’ll work with stakeholders to understand business requirements and then implement SQL-first transformation workflows to deploy analytics code. You’ll help ensure the integrity, reliability, and usability of data for stakeholders, so they can make critical data … are a critical thinker with strong analytical and problem-solving abilities. You are self-motivated and able to work independently with minimum supervision. We are seeking an experienced Data Engineer to play a critical role in the development of WEX's data & analytics capabilities. You will be part of an organization focusing on the development and More ❯

Devonshire Hayes have partnered with a fantastic organisation to help them secure a dynamic and hands-on Engineering Manager across Data & AI. You will have experience - - Leading, managing, building and scaling data teams in a SaaS, RegTech or technology driven environment. - Hands-on expertise in modern data engineering practices, cloud data platform and full data lifecycle. - Strong programming skills would be ideal for this position, languages such as Python, Java or Scala with Data pipeline frameworks and cloud infrastructure (AWS or Azure). - A proven track record of delivering innovative, data driven products from concept to production, ideally in a regulated industry. … Deep understanding of data governance, security, privacy standards especially within a B2B or regulated context. Working arrangement: 4 days in the office/1 day from home . More ❯

Devonshire Hayes have partnered with a fantastic organisation to help them secure a dynamic and hands-on Engineering Manager across Data & AI. You will have experience - - Leading, managing, building and scaling data teams in a SaaS, RegTech, or technology driven environment. - Hands-on expertise in modern data engineering practices, cloud data platform and full data lifecycle. - Strong programming skills would be ideal for this position, languages such as Python, Java or Scala with Data pipeline frameworks and cloud infrastructure (AWS or Azure). - A proven track record of delivering innovative, data driven products from concept to production, ideally in a regulated industry. … Deep understanding of data governance, security, privacy standards especially within a B2B or regulated context. Working arrangement: 4 days in the office/1 day from home . More ❯

Devonshire Hayes have partnered with a fantastic organisation to help them secure a dynamic and hands-on Engineering Manager across Data & AI. You will have experience - - Leading, managing, building and scaling data teams in a SaaS, RegTech or technology driven environment. - Hands-on expertise in modern data engineering practices, cloud data platform and full data lifecycle. - Strong programming skills would be ideal for this position, languages such as Python, Java or Scala with Data pipeline frameworks and cloud infrastructure (AWS or Azure). - A proven track record of delivering innovative, data driven products from concept to production, ideally in a regulated industry. … Deep understanding of data governance, security, privacy standards especially within a B2B or regulated context. Working arrangement: 4 days in the office/1 day from home . More ❯

Senior Data/Power BI Engineer West Midlands/HybridPermanent - Full Time Are you passionate about turning data into powerful insights? TXP is looking for a Senior Data/Power BI Engineer to help our clients unlock the full potential of their data. In … this role, you'll: Design and deploy Power BI models and dashboards Collaborate with stakeholders to shape intelligent analytics solutions Support data warehousing and data pipeline development Drive analytics maturity and best practices across client organisations Mentor junior team members and lead by example What you'll bring: Expertise in Power BI, DAX, and SQL … Experience with Microsoft Fabric or similar platforms Strong understanding of manufacturing processes and ERP systems A passion for data storytelling and business impact Join a consultancy that values innovation, diversity, and continuous learning. Be part of a team that's shaping the future of data-driven decision-making. Apply now and help us build smarter, data More ❯

We're looking for an experienced Azure Data & AI Engineer with a strong focus on advanced analytics, machine learning, and applied AI - particularly Generative AI. This role will suit a technically capable professional who combines real-world AI/ML solution delivery experience with a solid understanding of the Azure ecosystem. The ideal candidate will bring hands-on … Vault), and telemetry via Application Insights or Log Analytics. KEY RESPONSIBILITIES: Have 5+ years of technical consulting or a similar chronology of demonstrable success in coding and deploying Data and AI models onto Azure environments. At least one year using Azure Fabric Create scalable and reliable data pipelines for data processing, transformation, and storage. … Establish and enforce data governance policies and be 'hands-on' in exploratory data analysis to identify and measure quality gaps that are a block to Data and Ai implementation. Implement robust security measures to protect sensitive data within Azure environments. Integrate AI and machine learning models into data pipelines and More ❯

prospecting and qualification through to negotiation and deal closure. Identifying key decision-makers and internal champions within target businesses to support deal progression. Building and maintaining a strong, qualified pipeline and consistently delivering against revenue targets. Working collaboratively with the wider sales, product, and engineering teams to refine value propositions and go-to-market approaches. Delivering consultative, solution-based … sales conversations focused on operational and financial outcomes for merchants. Accurately managing Salesforce, CRM data, pipeline forecasting, and activity reporting. Requirements We'd love it if you have A proven track record in B2B sales, coupled with experience selling to mid-cap and enterprise clients - ideally within fintech, SaaS, or payments (or a similar industry focused on … about Super Payments? If applying via Otta, please provide us with your phone number here. GDPR Select When you apply to a job on this site, the personal data contained in your application will be collected by Super Payments Ltd ("Controller"), which is located at 2 Temple Back East, Temple Quay, Bristol, BS1 6EG ( and can be contacted More ❯

Intrum, Europe's biggest credit management service and have begun the next phase in our growth - expansion into 17 European markets over the next two years. The Role - Data Engineer We are looking for our first dedicated Data Engineering hire to join our small but high performing data team. You will be responsible for … ensuring the scalability and reliability of our data infrastructure to power our machine learning and analytics workloads to support the companies growth. Our data stack: We work with a modern data stack built on Databricks and AWS with python and pyspark as our primary tools. In this role, you'll get to: Own business … critical components and perform meaningful work with an impact on our company and our customers Design , implement and deliver data pipelines and infrastructure to support our machine learning and analytics products Collaborate as part of a fast paced data team and help achieve the team's goals of delivering high impact data products at More ❯

Data Analyst - 6 month contract - North London Based My global client is currently looking for a Data Analyst to join their Supply Chain Analytics team. This role will report into the Logistics Manager - Supply Chain Analytics - you will primary be responsible for working on day to day data analysis, building datasets, and a strategic … project to replace existing manual Excel reports with automated database sourced Power BI dashboards. Some of your responsibilities will be to: Identify manual data inputs and map them to appropriate fields in new or existing databases Collaborate with data engineers and/or IT to establish data pipelines that replace manual data sources. Rebuild reports using automated connections (e.g., Python, Excel Power Query, Power BI, Power Automate) linked to centralized data sources. Ensure data integrity, accuracy, and consistency across all reports during and after migration. Build and maintain automated dashboards and reports to support the day-to-day logistics operation. In order to be successful you More ❯

Software Engineer (Data & Infrastructure) London, United Kingdom At Modo Energy, we're on a mission to build the information architecture for the energy transition - we want to be the only place to come to for information on the global journey to net zero. Take a look at our platform , where we provide open access to an array of … will collaborate with us in shaping the culture of a rapidly growing team. The role We're looking for software engineers at various experience levels to join our data and infrastructure team. You will be responsible for developing new features and ensuring they are scalable, reliable, and efficient to meet future demands. This position requires a proactive approach … to adapt to a flexible, evolving environment. Some experience or desire to learn: AWS cloud services. Infrastructure as Code (Terraform) Python web frameworks (Django, FastAPI, Flask) Data pipeline development (Batch and Stream Processing) Data modeling and Data Lakehouse concepts. CI/CD pipelines. Microservices architecture. Hybrid Work Environment : This role is hybrid, with More ❯

Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: from £70,000 depending on experience Department: Technology and Data We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great value insurance with an … design, through development and testing, to deployment, production, monitoring and continuous improvement optimising cutting-edge AI solutions across the business. One day you might be collaborating with our Data Scientists, Software Engineers and Architects on a new GenAI capability. The next, you're fine-tuning prompts or experimenting with Computer Vision and Natural Language Processing (NLP). You … control, and continuous integration. Develop and maintain automated frameworks for testing, validation, and monitoring of AI model accuracy, performance, and reliability. Establish best practices for AI data pipeline development and integration with infrastructure to support scalable deployment. Collaborate closely with Data Scientists, Data Engineers, Software Developers, and Architects for seamless execution of AI More ❯

Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: from £70,000 depending on experience Department: Technology and Data We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great value insurance with an … design, through development and testing, to deployment, production, monitoring and continuous improvement optimising cutting-edge AI solutions across the business. One day you might be collaborating with our Data Scientists, Software Engineers and Architects on a new GenAI capability. The next, you're fine-tuning prompts or experimenting with Computer Vision and Natural Language Processing (NLP). You … control, and continuous integration. Develop and maintain automated frameworks for testing, validation, and monitoring of AI model accuracy, performance, and reliability. Establish best practices for AI data pipeline development and integration with infrastructure to support scalable deployment. Collaborate closely with Data Scientists, Data Engineers, Software Developers, and Architects for seamless execution of AI More ❯

Data Scientist - Property London – Hybrid Up to £65,000 About the Role A leading London-based data and technology company in the property space is looking for a Data Scientist to join their growing product-focused team. This is an exciting opportunity to work as a full stack/end to end Data Scientist, driving real business impact. You’ll collaborate closely with stakeholders to build and deploy ML models and data-driven tools that are core to the company’s commercial offerings. Key Responsibilities Identify and scope opportunities where machine learning and data science can enhance product offerings. Design and run experiments to test hypotheses and … support product development. Develop robust data pipelines to support science experimentation and production. Deploy, maintain, and monitor predictive models in live environments. Communicate findings and technical concepts clearly to both technical and non-technical audiences. Contribute to agile delivery workflows and cross-functional collaboration. What We’re Looking For Solid understanding of core data science techniques More ❯

Data Scientist - Property London – Hybrid Up to £65,000 About the Role A leading London-based data and technology company in the property space is looking for a Data Scientist to join their growing product-focused team. This is an exciting opportunity to work as a full stack/end to end Data Scientist, driving real business impact. You’ll collaborate closely with stakeholders to build and deploy ML models and data-driven tools that are core to the company’s commercial offerings. Key Responsibilities Identify and scope opportunities where machine learning and data science can enhance product offerings. Design and run experiments to test hypotheses and … support product development. Develop robust data pipelines to support science experimentation and production. Deploy, maintain, and monitor predictive models in live environments. Communicate findings and technical concepts clearly to both technical and non-technical audiences. Contribute to agile delivery workflows and cross-functional collaboration. What We’re Looking For Solid understanding of core data science techniques More ❯

We are a global media group delivering exceptional content through events, digital, data & insight. From agribusiness, ingredients and food processing, to retail, hospitality & fine dining - we provide the inspiration, insight and connections to power our customers' success. We have offices in Gatwick, Brighton and London, UK; Montpellier, France; Singapore and Chicago, US. In line with the Company's … and to work remotely for the rest of the week. Position Position: Full time - permanent Location: London/Brighton/Crawley/Hybrid We are looking for a Data Scientist to lead Lumina Intelligence's data team, providing an opportunity to shape and grow our data strategy. Lumina Intelligence is a highly ambitious and … food & drink consultancy providing insights for global markets and enabling its clients to understand their consumers, competitors, and markets in the way that facilitates growth. It provides subscription data products, maintaining the highest quality of data and continuously enhancing the way customers access and apply its insights. As the Data Science Lead, you'll More ❯

We are a global media group delivering exceptional content through events, digital, data & insight. From agribusiness, ingredients and food processing, to retail, hospitality & fine dining - we provide the inspiration, insight and connections to power our customers' success. We have offices in Gatwick, Brighton and London, UK; Montpellier, France; Singapore and Chicago, US. In line with the Company's … and to work remotely for the rest of the week. Position Position: Full time - permanent Location: London/Brighton/Crawley/Hybrid We are looking for a Data Scientist to lead Lumina Intelligence's data team, providing an opportunity to shape and grow our data strategy. Lumina Intelligence is a highly ambitious and … food & drink consultancy providing insights for global markets and enabling its clients to understand their consumers, competitors, and markets in the way that facilitates growth. It provides subscription data products, maintaining the highest quality of data and continuously enhancing the way customers access and apply its insights. As the Data Science Lead, you'll More ❯