476 to 500 of 920 Data Pipeline Jobs in the UK

Azure Data Engineer - FinTech Azure Data 12-month FTC London - Remote in office 4 times in a fortnight (flexible) Salary & Benefits - Up to £75,000 + 8 to 12% Pension, Life Assurance, Health & Dental Insurance, 25+ days annual leave + other flexible benefits Azure Data factory Logic Apps Azure Batch Azure Functions Azure DevOps … I'm working with a pioneering organisation in the UK fintech landscape who are on the hunt for an experienced Azure Data Engineer to join their fast-moving Intelligent Automation Team. This isn't your average data gig. You'll be building and scaling Azure-native pipelines that power the next phase of AI-led transformation … in financial services. If you're passionate about clean architecture, impactful automation, and cutting through the noise with robust cloud data solutions - you'll thrive here. This role is a 12 month FTC and would suite someone who wants to dive into a new challenge for the next year or so. Role as an Azure Data More ❯

by providing them with cutting-edge ideas, best-in-class products and solutions, and unparalleled access to capital and liquidity. What We do/The Team The FX Data Analytics & AI Technology team, within Citi's FX Technology organization, seeks a highly motivated Senior Java Data Engineer. The FX Data Analytics & Gen AI Technology … team provides data, analytics, and tools to Citi FX sales and trading globally and is responsible for defining and executing the overall data strategy for FX. The successful candidate will be responsible for developing and implementing data-driven models, and engineering robust data and analytics pipelines, to unlock actionable insights from our … vast amount of global FX data. The role will be instrumental in executing the overall data strategy for FX and will benefit from close interaction with a wide range of stakeholders across sales, trading, and technology. We are looking for a proactive individual with a practical and pragmatic attitude, ability to build consensus, and work both collaboratively and More ❯

Location: 1 Braham Street, London, United Kingdom Available locations: Belfast, Birmingham, Glasgow, Leeds, Bristol, Manchester or London Working Style: 3 days a week in office, 2 days anywhere Data is a vital part of our business and with your help, we can improve the services that we provide to our customers through engineering excellence of our data products. You'll be working on exciting data products which support TV, Broadband, Digital Voice and market leading technologies like Unbreakable Wifi. We deliver these critical services using the latest cloud technologies on AWS, GCP and Cloudera. We are hiring 2 Lead Data Engineers to join our brilliant team. When you join us as … a Lead Data Engineer, you'll have the opportunity to be part of our Data & AI Enablement Team where you will help to design, build, and support high quality engineering products from our extensive data sources and multi-cloud environment. As a team we believe in the agile principles of openness, transparency and continuous More ❯

a fast-growing, highly specialised team, working closely with industry experts to develop skills and expertise in an exciting part of the business. We're looking for a Data Engineer to join our growing Transaction Services team. This role supports the team's work in valuing and assessing music catalogues by providing the ingestion, standardisation, and analysis of … royalty data. As our work expands and becomes more specialised, this position will provide a dedicated data resource to support our valuation and due diligence processes. You'll play a hands-on role in processing royalty statement data, cleaning and standardising datasets that leverage our bespoke infrastructure, preparing outputs, and carrying out analysis. You'll also … contribute to internal projects alongside our central data team. Experience & skills you may have Strong working knowledge of SQL, Python, Spark, and experience with cloud infrastructure (ideally AWS and Databricks) Hands-on experience with building data pipelines in Spark within live production environments Coding transformation processes using tools such as dbt Implementing data quality More ❯

Data Scientist - (Forecasting/Regression) Remote (UK-Based) Up to £45,000 The Company This UK-based start-up has grown rapidly in just two years. With a team of ~30 people, they are scaling quickly, supported by recent funding and a strong growth pipeline. They specialise in predictive analytics, tracking KPIs for a wide range of companies … and industries. Their insights empower investors to make informed decisions by providing performance data ahead of public reports. The Role As a Data Scientist, you’ll play a pivotal role in developing and refining KPI prediction models, working with real-world data to create actionable insights. Clean and process data to ensure … models for KPI tracking. Access APIs and integrate software tools to enhance workflows. Collaborate with the revenue team to generate insightful reports. Support internal product development by improving data pipelines and analysis. What They're Looking For 1-2 years in data science or a related field, or a Master’s degree. Strong Python programming (essential More ❯

Senior Azure Data Engineer £57,000 - 64,000 GBP Hybrid WORKING Location: Glasgow, Scotland - United Kingdom Type: Permanent Senior Azure Data Engineer Locations: Leeds, Manchester, Birmingham, Bristol, Glasgow, or London (Hybrid - up to 2 days on-site per week, remainder remote) Salary: £57,000 - £64,000 (non-London)/Up to £70,000 (London) + Benefits … A respected digital consultancy is hiring a Senior Azure Data Engineer to join its growing Managed Services team. Known for supporting mission-critical services across government, health, and the private sector, this organisation builds and operates data platforms that are scalable, secure, and high-performing. You'll be part of a collaborative environment where modern engineering … practices and user-first thinking are at the heart of delivery. This role is ideal for experienced Data Engineers with a strong Azure background who enjoy variety, technical challenges, and building long-term value for clients. The Role: As a Senior Azure Data Engineer, you'll work across multiple client environments-enhancing pipelines, resolving performance issues More ❯

the industry, including Eight Roads (Alibaba, Spendesk, Toast), Bessemer Venture Partners (LinkedIn, Twilio, Shopify), Episode 1 (Zoopla, Betfair, Shazam), and Dynamo Ventures (Sennder, Stord, Gatik). As a Data Analyst, you'll be at the very heart of our mission to revolutionise Freight Forwarding. We're seeking a strategic thinker who goes beyond data preparation and … ll be instrumental in unlocking the true potential of our information to drive smarter business decisions. Your ability to understand the intricate context of our operations and pinpoint data-centric issues across our full tech stack will be critical. This role places you at the forefront of developing powerful analytical solutions that directly feed into and enhance our … up's advanced tech stack to solve complex problems and drive tangible, transformative change, we want to hear from you. Day to Day you will: Engineer and automate data pipelines and reports to deliver actionable insights at scale for both Raft and our customers. Translate complex business challenges into data-driven solutions, collaborating with teams across More ❯

Data Engineer (Minerva MMTAR Functional Core Build) Max Pay: £537 SC is required, Duration: 6 months initially Location: Telford: If local to Telford, requirement will be 2 days per week on site. If not local, expectation will be to attend once/twice a month. Via Umbrella Key Responsibilities: Design, development, and deployment of data integration … and transformation solutions using Pentaho, Denodo, Talend, and SAS. Architect and implement scalable data pipelines and services that support business intelligence and analytics platforms. Collaborate with cross-functional teams to gather requirements, define technical specifications, and deliver robust data solutions. Champion Agile and Scrum methodologies, ensuring timely delivery of sprints and continuous improvement. Drive DevOps practices … for CI/CD, automated testing, and deployment of data services. Mentor and guide junior engineers, fostering a culture of technical excellence and innovation. Ensure data quality, governance, and security standards are upheld across all solutions. Troubleshoot and resolve complex data issues and performance bottlenecks. Key Skills: SAS 9.4 (DI), SAS Viya 3.x (SAS More ❯

Description We're seeking a Junior Machine Learning Engineer to join our transversal Data team, where you'll support the transformation and modernisation of our machine learning platform. You'll collaborate across the organisation to define and implement MLOps best practices, while designing, implementing, and maintaining the infrastructure, essential for the development and deployment of machine learning models. … Working closely with data scientists, data engineers, solution engineers, and other stakeholders, you'll ensure the seamless integration of machine learning models into our production systems, driving innovation and excellence within AXA UK. At AXA we work smart, empowering our people to balance their time between home and the office in a way that works best … to consider flexible working arrangements, which you can discuss with Talent Acquisition. What you'll be doing: Transform offline models into a robust production system with deployment, including data management, feature engineering, monitoring, performance management, automation, and orchestration. Build and enhance reusable tools and modelling pipelines, fostering knowledge sharing across teams. Actively participate in knowledge sharing through internal More ❯

Senior Data Scientist - Product Analytics London, England Intercom is the AI Customer Service company on a mission to help businesses provide incredible customer experiences. Our AI agent Fin, the most advanced customer service AI agent on the market, lets businesses deliver always-on, impeccable customer service and ultimately transform their customer experiences for the better. Fin can also … Driven by our core values, we push boundaries, build with speed and intensity, and consistently deliver incredible value to our customers. What's the opportunity? The Research, Analytics & Data Science (RAD) team at Intercom use data and insights to drive evidence based decision-making. We're a team of data scientists and product researchers … who use data - both big and small - to unlock actionable insights about our customers, our products and our business. We generate insights that build customer empathy, drive product strategy and shape products that deliver real value to our customers. If you get really excited about asking the right questions, exploring patterns in data and surfacing actionable More ❯

Data Engineer (Enterprise DataWarehouse Developer) Description: As a Data Engineer, you'll design and maintain data scrapers and data pipelines, design & optimize analytics & relational databases, and build analytics models using DBT and bespoke aggregation engines. You'll work closely with business stakeholders, other BI Developers and DataOps as well as System engineers … to support both data and application integrations using bespoke tools written in Python/Java, as well as tools such as Meltano, Airflow, Mulesoft/Snaplogic, Apache NIFI, and Kafka, ensuring a robust, well-modelled, and scalable data analytics infrastructure running on MySQL and Postgres style databases primarily. Requirements: Advanced SQL development and deep understanding of … RDBMS concepts and engines Practical knowledge of Data Warehouse infrastructure architecture and best practices Practical database design, development, administration knowledge (any RDBMS) Strong understanding of data governance, quality, and privacy (e.g. GDPR compliance) Proficiency in ELT/ETL processes Strong experience in data ingestion, transformation & orchestration technology (ETL tools such as Informatica, Datastage, SSIS More ❯

Senior Data Scientist - Anti-Fraud & Quality Intelligence Reading GBP 50,000 - 75,000 Senior Data Scientist - Anti-Fraud & Quality Intelligence page is loaded Senior Data Scientist - Anti-Fraud & Quality Intelligence Apply locations Reading, King's Road time type Full time posted on Posted 2 Days Ago time left to apply End Date: July … days left to apply) job requisition id R095723 Senior Data Scientist - Anti-Fraud & Quality Intelligence page is loaded Senior Data Scientist - Anti-Fraud & Quality Intelligence Apply locations Reading, King's Road time type Full time posted on Posted 2 Days Ago time left to apply End Date: July 31, 2025 (25 days left to apply) job … requisition id R095723 We're the world's leading data, insights, and consulting company; we shape the brands of tomorrow by better understanding people everywhere. Kantar's Profiles division is home to the world's largest audience network. With access to 170m+ people in over 100 global markets, we offer unrivalled global reach with local relevancy. Validated by More ❯

Data Warehouse Engineer Location: Newark Salary: £35,000-£38,000 A well-established organisation in the Newark area is seeking a Data Warehouse Engineer to take ownership of its centralised data platform. With a current team member transitioning out at the end of July, this role is ideal for someone confident in SQL, data warehousing, and Power BI, who can hit the ground running in a collaborative, technically strong environment. You'll join a close-knit data team and work alongside a colleague focused on reporting to deliver meaningful insights and maintain a robust, scalable data infrastructure. This position offers exposure to a wide range of ERP systems … and an opportunity to shape the business's approach to data and reporting. Key Responsibilities: Manage and maintain the central data warehouse across multiple ERP platforms Develop and optimise SQL queries to support reporting and data access Build and maintain Power BI dashboards and visualisations Collaborate with internal teams to understand reporting needs and More ❯

The Role We are looking for a hands-on Azure Data Engineer who will lead the final phase of our Client's cloud migration and design the enterprise-grade data platform from the ground up. This is a hybrid role with a strong technical focusblending architecture, automation, and data engineeringto empower s next generation … across Europe, the US, and APAC. As they scale globally and accelerate their AI capabilities, they are completing their transition to the cloud and building a company-wide data platform to power insight-driven transformation for their consultants and clients Required Skills & Experience Must-Haves: 3+ years of hands-on Azure engineering experience (IaaS ? PaaS), including Infra as … Code. Strong SQL skills and proficiency in Python or PySpark . Built or maintained data lakes/warehouses using Synapse , Fabric , Databricks , Snowflake , or Redshift . Experience hardening cloud environments (NSGs, identity, Defender). Demonstrated automation of backups, CI/CD deployments, or DR workflows. Nice-to-Haves: Experience with Azure OpenAI , vector databases, or LLM integrations. Power More ❯

want to talk to you. What Are The Responsibilities? Architect and implement AI-powered features for threat detection, pattern recognition, and automated intelligence gathering Design and build scalable data pipelines that process billions of data points using AI/ML models for entity extraction and relationship mapping Lead the integration of Large Language Models (LLMs) for … natural language processing of intelligence data Develop robust APIs and microservices that handle real-time threat analysis at scale Implement computer vision systems for image and video analysis in OSINT investigations Build and optimize vector databases for semantic search across massive intelligence datasets Establish best practices for AI/ML model deployment, monitoring, and continuous improvement Mentor team … with MLOps practices and model deployment pipelines Proficient in cloud AI services (AWS SageMaker/Bedrock) Deep understanding of distributed systems and microservices architecture Expert in data pipeline platforms (Apache Kafka, Airflow, Spark) Proficient in both SQL (PostgreSQL, MySQL) and NoSQL (Elasticsearch, MongoDB) databases Strong containerization and orchestration skills (Docker, Kubernetes) Experience with infrastructure as code (Terraform More ❯

want to talk to you. What Are The Responsibilities? Architect and implement AI-powered features for threat detection, pattern recognition, and automated intelligence gathering Design and build scalable data pipelines that process billions of data points using AI/ML models for entity extraction and relationship mapping Lead the integration of Large Language Models (LLMs) for … natural language processing of intelligence data Develop robust APIs and microservices that handle real-time threat analysis at scale Implement computer vision systems for image and video analysis in OSINT investigations Build and optimize vector databases for semantic search across massive intelligence datasets Establish best practices for AI/ML model deployment, monitoring, and continuous improvement Mentor team … with MLOps practices and model deployment pipelines Proficient in cloud AI services (AWS SageMaker/Bedrock) Deep understanding of distributed systems and microservices architecture Expert in data pipeline platforms (Apache Kafka, Airflow, Spark) Proficient in both SQL (PostgreSQL, MySQL) and NoSQL (Elasticsearch, MongoDB) databases Strong containerization and orchestration skills (Docker, Kubernetes) Experience with infrastructure as code (Terraform More ❯

Overview: We're hiring a Product Manager to own our backend data platform-governed datasets, quality enforcement, platform tooling, and integrations with Azure and Databricks. You'll shape how data products are built, validated, and consumed across the enterprise. Key Responsibilities: -Define and manage governed data products across medallion architecture (Bronze, Silver, Gold). … Drive platform improvements in data quality, lineage, cataloging, and contract enforcement. -Collaborate with data engineers and architects to deliver scalable pipelines. -Own roadmap and tooling integration for Alation, Databricks, Azure Data Services, and Great Expectations. -Partner with Data Governance to support domain stewards and ensure enterprise alignment. Ideal Experience: -Product ownership of … data pipelines, platforms, or PaaS. -Familiarity with Azure, Databricks, and enterprise data governance. -Strong understanding of data contracts, DQ KPIs, and metadata standards. -Experience with modern data stacks and cross-functional teams. More ❯

Principal Data Engineer Department: Intel Employment Type: Permanent Location: Newcastle-upon-Tyne Reporting To: Head of Data Description We're looking for a Principal Data Engineer to join the team responsible for delivering trusted, high-quality data products that power decisions across Bede. Reporting to the Head of Data, you … ll be a respected technical authority, owning the design, integrity, and ongoing improvement of our data architecture. You'll set the standard for engineering excellence in your product area, guiding teams on best practices, system health, documentation, and long-term technical direction. This is a high-impact role suited to someone who thrives on solving complex problems, collaborating … across disciplines, and shaping scalable, resilient data platforms. This is a hybrid role that requires you to be in our Newcastle-upon-Tyne office two days a week. Please apply only if you're comfortable with this arrangement. What you'll be doing Core Responsibilities Own and evolve the technical roadmap for the data product area More ❯

of Engineering. You will oversee all aspects of the engineering lifecycle, from technology design and architecture through to implementation and optimisation. You'll work closely with cloud architects, data scientists, and risk officers to deliver a robust, scalable, and compliant platform that meets the bank's risk and regulatory needs. The role will shape the Lab vision, set … and demonstrate technical leadership across the lifecycle from idea to value realisation. About us Like the modern Britain we serve, we're evolving. Investing billions in our people, data and tech to transform how we meet the changing needs of our 26 million customers. We're growing with purpose. Join us on our journey and you will too … What you'll do Lead the engineering team responsible for end-to-end infrastructure and technology transformation, including legacy decommissioning and GCP-based data infrastructure. Provide technical direction and mentorship, fostering collaboration, innovation, and continuous improvement. Design scalable, high-performance cloud infrastructure on GCP, ensuring availability, resilience, security, and compliance. Implement Infrastructure-as-Code (IaC) using tools like More ❯

of Engineering. You will oversee all aspects of the engineering lifecycle, from technology design and architecture through to implementation and optimisation. You'll work closely with cloud architects, data scientists, and risk officers to deliver a robust, scalable, and compliant platform that meets the bank's risk and regulatory needs. The role will shape the Lab vision, set … and demonstrate technical leadership across the lifecycle from idea to value realisation. About us Like the modern Britain we serve, we're evolving. Investing billions in our people, data and tech to transform how we meet the changing needs of our 26 million customers. We're growing with purpose. Join us on our journey and you will too … What you'll do Lead the engineering team responsible for end-to-end infrastructure and technology transformation, including legacy decommissioning and GCP-based data infrastructure. Provide technical direction and mentorship, fostering collaboration, innovation, and continuous improvement. Design scalable, high-performance cloud infrastructure on GCP, ensuring availability, resilience, security, and compliance. Implement Infrastructure-as-Code (IaC) using tools like More ❯

The Role We are looking for a hands-on Azure Data Engineer who will lead the final phase of our Client's cloud migration and design the enterprise-grade data platform from the ground up. This is a hybrid role with a strong technical focus—blending architecture, automation, and data engineering—to empower s … across Europe, the US, and APAC. As they scale globally and accelerate their AI capabilities, they are completing their transition to the cloud and building a company-wide data platform to power insight-driven transformation for their consultants and clients Required Skills & Experience Must-Haves: 3+ years of hands-on Azure engineering experience (IaaS PaaS), including Infra as … Code. Strong SQL skills and proficiency in Python or PySpark . Built or maintained data lakes/warehouses using Synapse , Fabric , Databricks , Snowflake , or Redshift . Experience hardening cloud environments (NSGs, identity, Defender). Demonstrated automation of backups, CI/CD deployments, or DR workflows. Nice-to-Haves: Experience with Azure OpenAI , vector databases, or LLM integrations. Power More ❯

Outside IR35) London (3 days/week on-site) 6-month initial contract The Role A major logistics business is undergoing a full rebuild of its legacy, siloed data estate - and we're hiring an experienced Analytics Engineer to help drive the transformation. You'll join a newly formed data team under a new Head of … Data, working on a clean-slate Azure-based platform. The role bridges data engineering and analytics, focused on building scalable data models, automated pipelines, and enabling self-serve analytics across the organisation. Key Responsibilities Build and maintain scalable data pipelines using Azure Data Factory and Databricks Develop transformation workflows in … dbt, SQL, and Python Design dimensional models and semantic layers to support analytics use cases Implement automated data quality checks, monitoring, and alerting systems Create reusable data assets and documentation to support self-serve analytics via Power BI Work with analysts and business stakeholders to translate requirements into technical solutions Maintain clean, version-controlled codebases and More ❯

Data Products Engineer Aon is looking to welcome a Back End Engineer - Data APIs & Insights to our growing technology team. In this role, you'll help build and scale the data infrastructure and APIs that power our market intelligence products-serving high-value insights to clients across enterprise web applications. This is a hybrid … passionate about helping our colleagues and clients succeed. What the day will look like The main responsibilities will include: Design and develop modern APIs that serve both raw data and AI-generated insights to our suite of client-facing web applications. Build and optimise performant data pipelines using Polars, FastAPI, and Python, ensuring fast response times … building elegant, scalable, and performant back-end systems, with a track record of delivering robust APIs that enable dynamic React front ends and unlock the full value of data and AI-driven insights. Behind every insight we deliver is a fast, reliable, and intelligent API infrastructure-designed to serve curated data and machine-generated intelligence in More ❯

actively including and empowering our people. Above all, we are purpose-driven, committed to positively impacting our people, the planet, and our global communities. We are investing in data, technology and analytics as a strategic priority. The team brings together a number of capabilities that sit within different parts of Croud, into one unit that will drive cutting … edge development in a number of critical areas for the business. The role sits within the Data Engineering team and reports to the Head of Data Engineering. The team's remit is to drive innovation & revenue through the development & delivery of revenue-generating/client-facing data engineering solutions used across the agency. The … Data Engineer will be part of a growing team that delivers highly impactful data solutions across our extensive client portfolio and also the agency's own product offerings. We seek individuals who are proactive, self-starters with a meticulous eye for detail, and who can communicate clearly and effectively across our diverse internal and external stakeholders. More ❯

actively including and empowering our people. Above all, we are purpose-driven, committed to positively impacting our people, the planet, and our global communities. We are investing in data, technology and analytics as a strategic priority. The team brings together a number of capabilities that sit within different parts of Croud, into one unit that will drive cutting … edge development in a number of critical areas for the business. The role sits within the Data Engineering team and reports to the Head of Data Engineering. The team's remit is to drive innovation & revenue through the development & delivery of revenue-generating/client-facing data engineering solutions used across the agency. The … Data Engineer will be part of a growing team that delivers highly impactful data solutions across our extensive client portfolio and also the agency's own product offerings. We seek individuals who are proactive, self-starters with a meticulous eye for detail, and who can communicate clearly and effectively across our diverse internal and external stakeholders. More ❯