201 to 225 of 375 Data Pipeline Jobs in the UK excluding London

Power Platform & Azure Data Developer Are you a data-driven developer with a passion for automation, analytics, and AI? We're working with a forward-thinking organisation that's investing heavily in digital transformation - and they're looking for a Power Platform & Azure Data Developer to join their growing team. This is a fantastic … opportunity to work on cutting-edge projects that blend Power Platform , Azure Data Services , and AI technologies to deliver intelligent, scalable solutions across the business. This is a hybrid role, with 2 days per week in their Central London office to collaborate with your team and business stakeholders. What You'll Be Doing: Power Platform Development : Build and … maintain Power Automate flows, Power Apps, and Power BI dashboards. Azure Data Engineering : Design and manage robust data pipelines using Azure Data Factory. AI & Advanced Analytics : Collaborate on AI/ML projects, integrating models into Power BI and Azure services. Collaboration & Documentation : Work closely with stakeholders to gather requirements and document technical solutions. What More ❯

you're inspired to think big and bring your ambition to work every day, which is why, at British Airways the sky is never the limit. The role: Data Scientist/Senior Data Scientist Join British Airways as a Data Scientist in our cutting-edge Operations Decision Support (ODS) product team. This full-stack … role sits at the heart of our transformation, combining data science, machine learning, and optimisation to build industrialised decision-support software. If you're passionate about solving real-world problems through intelligent, data-driven solutions and thrive in a collaborative, agile environment-this is your opportunity to make a real impact. What you'll do: Design … with software engineering teams, product & change teams to turn their models into industrialized products that are used by the airline every day to make better decisions. Build robust data pipelines, automate data cleaning, and deliver scalable, production-grade Python code using best practices such as typing, testing, and modular design. Integrate models into orchestration frameworks (e.g. More ❯

Azure Data Engineer – FinTech | Azure | Data |12-month FTC London – Remote in office 4 times in a fortnight (flexible) Salary & Benefits – Up to £75,000 + 8 to 12% Pension, Life Assurance, Health & Dental Insurance, 25+ days annual leave + other flexible benefits Azure Data factory | Logic Apps | Azure Batch | Azure Functions | Azure DevOps … I’m working with a pioneering organisation in the UK fintech landscape who are on the hunt for an experienced Azure Data Engineer to join their fast-moving Intelligent Automation Team.This isn’t your average data gig. You’ll be building and scaling Azure-native pipelines that power the next phase of AI-led transformation in … financial services. If you're passionate about clean architecture, impactful automation, and cutting through the noise with robust cloud data solutions — you’ll thrive here.This role is a 12 month FTC and would suite someone who wants to dive into a new challenge for the next year or so.Role as an Azure Data Engineer: Crafting and More ❯

week in Surrey office 8 Month Contract Upto £340 p/day Inside IR35 About the Role We are looking for a commercially minded and technically capable Senior Data Analyst to join our growing analytics team. This high-impact role involves delivering insights across digital, commercial, and operational areas by working with a variety of customer, sales, behavioural … and market data. You’ll work cross-functionally with stakeholders in Marketing, UX, Product, Logistics, and Finance, as well as with Data Engineers to enable scalable, data-driven decision making across the organisation. Key Responsibilities Analyse data from multiple internal systems including sales platforms, customer data sources, logistics, and financial planning tools … digital marketing strategy, sales trends, stock movement, and operational efficiency Support UX and behavioural analysis using tools that provide heatmaps, session replays, and user journey insights Collaborate with Data Engineers to access data via APIs, define requirements, and help shape data pipelines and modelling Build and maintain clear, user-friendly dashboards and reports in More ❯

At Amazon, data is critical to everything we do, from understanding product inventories across our global fulfillment centers to predicting what products to recommend to customers. Data ceaselessly informs our flywheel, helping us to understand customer needs, onboard new sellers and selection, and identify opportunities for cost savings. Business Data Technologies (BDT) provides trustworthy … intuitive, and cost-efficient solutions for Amazonians to secure, store, analyze, and transform this data at unparalleled scale. BDT owns, develops, and operates Andes, one of the largest data lakes in the world, storing more than 2 exabytes of data, read/written to by 100k+ data pipelines, with >60k monthly active … users. To do this, we need extraordinary individuals to build the next generation of data analytics, machine learning, and AI solutions for thousands of scientists, engineers, and analysts who rely upon us to get their jobs done in a safe and secure manner. Data Privacy and Comprehension is a key function of an enterprise datalake. The More ❯

Contribute to security engineering projects, transitions, and transformations. Work closely with security operations and associated security incident response systems Stay informed about emerging threats and security best practices. Data Ingestion and Enrichment: Configure Elasticsearch pipelines for data ingestion from various sources, primarily from Kafka Enhance data enrichment by integrating threat intelligence feeds and contextual … towards achieving these. Skills Required for the Role Security and Compliance with Elastic Security: Set up access controls, authentication, and encryption using Elastic Security features. Ensure compliance with data protection regulations. Detection Rule Development: Ability to create, test, and optimise detection rules to identify suspicious activities and potential threats based on the MITRE ATT&CK Framework Performance Tuning … with Elasticsearch and Logstash: Fine-tune query performance using Elasticsearch indices and mappings. Monitor Logstash pipelines and optimize resource utilization. Kibana Visualization and Monitoring: Leverage Kibana for data visualization, dashboards, and real-time monitoring. Create custom visualizations to track data quality metrics and system performance. Elastic integration Integration of the SIEM with critical systems to provide More ❯

Senior Azure Data Engineer £57,000 - 64,000 GBP Hybrid WORKING Location: Glasgow, Scotland - United Kingdom Type: Permanent Senior Azure Data Engineer Locations: Leeds, Manchester, Birmingham, Bristol, Glasgow, or London (Hybrid - up to 2 days on-site per week, remainder remote) Salary: £57,000 - £64,000 (non-London)/Up to £70,000 (London) + Benefits … A respected digital consultancy is hiring a Senior Azure Data Engineer to join its growing Managed Services team. Known for supporting mission-critical services across government, health, and the private sector, this organisation builds and operates data platforms that are scalable, secure, and high-performing. You'll be part of a collaborative environment where modern engineering … practices and user-first thinking are at the heart of delivery. This role is ideal for experienced Data Engineers with a strong Azure background who enjoy variety, technical challenges, and building long-term value for clients. The Role: As a Senior Azure Data Engineer, you'll work across multiple client environments-enhancing pipelines, resolving performance issues More ❯

Data Engineer (Minerva MMTAR Functional Core Build) Max Pay: £537 SC is required, Duration: 6 months initially Location: Telford: If local to Telford, requirement will be 2 days per week on site. If not local, expectation will be to attend once/twice a month. Via Umbrella Key Responsibilities: Design, development, and deployment of data integration … and transformation solutions using Pentaho, Denodo, Talend, and SAS. Architect and implement scalable data pipelines and services that support business intelligence and analytics platforms. Collaborate with cross-functional teams to gather requirements, define technical specifications, and deliver robust data solutions. Champion Agile and Scrum methodologies, ensuring timely delivery of sprints and continuous improvement. Drive DevOps practices … for CI/CD, automated testing, and deployment of data services. Mentor and guide junior engineers, fostering a culture of technical excellence and innovation. Ensure data quality, governance, and security standards are upheld across all solutions. Troubleshoot and resolve complex data issues and performance bottlenecks. Key Skills: SAS 9.4 (DI), SAS Viya 3.x (SAS More ❯

Senior Data Scientist - Anti-Fraud & Quality Intelligence Reading GBP 50,000 - 75,000 Senior Data Scientist - Anti-Fraud & Quality Intelligence page is loaded Senior Data Scientist - Anti-Fraud & Quality Intelligence Apply locations Reading, King's Road time type Full time posted on Posted 2 Days Ago time left to apply End Date: July … days left to apply) job requisition id R095723 Senior Data Scientist - Anti-Fraud & Quality Intelligence page is loaded Senior Data Scientist - Anti-Fraud & Quality Intelligence Apply locations Reading, King's Road time type Full time posted on Posted 2 Days Ago time left to apply End Date: July 31, 2025 (25 days left to apply) job … requisition id R095723 We're the world's leading data, insights, and consulting company; we shape the brands of tomorrow by better understanding people everywhere. Kantar's Profiles division is home to the world's largest audience network. With access to 170m+ people in over 100 global markets, we offer unrivalled global reach with local relevancy. Validated by More ❯

Data Warehouse Engineer Location: Newark Salary: £35,000-£38,000 A well-established organisation in the Newark area is seeking a Data Warehouse Engineer to take ownership of its centralised data platform. With a current team member transitioning out at the end of July, this role is ideal for someone confident in SQL, data warehousing, and Power BI, who can hit the ground running in a collaborative, technically strong environment. You'll join a close-knit data team and work alongside a colleague focused on reporting to deliver meaningful insights and maintain a robust, scalable data infrastructure. This position offers exposure to a wide range of ERP systems … and an opportunity to shape the business's approach to data and reporting. Key Responsibilities: Manage and maintain the central data warehouse across multiple ERP platforms Develop and optimise SQL queries to support reporting and data access Build and maintain Power BI dashboards and visualisations Collaborate with internal teams to understand reporting needs and More ❯

The Role We are looking for a hands-on Azure Data Engineer who will lead the final phase of our Client's cloud migration and design the enterprise-grade data platform from the ground up. This is a hybrid role with a strong technical focusblending architecture, automation, and data engineeringto empower s next generation … across Europe, the US, and APAC. As they scale globally and accelerate their AI capabilities, they are completing their transition to the cloud and building a company-wide data platform to power insight-driven transformation for their consultants and clients Required Skills & Experience Must-Haves: 3+ years of hands-on Azure engineering experience (IaaS ? PaaS), including Infra as … Code. Strong SQL skills and proficiency in Python or PySpark . Built or maintained data lakes/warehouses using Synapse , Fabric , Databricks , Snowflake , or Redshift . Experience hardening cloud environments (NSGs, identity, Defender). Demonstrated automation of backups, CI/CD deployments, or DR workflows. Nice-to-Haves: Experience with Azure OpenAI , vector databases, or LLM integrations. Power More ❯

want to talk to you. What Are The Responsibilities? Architect and implement AI-powered features for threat detection, pattern recognition, and automated intelligence gathering Design and build scalable data pipelines that process billions of data points using AI/ML models for entity extraction and relationship mapping Lead the integration of Large Language Models (LLMs) for … natural language processing of intelligence data Develop robust APIs and microservices that handle real-time threat analysis at scale Implement computer vision systems for image and video analysis in OSINT investigations Build and optimize vector databases for semantic search across massive intelligence datasets Establish best practices for AI/ML model deployment, monitoring, and continuous improvement Mentor team … with MLOps practices and model deployment pipelines Proficient in cloud AI services (AWS SageMaker/Bedrock) Deep understanding of distributed systems and microservices architecture Expert in data pipeline platforms (Apache Kafka, Airflow, Spark) Proficient in both SQL (PostgreSQL, MySQL) and NoSQL (Elasticsearch, MongoDB) databases Strong containerization and orchestration skills (Docker, Kubernetes) Experience with infrastructure as code (Terraform More ❯

want to talk to you. What Are The Responsibilities? Architect and implement AI-powered features for threat detection, pattern recognition, and automated intelligence gathering Design and build scalable data pipelines that process billions of data points using AI/ML models for entity extraction and relationship mapping Lead the integration of Large Language Models (LLMs) for … natural language processing of intelligence data Develop robust APIs and microservices that handle real-time threat analysis at scale Implement computer vision systems for image and video analysis in OSINT investigations Build and optimize vector databases for semantic search across massive intelligence datasets Establish best practices for AI/ML model deployment, monitoring, and continuous improvement Mentor team … with MLOps practices and model deployment pipelines Proficient in cloud AI services (AWS SageMaker/Bedrock) Deep understanding of distributed systems and microservices architecture Expert in data pipeline platforms (Apache Kafka, Airflow, Spark) Proficient in both SQL (PostgreSQL, MySQL) and NoSQL (Elasticsearch, MongoDB) databases Strong containerization and orchestration skills (Docker, Kubernetes) Experience with infrastructure as code (Terraform More ❯

Principal Data Engineer Department: Intel Employment Type: Permanent Location: Newcastle-upon-Tyne Reporting To: Head of Data Description We're looking for a Principal Data Engineer to join the team responsible for delivering trusted, high-quality data products that power decisions across Bede. Reporting to the Head of Data, you … ll be a respected technical authority, owning the design, integrity, and ongoing improvement of our data architecture. You'll set the standard for engineering excellence in your product area, guiding teams on best practices, system health, documentation, and long-term technical direction. This is a high-impact role suited to someone who thrives on solving complex problems, collaborating … across disciplines, and shaping scalable, resilient data platforms. This is a hybrid role that requires you to be in our Newcastle-upon-Tyne office two days a week. Please apply only if you're comfortable with this arrangement. What you'll be doing Core Responsibilities Own and evolve the technical roadmap for the data product area More ❯

of Engineering. You will oversee all aspects of the engineering lifecycle, from technology design and architecture through to implementation and optimisation. You'll work closely with cloud architects, data scientists, and risk officers to deliver a robust, scalable, and compliant platform that meets the bank's risk and regulatory needs. The role will shape the Lab vision, set … and demonstrate technical leadership across the lifecycle from idea to value realisation. About us Like the modern Britain we serve, we're evolving. Investing billions in our people, data and tech to transform how we meet the changing needs of our 26 million customers. We're growing with purpose. Join us on our journey and you will too … What you'll do Lead the engineering team responsible for end-to-end infrastructure and technology transformation, including legacy decommissioning and GCP-based data infrastructure. Provide technical direction and mentorship, fostering collaboration, innovation, and continuous improvement. Design scalable, high-performance cloud infrastructure on GCP, ensuring availability, resilience, security, and compliance. Implement Infrastructure-as-Code (IaC) using tools like More ❯

of Engineering. You will oversee all aspects of the engineering lifecycle, from technology design and architecture through to implementation and optimisation. You'll work closely with cloud architects, data scientists, and risk officers to deliver a robust, scalable, and compliant platform that meets the bank's risk and regulatory needs. The role will shape the Lab vision, set … and demonstrate technical leadership across the lifecycle from idea to value realisation. About us Like the modern Britain we serve, we're evolving. Investing billions in our people, data and tech to transform how we meet the changing needs of our 26 million customers. We're growing with purpose. Join us on our journey and you will too … What you'll do Lead the engineering team responsible for end-to-end infrastructure and technology transformation, including legacy decommissioning and GCP-based data infrastructure. Provide technical direction and mentorship, fostering collaboration, innovation, and continuous improvement. Design scalable, high-performance cloud infrastructure on GCP, ensuring availability, resilience, security, and compliance. Implement Infrastructure-as-Code (IaC) using tools like More ❯

The Role We are looking for a hands-on Azure Data Engineer who will lead the final phase of our Client's cloud migration and design the enterprise-grade data platform from the ground up. This is a hybrid role with a strong technical focus—blending architecture, automation, and data engineering—to empower s … across Europe, the US, and APAC. As they scale globally and accelerate their AI capabilities, they are completing their transition to the cloud and building a company-wide data platform to power insight-driven transformation for their consultants and clients Required Skills & Experience Must-Haves: 3+ years of hands-on Azure engineering experience (IaaS PaaS), including Infra as … Code. Strong SQL skills and proficiency in Python or PySpark . Built or maintained data lakes/warehouses using Synapse , Fabric , Databricks , Snowflake , or Redshift . Experience hardening cloud environments (NSGs, identity, Defender). Demonstrated automation of backups, CI/CD deployments, or DR workflows. Nice-to-Haves: Experience with Azure OpenAI , vector databases, or LLM integrations. Power More ❯

Outside IR35) London (3 days/week on-site) 6-month initial contract The Role A major logistics business is undergoing a full rebuild of its legacy, siloed data estate - and we're hiring an experienced Analytics Engineer to help drive the transformation. You'll join a newly formed data team under a new Head of … Data, working on a clean-slate Azure-based platform. The role bridges data engineering and analytics, focused on building scalable data models, automated pipelines, and enabling self-serve analytics across the organisation. Key Responsibilities Build and maintain scalable data pipelines using Azure Data Factory and Databricks Develop transformation workflows in … dbt, SQL, and Python Design dimensional models and semantic layers to support analytics use cases Implement automated data quality checks, monitoring, and alerting systems Create reusable data assets and documentation to support self-serve analytics via Power BI Work with analysts and business stakeholders to translate requirements into technical solutions Maintain clean, version-controlled codebases and More ❯

actively including and empowering our people. Above all, we are purpose-driven, committed to positively impacting our people, the planet, and our global communities. We are investing in data, technology and analytics as a strategic priority. The team brings together a number of capabilities that sit within different parts of Croud, into one unit that will drive cutting … edge development in a number of critical areas for the business. The role sits within the Data Engineering team and reports to the Head of Data Engineering. The team's remit is to drive innovation & revenue through the development & delivery of revenue-generating/client-facing data engineering solutions used across the agency. The … Data Engineer will be part of a growing team that delivers highly impactful data solutions across our extensive client portfolio and also the agency's own product offerings. We seek individuals who are proactive, self-starters with a meticulous eye for detail, and who can communicate clearly and effectively across our diverse internal and external stakeholders. More ❯

Job Title: Data Engineer/Software Engineer - AI/ML Research Location: London- UK (Hybrid role) Duration: Contract- Until Dec 25 with a possible extension About the Role We are seeking a Data Engineer/Software Engineer to support a pioneering project focused on LLM agents for research . You will play a key role in … results to original datasets, repackage them, and support re-ingestion workflows. Collaborate with cross-functional teams to ensure data readiness and quality. Contribute to system design and pipeline automation efforts. Build and maintain Python-based data pipelines. Engage in technical discussions with researchers and stakeholders. Execute data mitigation and filtering tasks with minimal … enable LLM agents to process and manage data automatically. Required Skills & Qualifications Solid background in data engineering or software engineering . Proficient in Python and pipeline development . Experience with data cleaning, transformation, and validation . Understanding of modern data storage systems and formats. Strong communication and collaboration skills. Prior work More ❯

Eden Scott is recruiting a Senior Data Engineer for Amici to develop a cutting-edge platform. As the business looks to the future, we are now seeking an experienced Senior Data Engineer for our data team. This is a permanent, full-time position. You'll work in an agile, collaborative environment, leveraging modern technology … stacks to build and optimize a powerful data platform and search engine. With an opportunity to explore vector search, machine learning, and large-scale data processing using Apache Lucene, Solr, or Elasticsearch. What you'll be doing: Design, build, and optimize a high-performance data platform and search solution. Develop robust search capabilities using … Apache Lucene, Solr, or Elasticsearch. Engineer scalable data pipelines in Java or Python. Write high-quality, test-driven code using Agile methodologies. Collaborate with Business Analysts, Data Engineers, and UI Developers. Work across the full stack, from React/TypeScript front-end to Java-based search services. Leverage cloud technologies like Azure Data Factory More ❯

trends and their impact on utilities to support our GridOS deployments and connect customers with the respective products and solutions. As a "Services Engineer - GridOS", you will implement data models and configuration for electrical network systems, ensuring data accuracy and accessibility through collaboration with cross-functional teams. This role is expected to deliver, develop and tailor … GridOS modules to fit the customer needs. This role requires a good understanding of electrical network data structures, GIS technologies and SCADA/ADMS system. GridOS is a comprehensive software portfolio developed by GE Electrification Software to modernize and transform the electric grid into a smart and clean energy grid. It is an advanced and scalable energy management … system that transforms real-time data into actionable insights and provides utilities with advanced tools to manage the increasing complexity of energy systems. By integrating energy data, network modeling, and AI/ML-driven analytics, GridOS aims to enhance grid reliability, resilience, and efficiency, even in severe weather conditions. By integrating an Advanced Distribution Management System More ❯

Data Engineer Location: Burnley, Lancashire Contract: Permanent - 37.5 hours per week Hybrid (2 days a week in office) Salary: £50-55,000 + performance bonuses + great benefits Are you a passionate Data Engineer looking to work on meaningful projects that make a difference to the environment? Fancy joining a friendly, inclusive team where your ideas … and growing organisation thats been a pioneer in water network monitoring for over 20 years. As the sector steps up to meet new environmental challenges, the demand for data-driven solutions is growing fast - and this team is at the forefront of it all. If youre excited by working with large, complex datasets, building scalable data pipelines, and helping to solve real-world problems, wed love to hear from you. What youll be doing: Designing and building pipelines in the data platform, with automation, quality and resilience at the core. Supporting the development of a scalable data architecture and engineering roadmap. Helping colleagues across the business solve data More ❯

Role Overview: We are currently looking for a Data Team Lead to head our data operations and strategy.This is a hands-on leadership role responsible for managing a small but growing data team, ensuring the delivery of high-quality data infrastructure, reporting, and business intelligence tools to support cross-functional goals.The ideal … candidate will have a strong technical background, experience in team management, and the ability to align data processes with business objectives. Key Responsibilities: Lead and develop the internal data team, including hiring, mentoring, and performance management Build and maintain scalable data pipelines, storage solutions, and reporting dashboards Ensure data accuracy, quality, governance … and compliance with relevant standards Translate business needs into technical requirements and data-driven solutions Collaborate with marketing, product, and executive teams to support decision-making Monitor performance metrics and proactively identify areas for optimisation Own and refine the company's data strategy, aligned with broader business goals Requirements: Minimum 5 years of experience in data More ❯

Lead Data Engineer - Remote - UK About the Role: We're hiring on behalf of a fast-growing, tech-driven organisation looking for a Lead Data Engineer to take ownership of their data infrastructure. This is a fully remote role open to candidates based anywhere in the UK. You'll lead the design and development … of scalable data pipelines, mentor a small team of engineers, and work closely with cross-functional teams to deliver high-impact data solutions. Key Responsibilities: Architect and maintain robust data pipelines using AWS services (Glue, Lambda, S3, Airflow) Lead the migration and optimisation of data workflows into Snowflake. Collaborate with analysts, data scientists, and product teams to deliver clean, reliable data. Define and enforce best practices in data engineering and governance. Mentor junior engineers and contribute to a culture of technical excellence Requirements: Proven experience in a Lead or Senior Data Engineering role Strong hands-on expertise with AWS (Glue, Lambda, S3) Deep experience with Snowflake More ❯