551 to 575 of 925 Data Pipeline Jobs in the UK

Viya 4. Support the migration of legacy SAS platforms to cloud-native SAS Viya 4 environments, including namespace separation and Kubernetes orchestration. Implement and manage configuration objects, service data, and translation objects within SAS environments. Collaborate with data engineers and DevOps teams to integrate SAS with Oracle, GitLab CI/CD pipelines, and other enterprise platforms. … Monitor and optimise platform performance, ensuring high availability and compliance with security standards. Provide technical support and troubleshooting for SAS users and developers. Automate environment provisioning and data transfers using approved EA integration patterns. Participate in community knowledge sharing and contribute to best practice documentation. Essential Skills and Experience: SAS Enterprise Guide (EG) - workflow orchestration and user support. … Viya 4 - platform configuration, migration, and containerisation (Kubernetes). SAS Visual Analytics (VA) and SAS Visual Investigator (VI) - dashboard and investigation tool support. Oracle - integration and data pipeline support. Configuration Management - experience managing service objects, deployment artefacts, and environment baselines. Testing Lifecycle Knowledge - including test strategy design, environment comparison utilities, and automated testing integration. Desirable Attributes: Experience More ❯

Data Engineering Manager Hybrid | Brighton (Once Per Week) Up to £90k + Benefits Are you an experienced Data Engineering Manager with a passion for leading high-performing teams and shaping modern data infrastructure? I'm working with an exciting, fast-growing, private-equity-backed tech company that's on a mission to revolutionise how … people make confident buying decisions online - and they're looking for a hands-on leader to own a key part of their data platform. The Opportunity You'll take charge of a small, talented Data Engineering team, responsible for evolving and scaling the ingestion of customer product catalogues into internal systems. This is a hybrid role … up your sleeves when needed. They're entering an exciting growth phase with big ambitions, and this role will be pivotal in building scalable, cost-effective, and innovative data solutions to support that journey. What You'll Do Manage, mentor, and grow a small team of Data Engineers. Own the architecture and design of scalable data More ❯

and our employee exit rate is astonishingly low. Join us on our journey Let's create something awesome, together, today. About the role and team: As a Lead Data Engineer, you'll play a hands-on technical leadership role in our Data Practice. You'll be instrumental in shaping how we deliver data engineering … engagements, working closely with client stakeholders, internal teams and fellow consultants. You'll bring strong technical expertise, mentorship, and a practical approach to building scalable and value-driven data platforms. What you'll be doing: Leading the design and implementation of robust, cloud-native data platforms Architecting and optimising data pipelines and data models for performance and scalability Championing best practices across data engineering, including testing, automation, and documentation Mentoring junior engineers and guiding technical delivery across projects Working directly with client stakeholders to define goals, shape roadmaps and deliver real business impact Driving innovation through continuous improvement and staying ahead of industry trends We'd love to talk More ❯

the hunt for builders .No, we've not ventured into construction in our quest to conquer the world, rather a designer and builder of systems for all things data related where we are conquering the Data World. We can offer an interesting insight into projects spanning a variety of sectors, which may include industries such as … to explore our dynamic team where you can truly act as an expert in your field in support of our clients and their challenges in the world of data and technology, read on! The Team We're Intuita - a fast growing consultancy that's making waves in both the consultancy and technology space. With our ambitious goals for … our business, becoming a pivotal part of our journey, to not just meet, but continuously exceed our client expectations! The Role We are seeking a skilled MS Fabric Data Engineer(s) to join our team, ideally initially on a contract basis, however longer term there is potential to discuss longer term opportunities in the shape of a permanent More ❯

Senior Data Engineer| AWS/Databricks/PySpark | London/Glasgow (Hybrid) | August Start Role: Senior Data Engineer Location: This is a hybrid engagement represented by 2 days/week onsite, either in Central London or Glasgow. Start Date: Must be able to start mid-August. Salary: £80k-£90k (Senior) | £90k-£95k (Lead) About The Role … Our partner is looking for a Senior Data Engineer to join a high-impact engineering team delivering scalable data solutions for complex marketing and customer insight use cases. This is an opportunity to work on cutting-edge data pipelines, cloud-native platforms and real-time data flows in a collaborative, forward-thinking … with cross-functional teams including Data Science, Software Engineering and Product. Champion best practices in data governance, observability and compliance. Contribute to CI/CD pipeline development and infrastructure automation (Terraform, AWS DevOps). Provide input into technical decisions, peer reviews and solution design. Requirements Proven experience as a Data Engineer in cloud More ❯

Data Engineer/BI Developer - SAP S/4HANA Programme Location: Hybrid (UK-based with occasional on-site in the South West) Contract Length: 6 months initial Rate: £450 - Outside IR35 A leading UK water company is in the midst of a large-scale SAP S/4HANA transformation programme. We're looking for an experienced Data Engineer/BI Developer to support the delivery of robust data pipelines, reporting structures, and SAP-integrated BI solutions that will enable critical operational and regulatory reporting across the organisation. You'll be working in a dynamic, delivery-focused environment alongside SAP consultants, infrastructure teams, and business stakeholders, with a particular focus on SAP BW/… 4HANA, Datasphere, and integration of water utility data. Key Responsibilities Develop and maintain data models using SAP BW/4HANA , CDS Views , ADSO , and Composite Providers . Build and optimise ETL data flows from SAP S/4HANA , legacy systems , and real-time data sources (e.g. SCADA, telemetry). Deliver robust BI reporting layers More ❯

As an AI Software Engineer Apprentice, you’ll deliver real-world AI and ML solutions working with data pipelines, models, APIs, and microservices while advancing toward a fully funded Level 6 degree. This role is rooted in the Digital and Technology Solutions standard, blending a common core with the Software Engineer specialism. Role Location: Hybrid (UK-based) Hours … Monday – Friday, 09:00–17:00 Salary: £15,000 per annum Apprenticeship Standard: ST0119 v1.2 – Digital and Technology Solutions Degree (Software Engineer pathway) Key Responsibilities Model & Data Pipeline Development Assist in collecting, cleaning, validating, and preparing data for training and evaluation. Support the design, development, and tuning of machine learning and deep learning models. Contribute … to scalable and reusable data pipelines using modern ML workflows. Experimentation & Evaluation Conduct experiments and benchmarking exercises to test model performance. Perform error analysis, feature importance, and other model diagnostics. Track and log training/testing outcomes to support reproducibility and model versioning. Engineering Contributions Help build and integrate AI-powered APIs, scripts, and microservices. Collaborate on backend More ❯

ranks 189 on the Fortune 500. Further information about Lear is available at or on Position overview: As an Application Solution Architect, you will design and implement scalable, data-driven solutions using Palantir Foundry. You'll work closely with business stakeholders, data engineers, and developers to translate business needs into robust technical architectures that leverage Foundry … technical constraints. Design scalable and efficient data models and ontologies within Foundry. Define and oversee the development of data pipelines and workflows using Foundry's Pipeline Builder and Code Repositories. Lead integration of external systems and APIs into Foundry for seamless data flow. Work with cross-functional teams to gather requirements, define architecture … TECHNICAL/PERSONNEL SKILLS : Experience designing scalable data models and ontologies. Understanding of semantic data modelling and entity relationships. Familiarity with Foundry's Ontology SDK, Pipeline Builder, and Code Workspaces. Experience integrating external systems and APIs into Foundry. Knowledge of data transformation, cleansing, and enrichment techniques. Awareness of data privacy, access More ❯

Wood Mackenzie is the global data and analytics business for the renewables, energy, and natural resources industries. Enhanced by technology. Enriched by human intelligence. In an ever-changing world, companies and governments need reliable and actionable insight to lead the transition to a sustainable future. That's why we cover the entire supply chain with unparalleled breadth and … committed - we put customers at the heart of our decisions Future Focused - we accelerate change Curious - we turn knowledge into action Job Description We are looking for a Data Engineer who can leverage Python to build new data pipelines. Your role will sit within an Agile team developing backend data pipelines and processes, aligned … to our data roadmap for delivering new features for Wood Mackenzie's flagship product offering, Lens. You will work alongside other Data Engineers, business SMEs, product and data owners to ensure Wood Mackenzie delivers a world-class experience for its customers - helping them change the way we power our planet. Main Responsibilities As part More ❯

CONTRACT PALANTIR DATA ENGINEER - DV CLEARED NEW OUTSIDE IR35 CONTRACT OPPORTUNITY AVAILABLE WITHIN A HIGHLY SECURE DELIVERY PROGRAMME FOR A DV CLEARED PALANTIR FOUNDRY DATA ENGINEER. Contract opportunity for a Palantir Data Engineer to support cutting-edge National Security projects £600 - £750 per day (Outside IR35) DV clearance is essential Based full-time onsite … using Foundry tools like Workshop Strong communication skills to collaborate with technical and military/non-technical stakeholders Experience integrating data from multiple sources into Foundry via Pipeline Builder and custom code Comfortable working on-site within a secure environment and at pace with end-users TO BE CONSIDERED... . Please either apply by clicking online or … consent for us to process and submit your application to our client in conjunction with this vacancy only. KEY SKILLS: PALANTIR/FOUNDARY/DATA ENGINEER/PIPELINE BUILDER/ONTOLOGY/PYTHON/TYPESCRIPT/FULL STACK/DV CLEARED/LONDON/CONTRACT More ❯

CONTRACT PALANTIR DATA ENGINEER - DV CLEARED NEW OUTSIDE IR35 CONTRACT OPPORTUNITY AVAILABLE WITHIN A HIGHLY SECURE DELIVERY PROGRAMME FOR A DV CLEARED PALANTIR FOUNDRY DATA ENGINEER. Contract opportunity for a Palantir Data Engineer to support cutting-edge National Security projects £600 - £750 per day (Outside IR35) DV clearance is essential Based full-time onsite … using Foundry tools like Workshop Strong communication skills to collaborate with technical and military/non-technical stakeholders Experience integrating data from multiple sources into Foundry via Pipeline Builder and custom code Comfortable working on-site within a secure environment and at pace with end-users TO BE CONSIDERED... . Please either apply by clicking online or … consent for us to process and submit your application to our client in conjunction with this vacancy only. KEY SKILLS: PALANTIR/FOUNDARY/DATA ENGINEER/PIPELINE BUILDER/ONTOLOGY/PYTHON/TYPESCRIPT/FULL STACK/DV CLEARED/LONDON/CONTRACT More ❯

Job Title: Data & Migration Workstream Lead Location: London (Hybrid 1-2 days) Job Type: Full-time, Permanent Salary: £100,000 - £115,000 + Benefits Industry: Financial Technology A leading FinTech client based in London is seeking a hands-on … Data & Migration Workstream Lead to own and deliver all data-related activities across complex projects. This role requires strong expertise in data migration, pipeline development, and stakeholder management within banking or fintech environments, experience in BaaS is highly desirable. You'll lead data migration strategy, execution, and governance, ensuring smooth, high … quality transitions aligned with business goals. Key Responsibilities: Lead end-to-end delivery of the Data & Migration workstream across multiple programmes Develop robust data pipelines and reporting solutions to meet client and business needs Act as primary liaison between clients, technical teams, and workstream leads Define migration strategy, data mapping, validation, and support dress More ❯

healthcare. We work with leaders and frontline teams to improve health, transform healthcare, embed life science innovation and boost growth through investment. With unmatched access to UK healthcare data and award-winning data science expertise, our team are a driving force for delivering positive and meaningful change. Everyone at CF is passionate about healthcare. We understand … diagnostics, and health tech companies as well as their investors. We support the life sciences industry in the uptake of innovation including access, pathway transformation, and use of data & digital, and how they partner with health systems to improve patient outcomes. We have achieved Chartered Management Consulting (ChMC) accreditation for our learning and development programme, the highest recognition … have seen our staff develop, grow and be promoted to the leadership team. Whether your preference is to follow a path in the consulting team or in the data innovation team, the learning and development programme will set you up for success. Year One Training: In your first year, you will undergo a comprehensive training programme designed to More ❯

Viya 4. - Support the migration of Legacy SAS platforms to cloud native SAS Viya 4 environments, including namespace separation and Kubernetes orchestration. - Implement and manage configuration objects, service data, and translation objects within SAS environments. - Collaborate with data engineers and DevOps teams to integrate SAS with Oracle, GitLab CI/CD pipelines, and other enterprise platforms. … Monitor and optimise platform performance, ensuring high availability and compliance with security standards. - Provide technical support and troubleshooting for SAS users and developers. - Automate environment provisioning and data transfers using approved EA integration patterns. - Participate in community knowledge sharing and contribute to best practice documentation. Key Experience: - SAS Enterprise Guide (EG) - workflow orchestration and user support. - SAS Data … Viya 4 - platform configuration, migration, and containerisation (Kubernetes). - SAS Visual Analytics (VA) and SAS Visual Investigator (VI) - dashboard and investigation tool support. - Oracle - integration and data pipeline support. - Configuration Management - experience managing service objects, deployment artefacts, and environment baselines. - Testing Lifecycle Knowledge - including test strategy design, environment comparison utilities, and automated testing integration. - Experience with cloud More ❯

Metyis is growing! We are looking for a Data Science Principal with +8 years of experience to join our Data and Analytics team in London. Who we are Metyis is a global and forward-thinking firm operating across a wide range of industries, developing and delivering Big Data, Digital Commerce, Marketing & Design solutions and … management oversight required to meet client expectations. Responsibilities may include overall project delivery quality, development of presentations, and managing of external relationships. Function as a sounding board for data and analytics related questions of client business leadership. Seek compelling opportunities beyond the scope of the current project. Provide guidance to more junior members of the team, while orchestrating … consulting experience or relevant industry experience, with at least 3+ years at a project lead level. Master (or Ph.D.) degree in a quantitative field with a focus on data analysis (e.g. econometrics, AI, mathematics, physics, and other exact sciences). Sharp thinking ability to be able to quickly differentiate major contributors from irrelevant details and to hierarchically structure More ❯

The Data Analyst will be responsible for collecting, processing, and analysing data to support strategic decision-making & planning across the business. Role Analyse large datasets to identify trends, patterns, and insights Develop and maintain dashboards and reports using tools like Power BI Perform data cleaning, transformation, and validation to ensure accuracy and quality Collaborate … with stakeholders to gather requirements and deliver data solutions Conduct A/B tests and statistical analysis to inform business decisions Monitor key performance indicators (KPIs) and provide regular performance reports Work with data engineering teams to improve data pipelines and data architecture Present findings to stakeholders through visualisations and presentations Training … All work uploaded to Aptem Monthly college release days (online or face to face) Potential full-time position Apprenticeship Standard Data analyst (level 4) Training Provider BRADFORD COLLEGE Working Week Monday - Thursday 07:30am - 16:15. Friday 07:30am - 12.45pm. Expected Duration 2 Years Positions Available 1 Closing Date Thursday, 14th August 2025 Start Date Wednesday, 20th August More ❯

Data Engineer | £60-65K | London (5 days p/w Onsite) Build a greenfield data platform from scratch! This logistics company is halfway through a massive digital transformation. Legacy monoliths are being dismantled, replaced with a clean, cloud-native, modular stack - and the new data team is central to making it all talk. … You'll be working directly with their Head of Data, building Azure-based pipelines from the ground up, and shaping how the company uses data across 50+ systems. There's real investment, real urgency, and real interest in doing this properly - not endless meetings and PowerPoints. What you'll be doing: Designing, building, and optimising Azure … based data pipelines using Databricks, PySpark, ADF, and Delta Lake Implementing a medallion architecture - from raw to curated Collaborating with analysts to make data business-ready Applying CI/CD and DevOps best practices (Git, Azure DevOps) Supporting the team's growth with clean, well-documented code Exploring real-time logistics datasets What they're looking More ❯

Head of Data Engineering Manchester (Hybrid)Permanent Full-timeSalary: £100,000 - £120,000 (DOE) A major UK financial services organisation is seeking a visionary Head of Data Engineering to lead and scale its enterprise-wide data platforms. Youll drive the design and delivery of modern data solutions across cloud, analytics, and core … banking systems — enabling smarter decisions, customer innovation, and regulatory excellence. Key Responsibilities: Lead and develop high-performing data engineering teams Architect scalable, secure data pipelines and platforms (Azure, Databricks, etc.) Partner with product, risk, and tech leaders to deliver data-driven outcomes Champion best practices in data governance, quality, and DevOps What … You’ll Bring: Proven leadership in large-scale data engineering within complex environments Deep technical expertise in cloud-native data architecture Strong strategic thinking and stakeholder engagement skills Passion for transforming legacy systems into modern, value-driving platforms This is a rare opportunity to shape the future of data in a trusted institution committed More ❯

Head of Data Engineering Manchester (Hybrid) Permanent Full-time Salary: £100,000 - £120,000 (DOE) A major UK financial services organisation is seeking a visionary Head of Data Engineering to lead and scale its enterprise-wide data platforms. Youll drive the design and delivery of modern data solutions across cloud, analytics, and … core banking systems — enabling smarter decisions, customer innovation, and regulatory excellence. Key Responsibilities: Lead and develop high-performing data engineering teams Architect scalable, secure data pipelines and platforms (Azure, Databricks, etc.) Partner with product, risk, and tech leaders to deliver data-driven outcomes Champion best practices in data governance, quality, and DevOps … What You'll Bring: Proven leadership in large-scale data engineering within complex environments Deep technical expertise in cloud-native data architecture Strong strategic thinking and stakeholder engagement skills Passion for transforming legacy systems into modern, value-driving platforms This is a rare opportunity to shape the future of data in a trusted institution More ❯

Position at Everyday Health - Professional The Opportunity We're looking for a Senior Data Quality Analyst to join our fast-paced Data & Analytics team. This team supports internal operations and client-facing work by ensuring the accuracy and reliability of data pipelines, audience segmentation, and reporting. You'll take ownership of quality checks across … the data lifecycle-from ingestion to delivery-and work closely with engineers, analysts, and stakeholders to drive high standards and solve issues quickly. Strong communication and collaboration are key to this role. Key Responsibilities Own and manage QA processes for data pipelines, campaign outputs, and reporting across Databricks, SQL Server, Looker, and QuickPivot Build automated tests … to catch data issues early and ensure clean, reliable data throughout workflows Test all changes and new development before they go live Work closely with engineering, business intelligence, data science and operations teams to identify and resolve issues quickly Maintain clear documentation of QA processes and testing standards Investigate data quality problems More ❯

ideal candidate will have extensive hands-on experience building and implementing ELK solutions from the ground up-not just monitoring existing systems. Key Responsibilities: Design, build, and implement data ingestion pipelines using Logstash and Kafka Set up and configure the ELK Stack (Elasticsearch, Logstash, Kibana), including Fleet and Integrations Collaborate with stakeholders to analyze data and … availability, and reliability of the ELK environment Maintain and support the ELK stack and its integrations Apply domain knowledge in security and cloud environments to enhance data pipeline resilience and compliance Mandatory Skills & Qualifications: 8+ years of hands-on experience with Elasticsearch , Logstash , and Kibana Proven track record of implementing and maintaining ELK stacks Experience designing and … developing data pipelines Strong exposure to cloud platforms (e.g., AWS, Azure, GCP) Proficiency with Kafka for data streaming and ingestion Background or familiarity in the security domain Deep understanding of ELK ecosystem components including Fleet , Beats , and advanced Kibana dashboards Strong problem-solving and analytical skills Desirable: Experience with Elastic Security or Observability solutions Certification in More ❯

artifacts for complex applications while being accountable for ensuring design constraints are met by software code development Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to … to software engineering communities of practice and events that explore new and emerging technologies Adds to team culture of diversity, equity, inclusion, and respect Build and maintain scalable data pipelines for batch and near real-time processing Optimize data workflows for performance, cost and reliability Required qualifications, capabilities, and skills Formal training or certification on software … engineering concepts and proficient advanced experience in Data Engineering such as Python and SQL Hands-on practical experience in system design, application development, testing, and operational stability Proficient in coding in one or more languages Experience in developing, debugging, and maintaining code in a large corporate environment with one or more modern programming languages and database querying languages More ❯

Are you a SQL Server expert with a passion for data architecture and engineering in the fast-paced world of finance? We're looking for a Front Office Data Engineer/Data Architect to join a high-performing team at the heart of a leading financial institution. The Role: You'll be embedded within … the Front Office Technology Team, reporting directly to the team lead and collaborating closely with four other talented data engineers. This is a hybrid role, offering the flexibility of remote work combined with the energy of on-site collaboration. What You'll Be Doing: Designing, developing, and maintaining robust data pipelines and architectures Working with modern … Microsoft SQL Server (2016 or later) in an on-prem environment Supporting front office operations with real-time, high-quality data solutions Leveraging tools like Azure Data Factory, Microsoft Python, and Azure Fabric (if you have them!) What We're Looking For: Strong experience with Microsoft SQL Server (2016+) - this is a must-have Solid background More ❯

small teams of exceptional people, who are relentlessly resourceful to solve problems and find smarter solutions than the status quo Build the best technology in-house , using new data sources, machine learning and AI to make machines do the heavy lifting About the Role As a Data Platform Engineer, you'll help shape and scale our … data infrastructure, making analytics faster, more reliable, and cost-efficient. You'll work with AWS, Snowflake, Python, and Terraform, building tooling, and onboarding new data sources. You'll collaborate closely with teams across the business, ensuring our platform is secure, scalable, and easy to use. Our team mission We want to maximise business value by improving … efficiency in our Analytics, enhancing Lendable's competitive advantage through data utilisation. This means our Data Platform is designed to streamline the efficiency of analysis in extracting insights from data, while also ensuring cost control, compliance, and security. What will you be doing? This is a non-exhaustive list of the activities you would More ❯

Senior Data Engineers with a background are required by this major client, who is creating a new start up engineering capability in their Leeds offices, where you will provide best in class Data Engineering services to a wide range of major Public Sector organisations. As a result of the work that they do, this client requires … national or dual UK national. Please note your application will not be taken forward if you cannot fulfil these requirements. In order to secure one of these Senior Data Engineer roles you must be able to demonstrate the following experience: Experience in prominent languages such as Python, Scala, Spark, SQL. Good experience in using Databricks Experience working with … Knowledge and experience using at least one Data Platform Technology such as Quantexa, or Palantir Knowledge of test automation frameworks and ability to automate testing within the pipeline This is an opportunity for significant growth, but with a start-up feel and mentality. In this role you will have the chance to build and be part of More ❯