276 to 300 of 371 Data Pipeline Jobs in the UK excluding London

Data Engineer - Energy Consultancy £45,000 DOE | Full-Time, Permanent | Hybrid (Southampton) Join a company driving the UK's journey to net zero. We're hiring a Data Engineer for a purpose-led energy consultancy helping organisations reduce energy consumption, lower carbon emissions, and cut costs through innovative solutions and expert guidance. This is a fantastic … opportunity to join a tech-forward team committed to sustainability, professional development, and a collaborative working culture. The Role As a Data Engineer , you'll work as part of the dedicated Data Team to support internal reporting and external customer platforms. You'll design and maintain scalable pipelines using modern cloud technologies and help build a … robust new data platform for real-time analytics. Key Responsibilities: Own and deliver assigned data projects and BAU tasks Maintain data pipelines using Azure ADF and Synapse Analytics Transform raw CRM data into structured, curated datasets Develop event-driven data processes for internal and external use Contribute to best-practice More ❯

with an average profit share of £3,532-£10,861. Softwire is one of the UK's leading digital technology consultancies, offering services in data, AI, cloud, CX, innovation, design, and software engineering. We deliver high-profile, mission-critical, and transformational projects for household names across the public and private sectors. Founded on the idea to be the … Our culture and values emphasize doing jobs properly, making work fulfilling and fun, extending kindness, and trusting each other to reduce bureaucracy. In brief We seek well-rounded data engineers capable of tackling complex data challenges, impressing clients, and impacting team output. We offer a supportive environment with career development, mentorship, and diverse project opportunities. You … will work with talented developers and data engineers, supported by a Technical Lead, on projects such as: Data modeling for Moorfields Eye Hospital's INSIGHT programme Maintaining data pipelines and dashboards on Elexon's Azure platform Implementing AI transcription services for the BBC using GenAI Migrating legacy Excel workflows for a financial services firm More ❯

Comfortable providing technical guidance and helping resolve ambiguity on large-scale work. Preferred Qualifications Experience working with Gemini models and GCP-native AI tooling. Familiarity with real-time data pipelines or streaming architectures. Prior work on context-aware or intelligent product experiences. Experience with design systems or component libraries in a production setting. Passion for continuously learning and More ❯

Comfortable providing technical guidance and helping resolve ambiguity on large-scale work. Preferred Qualifications Experience working with Gemini models and GCP-native AI tooling. Familiarity with real-time data pipelines or streaming architectures. Prior work on context-aware or intelligent product experiences. Experience with design systems or component libraries in a production setting. Passion for continuously learning and More ❯

A popular British brand is seeking a an experienced Data Engineer to play a pivotal role in a major data modernization initiative. With offices just outside of Bristol, this role will require being on-site 3 days per week to collaborate with your team and business stakeholders. As part of a transformative project leveraging Microsoft Fabric … you'll lead the design and implementation of a scalable, metadata-driven Medallion architecture. You'll work closely with cross-functional teams to deliver robust, trusted, and timely data solutions that power advanced analytics and business intelligence. What You'll Do: Architect and build scalable data pipelines using Microsoft Fabric, PySpark, and T-SQL Lead the … development of Star Schema Lakehouse tables to support BI and self-service analytics Collaborate with stakeholders to translate business needs into data models and solutions Mentor engineers and act as a technical leader within the team Ensure data integrity, compliance, and performance across the platform What You'll Bring: Expertise in Microsoft Fabric, Azure, PySpark, SparkSQL More ❯

A popular British brand is seeking a an experienced Data Engineer to play a pivotal role in a major data modernization initiative. With offices just outside of Bristol, this role will require being on-site 3 days per week to collaborate with your team and business stakeholders. As part of a transformative project leveraging Microsoft Fabric … you'll lead the design and implementation of a scalable, metadata-driven Medallion architecture. You'll work closely with cross-functional teams to deliver robust, trusted, and timely data solutions that power advanced analytics and business intelligence. What You'll Do: Architect and build scalable data pipelines using Microsoft Fabric, PySpark, and T-SQL Lead the … development of Star Schema Lakehouse tables to support BI and self-service analytics Collaborate with stakeholders to translate business needs into data models and solutions Mentor engineers and act as a technical leader within the team Ensure data integrity, compliance, and performance across the platform What You'll Bring: Expertise in Microsoft Fabric, Azure, PySpark, SparkSQL More ❯

A popular British brand is seeking a an experienced Data Engineer to play a pivotal role in a major data modernization initiative. With offices just outside of Bristol, this role will require being on-site 3 days per week to collaborate with your team and business stakeholders. As part of a transformative project leveraging Microsoft Fabric … you'll lead the design and implementation of a scalable, metadata-driven Medallion architecture. You'll work closely with cross-functional teams to deliver robust, trusted, and timely data solutions that power advanced analytics and business intelligence. What You'll Do: Architect and build scalable data pipelines using Microsoft Fabric, PySpark, and T-SQL Lead the … development of Star Schema Lakehouse tables to support BI and self-service analytics Collaborate with stakeholders to translate business needs into data models and solutions Mentor engineers and act as a technical leader within the team Ensure data integrity, compliance, and performance across the platform What You'll Bring: Expertise in Microsoft Fabric, Azure, PySpark, SparkSQL More ❯

A popular British brand is seeking a an experienced Data Engineer to play a pivotal role in a major data modernization initiative. With offices just outside of Bristol, this role will require being on-site 3 days per week to collaborate with your team and business stakeholders. As part of a transformative project leveraging Microsoft Fabric … you'll lead the design and implementation of a scalable, metadata-driven Medallion architecture. You'll work closely with cross-functional teams to deliver robust, trusted, and timely data solutions that power advanced analytics and business intelligence. What You'll Do: Architect and build scalable data pipelines using Microsoft Fabric, PySpark, and T-SQL Lead the … development of Star Schema Lakehouse tables to support BI and self-service analytics Collaborate with stakeholders to translate business needs into data models and solutions Mentor engineers and act as a technical leader within the team Ensure data integrity, compliance, and performance across the platform What You'll Bring: Expertise in Microsoft Fabric, Azure, PySpark, SparkSQL More ❯

CONTRACT PALANTIR DATA ENGINEER - DV CLEARED NEW OUTSIDE IR35 CONTRACT OPPORTUNITY AVAILABLE WITHIN A HIGHLY SECURE DELIVERY PROGRAMME FOR A DV CLEARED PALANTIR FOUNDRY DATA ENGINEER. Contract opportunity for a Palantir Data Engineer to support cutting-edge National Security projects £600 - £750 per day (Outside IR35) DV clearance is essential Based full-time onsite … using Foundry tools like Workshop Strong communication skills to collaborate with technical and military/non-technical stakeholders Experience integrating data from multiple sources into Foundry via Pipeline Builder and custom code Comfortable working on-site within a secure environment and at pace with end-users TO BE CONSIDERED... . Please either apply by clicking online or … consent for us to process and submit your application to our client in conjunction with this vacancy only. KEY SKILLS: PALANTIR/FOUNDARY/DATA ENGINEER/PIPELINE BUILDER/ONTOLOGY/PYTHON/TYPESCRIPT/FULL STACK/DV CLEARED/LONDON/CONTRACT More ❯

apply End Date: September 5, 2025 (30+ days left to apply) job requisition id R Role Summary: This role demands skills and perseverance to modernise tech stacks and data pipelines of well established StarMine Quant models in Python to provided specifications, and to build brand-new quantitative/predictive models with help of machine learning algorithms working in … collaboration with our data science and Research teams. Build data pipelines to break down complicated calculations into stages. Main Responsibilities/Accountabilities: We engage with product owners, architects and other specialists to craft and build sophisticated, world-class analytics models to address our customer needs. Building and maintaining efficient, reusable, reliable and secure enterprise software, adhering … like Terraform. Proficient with Git. Proficient with CI/CD automation using GitLab or similar. Azure Fabric experience Vision to use machine learning and AI algorithms to the data Education/Certifications: A relevant degree or equivalent experience is desirable, but the right approach to work is just as important. AWS/Azure certification a nice to have. More ❯

Job Title : Commercial Data Analyst - SQL Location : Didcot, Oxfordshire (Hybrid - 3 days in office, 2 days remote) Salary : £55,000 + Excellent Benefits Introduction Are you passionate about turning complex data into actionable insights? We have a fantastic opportunity for a skilled Commercial Data Analyst to join an exciting company in the retail sector … in the office, with 2 days from home. The company, a leader in sustainable retail, has been in business for over a decade and is known for leveraging data to drive customer experiences and business growth. Duties & Responsibilities Collaborate with data and tech teams to manage data pipelines across eCommerce platforms using GTM/… supply/demand across regions. Analyze customer acquisition channels, calculating ROI and attribution for various marketing efforts. What Experience is Required? At least 5 years of experience in data analysis with a strong focus on data extraction, analysis, and manipulation. Excellent experience in margins, revenue and pricing. Expertise in GTM/GA4, BigQuery, SQL, and Excel More ❯

a new scrum team within Minerva Platform to develop and deliver the Ingestion and Risking within the SAS Platform including IDP. Key Responsibilities: Design, development, and deployment of data integration and transformation solutions using Pentaho, Denodo, Talend, and SAS. Architect and implement scalable data pipelines and services that support business intelligence and analytics platforms. Collaborate with … cross-functional teams to gather requirements, define technical specifications, and deliver robust data solutions. Champion Agile and Scrum methodologies, ensuring timely delivery of sprints and continuous improvement. Drive DevOps practices for CI/CD, automated testing, and deployment of data services. Mentor and guide junior engineers, fostering a culture of technical excellence and innovation. Ensure data quality, governance, and security standards are upheld across all solutions. Troubleshoot and resolve complex data issues and performance bottlenecks. Key Skills: SAS 9.4 (DI), SAS Viya 3.x (SAS Studio, VA, VI). Platform LSF, Jira, Platform Support. GIT. Strong expertise in ETL tools: Pentaho, Talend. Experience with data virtualisation using Denodo. Proficiency in SAS More ❯

a new scrum team within Minerva Platform to develop and deliver the Ingestion and Risking within the SAS Platform including IDP. Key Responsibilities: Design, development, and deployment of data integration and transformation solutions using Pentaho, Denodo, Talend, and SAS. Architect and implement scalable data pipelines and services that support business intelligence and analytics platforms. Collaborate with … cross-functional teams to gather requirements, define technical specifications, and deliver robust data solutions. Champion Agile and Scrum methodologies, ensuring timely delivery of sprints and continuous improvement. Drive DevOps practices for CI/CD, automated testing, and deployment of data services. Mentor and guide junior engineers, fostering a culture of technical excellence and innovation. Ensure data quality, governance, and security standards are upheld across all solutions. Troubleshoot and resolve complex data issues and performance bottlenecks. Key Skills: SAS 9.4 (DI), SAS Viya 3.x (SAS Studio, VA, VI). Platform LSF, Jira, Platform Support. GIT. Strong expertise in ETL tools: Pentaho, Talend. Experience with data virtualisation using Denodo. Proficiency in SAS More ❯

a new scrum team within Minerva Platform to develop and deliver the Ingestion and Risking within the SAS Platform including IDP. Key Responsibilities: Design, development, and deployment of data integration and transformation solutions using Pentaho, Denodo, Talend, and SAS. Architect and implement scalable data pipelines and services that support business intelligence and analytics platforms. Collaborate with … cross-functional teams to gather requirements, define technical specifications, and deliver robust data solutions. Champion Agile and Scrum methodologies, ensuring timely delivery of sprints and continuous improvement. Drive DevOps practices for CI/CD, automated testing, and deployment of data services. Mentor and guide junior engineers, fostering a culture of technical excellence and innovation. Ensure data quality, governance, and security standards are upheld across all solutions. Troubleshoot and resolve complex data issues and performance bottlenecks. Key Skills: SAS 9.4 (DI), SAS Viya 3.x (SAS Studio, VA, VI). Platform LSF, Jira, Platform Support. GIT. Strong expertise in ETL tools: Pentaho, Talend. Experience with data virtualisation using Denodo. Proficiency in SAS More ❯

a new scrum team within Minerva Platform to develop and deliver the Ingestion and Risking within the SAS Platform including IDP. Key Responsibilities: Design, development, and deployment of data integration and transformation solutions using Pentaho, Denodo, Talend, and SAS. Architect and implement scalable data pipelines and services that support business intelligence and analytics platforms. Collaborate with … cross-functional teams to gather requirements, define technical specifications, and deliver robust data solutions. Champion Agile and Scrum methodologies, ensuring timely delivery of sprints and continuous improvement. Drive DevOps practices for CI/CD, automated testing, and deployment of data services. Mentor and guide junior engineers, fostering a culture of technical excellence and innovation. Ensure data quality, governance, and security standards are upheld across all solutions. Troubleshoot and resolve complex data issues and performance bottlenecks. Key Skills & Experience: SAS 9.4 (DI), SAS Viya 3.x (SAS Studio, VA, VI). Platform LSF, Jira, Platform Support. GIT. Strong expertise in ETL tools: Pentaho, Talend. Experience with data virtualization using Denodo. Proficiency in More ❯

a new scrum team within Minerva Platform to develop and deliver the Ingestion and Risking within the SAS Platform including IDP. Key Responsibilities: Design, development, and deployment of data integration and transformation solutions using Pentaho, Denodo, Talend, and SAS. Architect and implement scalable data pipelines and services that support business intelligence and analytics platforms. Collaborate with … cross-functional teams to gather requirements, define technical specifications, and deliver robust data solutions. Champion Agile and Scrum methodologies, ensuring timely delivery of sprints and continuous improvement. Drive DevOps practices for CI/CD, automated testing, and deployment of data services. Mentor and guide junior engineers, fostering a culture of technical excellence and innovation. Ensure data quality, governance, and security standards are upheld across all solutions. Troubleshoot and resolve complex data issues and performance bottlenecks. Key Skills & Experience: SAS 9.4 (DI), SAS Viya 3.x (SAS Studio, VA, VI). Platform LSF, Jira, Platform Support. GIT. Strong expertise in ETL tools: Pentaho, Talend. Experience with data virtualization using Denodo. Proficiency in More ❯

a new scrum team within Minerva Platform to develop and deliver the Ingestion and Risking within the SAS Platform including IDP. Key Responsibilities: Design, development, and deployment of data integration and transformation solutions using Pentaho, Denodo, Talend, and SAS. Architect and implement scalable data pipelines and services that support business intelligence and analytics platforms. Collaborate with … cross-functional teams to gather requirements, define technical specifications, and deliver robust data solutions. Champion Agile and Scrum methodologies, ensuring timely delivery of sprints and continuous improvement. Drive DevOps practices for CI/CD, automated testing, and deployment of data services. Mentor and guide junior engineers, fostering a culture of technical excellence and innovation. Ensure data quality, governance, and security standards are upheld across all solutions. Troubleshoot and resolve complex data issues and performance bottlenecks. Key Skills & Experience: SAS 9.4 (DI), SAS Viya 3.x (SAS Studio, VA, VI). Platform LSF, Jira, Platform Support. GIT. Strong expertise in ETL tools: Pentaho, Talend. Experience with data virtualization using Denodo. Proficiency in More ❯

Lead Services Engineer - GridOS", you will act as the technical lead, as well as an individual contributor, on these engagements, contributing to software implementation, design and configuration of data models, troubleshooting, customizations, upgrades, and integration into customer systems while balancing scope versus project time and resource commitments. This role is expected to deliver, develop and tailor GridOS modules … to fit the customer needs. A strong understanding of electrical network data structures, GIS technologies, and SCADA/ADMS systems is essential. GridOS is a comprehensive software portfolio developed by GE Electrification Software to modernize and transform the electric grid into a smart and clean energy grid. It is an advanced and scalable energy management system that transforms … real-time data into actionable insights and provides utilities with advanced tools to manage the increasing complexity of energy systems. By integrating energy data, network modeling, and AI/ML-driven analytics, GridOS aims to enhance grid reliability, resilience, and efficiency, even in severe weather conditions. By integrating an Advanced Distribution Management System, a robust Outage More ❯

and speech-to-speech tasks Translating academic and internal research into scalable, maintainable code and services Developing and maintaining training pipelines, inference services, and deployment workflows Implementing robust data pipelines for sourcing, preprocessing, and versioning multimodal datasets Collaborating with research scientists to refine model architectures and integrate the latest techniques into production Evaluating model performance with custom metrics More ❯

What you’ll be doing We’re looking for someone who has experience guiding teams and supporting clients to use data to make better decision making. Data is at the heart of everything we do and we're working on some amazing projects across both our Health and Private clients. If you're interested in being … involved in work that delivers real value then we'd love to hear from you! What you’ll bring to Answer Designing and implementing complex data pipelines, leveraging both NoSQL and relational databases. Develop and manage cloud-based data solutions, ensuring scalability and security. Lead and mentor junior data engineers, promoting knowledge sharing and … professional growth. Implement and oversee CI/CD pipelines, ensuring efficient deployment of data services. Proficiency in Python, SQL, and other relevant backend languages. Utilise backend programming languages effectively for data processing and manipulation. It would be great if you also had experience in some of these, but if not we’ll help you with them More ❯

as specialist practices Publicis Media Exchange (PMX), Performics, Publicis Sport & Entertainment, Publicis Media Content and NextTECHnow. Together they combine deep expertise in media investment, strategy, insights and analytics, data and technology, commerce, performance marketing and content. Publicis Media is part of Publicis Groupe and is present in more than 100 countries with over 23,500 employees worldwide. Our … encourages applications from underrepresented groups. We are committed to equality of opportunity and welcome applications from individuals, regardless of their background. Job Description We are looking for a Data Engineer to join our Product Development team. You will work closely with the Scrum Master to deliver our technical builds, approach, and prioritisation. Are you a developer, data or software engineer with experience working with advertising/media dataset, and a history of creating data pipelines and structures that can be used in front end applications or creating automations that make data work harder? If so this is the role for you! Qualifications To be successful in this role you will need More ❯

DOE) + Benefits SQL Database Developer needed for a permanent career opportunity based in Derby . A chance to join an established + growing software business who develop data solutions for large Retail brands. Must be willing to work in the Derby office on a full-time basis. Start ASAP during Summer 2025. Key experience + responsibilities: Designing … SQL Server database solutions that power core business applications. Strong hands-on SQL Server database development skills including: complex stored procedures T-SQL, indexing, relational/dimensional modelling, data dashboards. Building/optimising data pipelines and integrations across cloud platforms. Any cloud platforms experience would be helpful including: such as Snowflake, Databricks, BigQuery, Azure SQL. Working … closely with key stakeholders including data architects, analysts, testers and managers. Working across the full SQL development life-cycle including: design, development, documentation and testing. Advantageous Skills: Power BI, NoSQL, Azure Synapse, data visualisation tools, Data Lakes, streaming technologies, MDM, Git, DevOps pipelines. Benefits include: to £50k Base (DOE) + 25 days holiday (plus More ❯

on experience Working Hours – 37.5 hours a week, Monday to Friday We are the brand behind world-class brands. We deliver unparalleled customer management, marketing, payment, technology and data solutions, making us the largest and most strategically aligned full-service provider for publishers globally. We have earned the trusted confidence of a wide range of companies supporting over … brands globally The Analytics Engineer will join a strong team who design, develop, deploy and maintain scalable data pipelines and analytics solutions. The Analytics Engineer is responsible for creating, enhancing and maintaining reporting services to meet requests for new functionality and support internal and external users. The Analytics Engineer will also be responsible for resolving support requests in … collaborate with cross-functional teams and translate business requirements into technical solutions. A very strong command of SQL, both Athena and MSSQL A good understanding of methods for data manipulation, analysis, and automation tasks. Experience with Microsoft SSIS ETL pipelines. Experience with AWS tools such as S3, Glue, Redshift, Lambda, and Athena for building scalable data More ❯

days per month on site in Telford and is inside IR35 so will require working via an FCSA accredited umbrella company. Key Responsibilities: Design, development, and deployment of data integration and transformation solutions using Pentaho, Denodo, Talend, and SAS. Architect and implement scalable data pipelines and services that support business intelligence and analytics platforms. Collaborate with … cross-functional teams to gather requirements, define technical specifications, and deliver robust data solutions. Champion Agile and Scrum methodologies, ensuring timely delivery of sprints and continuous improvement. Drive DevOps practices for CI/CD, automated testing, and deployment of data services. Mentor and guide junior engineers, fostering a culture of technical excellence and innovation. Ensure data quality, governance, and security standards are upheld across all solutions. Troubleshoot and resolve complex data issues and performance bottlenecks. Key Skills: SAS 9.4 (DI), SAS Viya 3.x (SAS Studio, VA, VI). Platform LSF, Jira, Platform Support. GIT. Strong expertise in ETL tools: Pentaho, Talend. Experience with data virtualization using Denodo. Proficiency in SAS More ❯

a new scrum team within Minerva Platfrom to develop and deliver the Ingestion and Risking within the SAS Platform including IDP. Key Responsibilities: Design, development, and deployment of data integration and transformation solutions using Pentaho, Denodo, Talend, and SAS. Architect and implement scalable data pipelines and services that support Business Intelligence and analytics platforms. Collaborate with … cross-functional teams to gather requirements, define technical specifications, and deliver robust data solutions. Champion Agile and Scrum methodologies, ensuring timely delivery of sprints and continuous improvement. Drive DevOps practices for CI/CD, automated testing, and deployment of data services. Mentor and guide junior engineers, fostering a culture of technical excellence and innovation. Ensure data quality, governance, and security standards are upheld across all solutions. Troubleshoot and resolve complex data issues and performance bottlenecks. Key Skills: SAS 9.4 (DI), SAS Viya 3.x (SAS Studio, VA, VI). Platform LSF, Jira, Platform Support. GIT. Strong expertise in ETL tools: Pentaho, Talend. Experience with data virtualization using Denodo. Proficiency in SAS More ❯