76 to 100 of 908 Data Pipeline Jobs in the UK

Octopus Investments and Octopus Money. Check out the Seccl website for the latest on our products and our mission to shape the future of investments. The role The Data Squad engineering manager's purpose is to lead and empower a high-performing team of data engineers to deliver scalable, reliable, and secure data capabilities. … This role is central to enabling internal and external data products, supporting business insights, and developing a modern data platform. The role will work closely with Product, Engineering, and Data Operations to align delivery with business outcomes, support the team's growth, and help shape our overall data strategy. On a typical … day you will Guide and mentor, a team of data engineers, fostering their professional growth and ensuring high performance.Setting clear, measurable goals with regular performance reviews, development plans, and recognition. Collaborate with product managers and engineering leaders to define priorities and align data initiatives with business goals. Provide technical guidance and architectural oversight across the data More ❯

Octopus Investments and Octopus Money. Check out the Seccl website for the latest on our products and our mission to shape the future of investments. The role The Data Squad engineering manager's purpose is to lead and empower a high-performing team of data engineers to deliver scalable, reliable, and secure data capabilities. … This role is central to enabling internal and external data products, supporting business insights, and developing a modern data platform. The role will work closely with Product, Engineering, and Data Operations to align delivery with business outcomes, support the team's growth, and help shape our overall data strategy. On a typical … day you will Guide and mentor, a team of data engineers, fostering their professional growth and ensuring high performance.Setting clear, measurable goals with regular performance reviews, development plans, and recognition. Collaborate with product managers and engineering leaders to define priorities and align data initiatives with business goals. Provide technical guidance and architectural oversight across the data More ❯

Octopus Investments and Octopus Money. Check out the Seccl website for the latest on our products and our mission to shape the future of investments. The role The Data Squad engineering manager's purpose is to lead and empower a high-performing team of data engineers to deliver scalable, reliable, and secure data capabilities. … This role is central to enabling internal and external data products, supporting business insights, and developing a modern data platform. The role will work closely with Product, Engineering, and Data Operations to align delivery with business outcomes, support the team's growth, and help shape our overall data strategy. On a typical … day you will Guide and mentor, a team of data engineers, fostering their professional growth and ensuring high performance.Setting clear, measurable goals with regular performance reviews, development plans, and recognition. Collaborate with product managers and engineering leaders to define priorities and align data initiatives with business goals. Provide technical guidance and architectural oversight across the data More ❯

Role: Data Engineer Role type: Permanent Location: UK or Greece Preferred start date: ASAP LIFE AT SATALIA As an organization, we push the boundaries of data science, optimization, and artificial intelligence to solve the hardest problems in industry. Satalia is a community of individuals devoted to working on diverse and interesting projects that will challenge you … multi-year roadmap. Your contributions will directly shape cutting-edge AI products and services that make a tangible impact for FTSE 100 clients. YOUR RESPONSIBILITIES Collaborate closely with data scientists, architects, and stakeholders to understand and implement business requirements. Support AI model development and deployment by providing data engineering expertise, ensuring data scientists have … access to the data they need in the required format. Implement and optimize data transformations and ETL/ELT processes using appropriate tools. Work with various databases and data warehousing solutions to store and retrieve data efficiently. Monitor, troubleshoot, and maintain data pipelines to ensure high data quality More ❯

ideal candidate will have deep expertise in cloud technologies (Azure), Infrastructure as Code (IaC), container orchestration, and CI/CD pipelines. An understanding of MLOps and data pipeline tools is also essential for integrating with our AI components. Core Responsibilities Cloud Platform & Infrastructure Management Design, implement, and manage secure and high-performance cloud infrastructure on the Microsoft … Orchestration Lead the deployment, scaling, and management of applications and services using Kubernetes and containerisation technologies like Docker. Manage infrastructure and resource allocation for all containerised applications and data systems. CI/CD and Automation Develop and maintain robust CI/CD pipelines to automate the build, test, and deployment of both our front-end and back-end … Implement monitoring, logging, and alerting solutions to ensure the health and performance of our platform. Promote a culture of automation across the development lifecycle. MLOps and Data Pipeline Integration Collaborate with data scientists and engineers to support the operationalization of machine learning models. Possess a strong understanding of data pipeline orchestration tools More ❯

achieving their strategic goals and empower our people to make an impact and develop their own unique career path. About the team and your role Our Digital and Data Advisory practice, as part of our broader Business Transformation client offering, consists of three teams: Digital Finance team working with clients to understand how their finance functions work, assisting … throughout their digital transformation journey from defining a digital strategy and roadmap, creating a business case, selecting the right software, documenting user stories, to managing and assuring projects. Data analytics and insights team working with clients to help them understand their level of data analytics maturity and to develop a data analytics strategy that … of maturity. We work with clients to identify KPIs and metrics they can use to track progress against their strategic objectives and to assess the quality of their data needed for those KPIs and metrics. We support clients with full life cycle data warehouse and business intelligence/analytics implementations including data warehouse design More ❯

Join to apply for the Data Solutions Architect -GCP role at EXL 2 days ago Be among the first 25 applicants Join to apply for the Data Solutions Architect -GCP role at EXL Get AI-powered advice on this job and more exclusive features. Senior Talent Acquisition Manager | Hiring for Data, AI, Tech & Digital … Transformation | Leadership Hiring | UK & Ireland | Driving Inclusive & EXL (NASDAQ: EXLS) is a global data and artificial intelligence (AI) company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. EXL harnesses the power of data, AI, and deep industry knowledge to transform businesses, including the worlds leading corporations … innovation, collaboration, excellence, integrity and respect. We are headquartered in New York and have more than 59,000 employees spanning six continents. For more information, visit Role Title: Data Solutions Architect (GCP) Location: London, United Kingdom (Flexible hybrid working) Employment Type: Permanent Summary of the role: The Data Solutions Architect at EXL plays a strategic, client More ❯

of educational apps for children ages 2 to 7. Our products are among the top 15 in the preschool apps category globally. We're looking for a skilled Data Engineer to design and maintain robust data infrastructure and pipelines, driving data accessibility and reliability across our platform. Working format: full-time, remote. Schedule: Monday … data quality, consistency, and availability . Support analysts: build user-friendly data marts and contribute to schema and data model design. Set up pipeline monitoring , alerting , and logging . Participate in architectural decisions and technology selection . Optimize existing data storage systems and complex SQL queries . Your goals and KPIs … source integrations, identifying bottlenecks and proposing improvements to enhance data reliability and performance. Key long-term goals: Architect and evolve the analytical data delivery pipeline into a standalone, scalable service. What we expect from you: 4+ years of experience as a Data Engineer, including 1+ year at a Senior level. Deep knowledge More ❯

We are looking to hire a additional 2 Data Engineers to join the Satalia Data Engineering Team. We are investing massively in developing next-generation AI tools for multimodal datasets and a wide range of applications. We are building large scale, enterprise grade solutions and serving these innovations to our clients and WPP agency partners. As … Your contributions will directly shape cutting-edge AI products and services that make a tangible impact for FTSE 100 clients. What you’ll be doing: Collaborate closely with data scientists, architects, and other stakeholders to understand and implement business requirements. Provide data engineering support for AI model development and deployment, ensuring data scientists have … access to the data they need in the format they need it. Implement and optimize data transformations and ETL/ELT processes, using appropriate data engineering tools. Work with a variety of databases and data warehousing solutions to store and retrieve data efficiently. Implement monitoring, troubleshooting, and maintenance procedures for More ❯

and want to take your career further in a thriving office environment? Are you a strong communicator who works well within a team? Do you understand data pipeline tools and data modelling? Were seeking an SQL Developer to join our expanding Database team in Leeds! In the role, you will: Analyse business requirements through collaboration … with stakeholders, IT Management, and the user community Develop new systems, integrate third-party platforms, and maintain existing applications Use data to deliver business improvements and support informed decision-making Work with stakeholders on data extraction and manipulation tasks Write and optimise in-application SQL statements Provide user support for report errors, debugging, and issue resolution … experience in a database developer/data engineer role Proficiency in SQL and Python Experience with cloud platforms (AWS, GCP, or Azure) Familiarity with data pipeline tools (e.g., SSIS, Spark) Strong grasp of data warehousing and data modelling principles Experience undertaking development work in C# Ability to create and troubleshoot SSRS More ❯

Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing category? If so, you might be … the ideal candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program, Digital First, has been mobilized by the Mars Pet Nutrition (PN) leadership team. Digital First places … pipelines, and infrastructure that supports advanced analytics and machine learning. DataOps & DevOps Enablement: Skilled in implementing CI/CD pipelines, observability standards, and modern engineering workflows to enhance pipeline reliability, agility, and operational efficiency. Technical Standards & Frameworks: Experience in defining and enforcing data engineering best practices, architectural patterns, and reusable frameworks across multiple product teams. Data More ❯

Data Engineer (Python SQL ETL) London/WFH to £80k Are you a tech savvy Data Engineer with experience of working with sensitive patient/healthcare data? You could be progressing your career as a Data Engineer working on Tech for Good application for the healthcare sector that utilises AI and Machine … Learning techniques to help prevent patients from experiencing health crisis. As a Data Engineer you will take ownership of the healthcare data pipelines and platforms, focussing on implementing robust ETL processes and scalable data architectures, collaborating with various teams to deliver high quality data solutions. You'll develop and maintain data infrastructure on Azure Data Lakes and Data Warehouses; create robust data transformation processes that ensure data quality, consistency and security and implement automation workflows. You will help to maintain compliance with ISO27001 and ISO13485 requirements for healthcare data management and ensure that security first practices are employed in More ❯

Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Responsibilities: Design, develop, and maintain robust and scalable ETL/ELT pipelines using Snowflake as the data warehouse. Implement data transformations and build analytical data models using dbt (data build tool). Develop and optimize complex SQL queries for data extraction, transformation, and loading in Snowflake. Orchestrate and schedule data workflows using Apache Airflow, including developing custom Python operators and DAGs. Write efficient and maintainable Python scripts for data processing, automation, and integration with various data sources and APIs. Ensure data quality, integrity, and governance throughout the data lifecycle. Collaborate with data analysts, data scientists, and business stakeholders to understand requirements and deliver data solutions. Implement and maintain CI/CD pipelines for data engineering processes, including version control with Git. Monitor data pipelines, troubleshoot issues, and optimize performance for efficiency and cost-effectiveness. Qualifications: Strong More ❯

Join us as a Data Platform Engineer for our client. At Peregrine, were always seeking Specialist Talent that have the ideal mix of skills, experience, and attitude, to place with our vast array of clients. From Business Analysts in large government organisations to Software Developers in the private sector we are always in search of the best talent … you will be deployed across our portfolio of clients as a specialist consultant, working on a wide array of complex projects across multiple industries. The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and on … with over 3 years of relevant experience in data engineering, platform engineering, or a related field, with demonstrated hands-on expertise in NiFi and data pipeline design in regulated environments. Responsibilities: Design, develop, and maintain robust and secure data pipelines using NiFi and related big data technologies. Troubleshoot and optimize NiFi More ❯

Data Engineering Analyst Duration: 6 Months (potential to extend) Location: Leeds or Edinburgh (Hybrid – 2 days per week in-office) About the Role: We’re looking for an experienced Data Engineering Analyst to join our team on a 6-month contract. In this role, you'll be instrumental in shaping our data infrastructure, enabling … seamless data flows, and delivering actionable insights through advanced analytics and visualization. What You’ll Be Doing: Design, build, and maintain data pipelines using GCP technologies such as BigQuery, Cloud Storage, and Cloud Dataflow Develop insightful dashboards and reports in Power BI to support key business decisions Write efficient, scalable Python code for data … Power BI for creating reports and dashboards Strong Python skills, including experience with data libraries like Pandas and NumPy Solid background in ETL processes, data pipeline design, and data warehousing Detail-oriented with excellent problem-solving and communication skills Nice to Have: Knowledge of data governance, quality, and security best practices More ❯

The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and on premises platforms. You will play a key role in ensuring that all data systems comply with industry regulations and security standards while … enabling efficient access for analytics and operational teams. A strong command of Apache NiFi is essential for this role. You will be expected to design, implement, and maintain data flows using NiFi, ensuring accurate, efficient, and secure data ingestion, transformation, and delivery. You should be adept at identifying and resolving issues within NiFi flows, managing performance … with over 3 years of relevant experience in data engineering, platform engineering, or a related field, with demonstrated hands-on expertise in NiFi and data pipeline design in regulated environments. Responsibilities: Design, develop, and maintain robust and secure data pipelines using NiFi and related big data technologies. Troubleshoot and optimize NiFi More ❯

AWS Data Engineering Manager (1 Braham Street, London, United Kingdom) Recruiter: BT Group was the world’s first telco and our heritage in the sector is unrivalled. As home to several of the UK’s most recognised and cherished brands – BT, EE, Openreach and Plusnet, we have always played a critical role in creating the future, and we … are on a path to creating the UK’s best telco, reimagining the customer experience and relationship with one of this country’s biggest infrastructure companies. The AWS Data Engineering Manager plays a mission-critical role in enabling BT’s DD Ops transformation by leading the design, implementation, and optimisation of data infrastructure that powers intelligent … ready solutions. Data Quality & Visibility: Coordinate the use of internal and external data sources to define and monitor key indicators of data quality, pipeline health, and infrastructure performance. Resource Management: Allocate engineering resources effectively to address priority issues, ensuring timely responses and measurable outcomes. Translate business objectives into scalable, end-to-end data More ❯

Azure Data Architect Remote UK £550-£750 per day (Outside IR35) 3-6 months contract (Possible Extension) An excellent opportunity awaits an experienced Data Architect with strong Azure experience looking to lead and architect a greenfield project. This company is an established business focused on operational and management solutions, specialising in monitoring services. In this role … you will join the data team and lead the design, build, and delivery of a brand-new data lake and data architecture from scratch. You will take full ownership of the data solution, including modelling and storage, working closely with senior stakeholders to define data strategy, governance, and structure tailored … to an SME environment. This is a remote position based in the UK. The ideal candidate will have extensive experience across the Azure Data stack, particularly with Azure Data Factory and Azure Synapse, and will be confident designing and delivering data lake and data warehouse solutions from the ground up. They will More ❯

Azure Data Architect Remote UK £550-£750 per day (Outside IR35) 3-6 months contract (Possible Extension) An excellent opportunity awaits an experienced Data Architect with strong Azure experience looking to lead and architect a greenfield project. This company is an established business focused on operational and management solutions, specialising in monitoring services. In this role … you will join the data team and lead the design, build, and delivery of a brand-new data lake and data architecture from scratch. You will take full ownership of the data solution, including modelling and storage, working closely with senior stakeholders to define data strategy, governance, and structure tailored … to an SME environment. This is a remote position based in the UK. The ideal candidate will have extensive experience across the Azure Data stack, particularly with Azure Data Factory and Azure Synapse, and will be confident designing and delivering data lake and data warehouse solutions from the ground up. They will More ❯

Who We Are BCG Expand is a specialist firm providing unique data-driven business intelligence as a trusted advisor to senior executives across the world's leading financial services firms to help them to operate more effectively. Expand's activities are focused on data benchmarking in technology, operations, FinTech and market data, with expertise … our professional, supportive and entrepreneurial working culture that we all enjoy. What You'll Do We're looking for a highly skilled Principal Engineer with a passion for data, cloud technologies, and building robust, scalable solutions - who also brings strategic product thinking and cross-functional leadership . In this role, you'll not only lead the design and … implementation of the data infrastructure that powers advanced analytics and data science across our platforms, but also contribute to the strategic direction, roadmap, and execution of data products in collaboration with senior stakeholders. Architect & Build Scalable Data Solutions Collaborate closely with senior product stakeholders to understand data needs and architect More ❯

Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £60,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital transformation and building a cloud-first, data-led approach to support major environmental goals. Think scalable pipelines, secure platforms, and data systems that … directly contribute to a greener future. As a Senior Data Engineer, you'll play a key role in designing and delivering robust, cloud-based data infrastructure. You'll work with large datasets, build scalable pipelines, and help ensure data is high quality, secure, and accessible, while mentoring more junior engineers and working closely with … stakeholders across the business. Key Responsibilities: Develop scalable and secure data architectures ensuring optimal data flow Cloud data platform development, data modelling, shaping and technical planning Implementing best practices around data security, governance, privacy, and compliance Ensure company data is secure, accurate, maintained and available. Mentor data More ❯

Senior Data Engineer Next-gen diagnostics start-up Take ownership of data strategy and architecture from the ground up. Flexible, remote-first working with visits to a high-impact biotech lab. Cutting-edge work combining AI, genomics, and diagnostics to save lives. Were working with a biotech start-up thats tackling one of modern medicines biggest … theyre scaling fast and now looking for their very first Data Engineer. Youll take the reins on all things data - shaping the architecture, strategy, and pipeline design that supports a life-saving platform. Youll be leading on the design and implementation of scalable, secure data pipelines - getting experimental and genomic data into formats that data scientists and machine learning engineers can easily work with. This role combines classic data engineering work with data management strategy, data lineage tracking, and storage infrastructure design; from cold archiving through to high-speed access for ML models, youll be the go-to person. You'll More ❯

enables customers to easily personalise their creations to keep for themselves or share as the most thoughtful of gifts. About The Role: We are looking for a Senior Data Platform Engineerto join our London-based data team and help us build a platform that accelerates a decentralised-by-design data adoption model within the … business. We care about trustable, usable data and we want you to bring your technical expertise to make that happen. You're a software engineer at heart, you thrive in the data domain and care deeply about customer outcome-focused engineering excellence. Day to day, you will build observable, scalable and resilient data services … that ingest data from source systems into consuming applications such as our data warehouse to meet the needs of analytics engineers and stakeholders. You will make significant contributions to solution designs, provide technical guidance to other team members and champion iterative approaches to software delivery. You will work within a cross-functional mission-led team, led More ❯

Machine Learning Engineer role at Lumilinks Group Ltd Join to apply for the Machine Learning Engineer role at Lumilinks Group Ltd About us: Turning the fantasy of analytics, data and A.I. into reality. In a world where vast amounts of data are being created in a multitude of different ways, Lumilinks exist to help companies collate … and use data in an automated and compliant way, creating live and actionable insights. We help businesses across the entire data journey, eliminating silos and creating data transparency. This allows our clients to be data confident in making strategic and tactical decisions that will further their business and create automation that improves … actionable insights. The Day Job Developing and Maintaining ML Platforms : You will be responsible for developing and maintaining platforms and systems that automate the end-to-end machine learning pipeline, which encompasses building, training, testing, deploying, monitoring, and updating machine learning models. Implementing CI/CD Pipelines : Implement and maintain continuous integration and continuous deployment (CI/CD) pipelines More ❯

Place Informatics is helping redefine how the UK's leading organisations understand people and places. We transform billions of data points on movement and demographics into powerful insights that drive smarter decisions in Retail, Tourism, Local Government, Outdoor Leisure and Real Estate. As part of our passionate team, you'll help the team who unlock patterns in human … that make a real-world impact. If you're driven by curiosity and want your work to influence the future of location analytics, join us and help make data work smarter. About the Role: Senior Database Administrator (DBA)/Data Ops Engineer You will be responsible for the management, optimisation, and reliability of our databases and … implement processes for loading, validating, and managing data sets Ensure data security, integrity, and compliance with relevant standards Automate routine database and data pipeline tasks to improve efficiency Support the development and deployment of new data-driven products and features Collaborate with cross-functional teams to deliver high-quality data More ❯