101 to 125 of 915 Data Pipeline Jobs in the UK

Machine Learning Engineer role at Lumilinks Group Ltd Join to apply for the Machine Learning Engineer role at Lumilinks Group Ltd About us: Turning the fantasy of analytics, data and A.I. into reality. In a world where vast amounts of data are being created in a multitude of different ways, Lumilinks exist to help companies collate … and use data in an automated and compliant way, creating live and actionable insights. We help businesses across the entire data journey, eliminating silos and creating data transparency. This allows our clients to be data confident in making strategic and tactical decisions that will further their business and create automation that improves … actionable insights. The Day Job Developing and Maintaining ML Platforms : You will be responsible for developing and maintaining platforms and systems that automate the end-to-end machine learning pipeline, which encompasses building, training, testing, deploying, monitoring, and updating machine learning models. Implementing CI/CD Pipelines : Implement and maintain continuous integration and continuous deployment (CI/CD) pipelines More ❯

Place Informatics is helping redefine how the UK's leading organisations understand people and places. We transform billions of data points on movement and demographics into powerful insights that drive smarter decisions in Retail, Tourism, Local Government, Outdoor Leisure and Real Estate. As part of our passionate team, you'll help the team who unlock patterns in human … that make a real-world impact. If you're driven by curiosity and want your work to influence the future of location analytics, join us and help make data work smarter. About the Role: Senior Database Administrator (DBA)/Data Ops Engineer You will be responsible for the management, optimisation, and reliability of our databases and … implement processes for loading, validating, and managing data sets Ensure data security, integrity, and compliance with relevant standards Automate routine database and data pipeline tasks to improve efficiency Support the development and deployment of new data-driven products and features Collaborate with cross-functional teams to deliver high-quality data More ❯

growth Google Cloud consultancy. At Qodea, you'll be part of a team energised by innovation and passionate about delivering exceptional results. We craft cutting-edge solutions in data and analytics, AI, cloud infrastructure and security, driving digital transformation that empowers our customers to scale, modernise and lead in their industries. We're driven by ideas and powered … by our people. We are looking for a Senior Data Engineer to deliver solutions that surpass our customers expectations, by utilising cutting-edge tools and technologies. We really value in-person collaboration, so we're looking for you to spend at least 60% of your time on-site. This means being at our company offices or at a … client's site. How You'll Shape Our Success The purpose of this role is to design, build, and maintain scalable data pipelines and infrastructure that enable the efficient processing and analysis of large, complex data sets. What You'll Do Develop and maintain automated data processing pipelines using Google Cloud: Design, build, and More ❯

We do energy differently - we do it all. We make it, store it, move it, sell it, and mend it. About your team: Youll be joining Centricas Group Data function, working in close partnership with our Data Science and Data Governance teams. Together, were building a data ecosystem that powers strategic decision … making and enables the creation of reusable, high-quality data assets across the business. About your role: As Head of Data Engineering , youll lead the design, development, and optimisation of Centricas data infrastructure. Youll define and execute a forward-thinking data engineering strategy, ensuring our pipelines and platforms are scalable, secure, and … aligned with business goals. Youll mentor a high-performing team, collaborate across departments, and champion best practices in data management, governance, and technology adoption. Youll also work closely with the Head of Data Science to ensure our infrastructure supports advanced analytics and modelling, enabling the organisation to harness data-driven insights effectively. Regular travel More ❯

We do energy differently - we do it all. We make it, store it, move it, sell it, and mend it. About your team: Youll be joining Centricas Group Data function, working in close partnership with our Data Science and Data Governance teams. Together, were building a data ecosystem that powers strategic decision … making and enables the creation of reusable, high-quality data assets across the business. About your role: As Head of Data Engineering , youll lead the design, development, and optimisation of Centricas data infrastructure. Youll define and execute a forward-thinking data engineering strategy, ensuring our pipelines and platforms are scalable, secure, and … aligned with business goals. Youll mentor a high-performing team, collaborate across departments, and champion best practices in data management, governance, and technology adoption. Youll also work closely with the Head of Data Science to ensure our infrastructure supports advanced analytics and modelling, enabling the organisation to harness data-driven insights effectively. Regular travel More ❯

still grounded in our founding principle that people are at the centre of all we do. Each day, we apply this belief to harness the transformative power of data and technology to inspire and move people and business forward. With more than 7,000 employees in over 100 offices around the world, we are the flagship Publicis Media … high demand. If you are passionate about shaping the future of AI and thrive on complex, high-impact challenges, we encourage you to apply. Responsibilities As a Senior Data Engineer for AI/ML, you will be the architect and builder of the data infrastructure that feeds our intelligent systems. Your responsibilities will include: Design and … Build Scalable Data Pipelines: Architect, implement, and optimize robust, high-performance real-time and batch ETL pipelines to ingest, process, and transform massive datasets for LLMs and foundational AI models. Cloud-Native Innovation: Leverage your deep expertise across AWS, Azure, and/or GCP to build cloud-native data solutions, ensuring efficiency, scalability, and cost-effectiveness. More ❯

a great place to work and as our business expands, we are looking for ambitious, talented people to join us. We are looking for a technically proficient Senior Data Engineer to join our growing Data team. Your primary focus will be on ensuring data quality, stability, and reliability … from the moment data arrives in its rawest form to when it is used in decision-making dashboards and customer-facing reports. You will optimise the transformation pipeline from start to finish, guaranteeing that datasets are robust, tested, secure, and business-ready. Our data platform is built using Databricks, with data pipelines written … in PySpark and orchestrated using Airflow. You will be expected to challenge and improve current transformations, ensuring they meet our performance, scalability, and data governance needs. This includes work with complex, nested data structures, ensuring they are reliably parsed and transformed. Experience in managing sensitive data (PII) and implementing GDPR policies is required. You More ❯

Curve is a next-gen insights, analytics and technology consultancy that leverages digital consumer data and advanced technology to help businesses unlock consumer opportunities. Digital consumer data is powerful; it's big, it's real, and it's always updating. We use a combination of in-house technology and bespoke solutions, powered by AI, to transform … data from sources such as Social, Reviews, Search, and broader marketing and sales data. These reveal fresh insights for our clients; helping them to build better products and brands, to deliver effective marketing to consumers. Our software, machine learning and AI are key to how we deliver impact, centred on: Natural Language Processing, GPT & other LLMs : unearthing trends … themes and other patterns from large text-based data sets, and deploying state-of-the-art AI to automate and empower consumer facing businesses and their insights & analytics functions Marketing Data Science & Personalisation : using first party consumer data to understand each client's consumer base, building personalisation and other machine learning models to better More ❯

Bloomberg runs on data. Our products are fueled by powerful information. We combine data and context to paint a complete picture for our clients-around the clock and around the world. In Data, we are responsible for delivering this data, news, and analytics through innovative technology-quickly and accurately. We apply product thinking, deep … domain expertise, and technical insight to continuously improve our data offerings, ensuring they remain reliable, scalable, and fit-for-purpose in a fast-changing landscape. Our Team: The Entities Data team is responsible for Bloomberg's core entity and issuer reference data-a foundational component of the financial data ecosystem. Entity data … and corporate structures. It provides critical linkages between datasets and is crucial for use cases including regulatory compliance, risk modeling, investment analysis, counterparty exposure, and ownership research. This data powers a wide range of financial applications-from mapping issuers to securities and understanding corporate hierarchies, to identifying exposure to private market entities and aggregating risk at the parent More ❯

Job Description: We are seeking a highly skilled Data Architect for Gen AI Engineering to lead the design and implementation of robust data architectures that support our generative AI initiatives across various business functions, including Marketing, Product Development, and Customer Insights. This role is transformation-funded and therefore has an expected end date of 31st December … 2026. What are we looking for? • A seasoned data architect with 8+ years of experience in data architecture and engineering, specifically in the context of generative AI and machine learning applications. • Strong expertise in designing scalable data models and architectures, with proficiency in … cloud platforms such as AWS, GCP, or Azure, and familiarity with data warehousing solutions. • Experience with data integration tools, ETL processes, and data pipeline development, along with a solid understanding of data governance and security best practices. • Proven leadership skills in managing cross-functional teams, driving data strategy, and More ❯

New Permanent Opportunity available with a leading National Security Organisation for an eDV cleared Data Engineer in Gloucester Gloucester location – hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who … to the National Security sector, delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You’ll work with cutting-edge technologies including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework and are set for significant growth. What will the … Data Engineer be Doing? You will develop mission-critical data solutions and manage pipelines that transform diverse data sources into valuable insights for our client’s National Security customers. You will collaborate with clients to solve complex challenges, utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design More ❯

Data Engineer - Azure/Microsoft Fabric City of London - Hybrid Working Circa £55-65k + Bonus & Benefits Our client, a forward-thinking and globally connected staffing & consulting organization is seeking a skilled and driven Data Engineer to join their growing Data & Analytics team. Based in the City of London, this role presents a … fantastic opportunity for someone with 2-3 years of data engineering experience who is passionate about building robust data solutions using Microsoft Azure and Microsoft Fabric technologies. This is a hands-on technical role where you'll work closely with the Lead Data Architect and collaborate across the business to design, build, and support … scalable data infrastructure that powers business intelligence, reporting, and analytics. The ideal candidate will be eager to grow their skills and take ownership of impactful data projects within a fast-paced, modern tech environment. Key Responsibilities: Design, develop, and maintain data pipelines and data warehousing solutions using Azure services Work with stakeholders More ❯

totaled $13.8 billion. Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver data solutions and integration pipelines in accordance with agreed organizational standards that ensure services are resilient, scalable and … cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data platforms which involves Cloud & related technologies, Graph databases, Virtualization Technology Perspective Worked in multiple large distributed mission critical applications as an architect. Proven experience as architect and engineering lead … in Data & Analytics stream. In-depth understanding of data structure principles and data platforms Used Architecture tools for modelling. Working experience on Modern data platforms which involves Cloud & related technologies Keeps track of industry trends and incorporates new concepts Advanced understanding of AI concepts , LLMS, RAG, Agentic apps Advance Understanding in Data More ❯

totaled $13.8 billion. Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver data solutions and integration pipelines in accordance with agreed organizational standards that ensure services are resilient, scalable and … cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data platforms which involves Cloud & related technologies, Graph databases, Virtualization Technology Perspective Worked in multiple large distributed mission critical applications as an architect. Proven experience as architect and engineering lead … in Data & Analytics stream. In-depth understanding of data structure principles and data platforms Used Architecture tools for modelling. Working experience on Modern data platforms which involves Cloud & related technologies Keeps track of industry trends and incorporates new concepts Advanced understanding of AI concepts , LLMS, RAG, Agentic apps Advance Understanding in Data More ❯

Team: Kore Intelligence Platform engineering Two Circles is a leading data-driven sports agency helping rights holders build stronger, more valuable relationships with their audiences. We blend sports expertise, data science, and technology to help sports organisations grow direct relationships with their fans, increase revenue, and enhance their partner propositions. With a passionate, high-performing team … Overview We're looking for a Technical Product Manager to work on the KORE Intelligence platform. You'll be joining a team responsible for a core suite of data products that transforms fragmented fan data into meaningful, actionable insights. You'll take ownership of backend-heavy capabilities that allow our clients to unify, understand, and activate … their audience data . This includes managing data ingestion frameworks, segmentation infrastructure, and the tooling used by internal teams to deliver commercial outcomes at scale. You'll work closely with external vendors, internal engineering and data teams, and cross-functional stakeholders to to build secure, scalable, and highly performant systems that support campaigns, personalization More ❯

As a Data Engineer, you will design, build, and maintain data pipelines and solutions to support business needs. This role involves leveraging your technical expertise to enable data-driven decision-making. Client Details Data Engineer - Surrey - Hybrid Our client is a well-established organisation undergoing a significant digital and data transformation. With a focus on innovation and technology, they are investing in building modern, cloud-based data capabilities to drive smarter decision-making, improve customer experience, and support future growth. This is an exciting time to join a business that is placing data at the heart of its strategy and creating opportunities for impactful … work across the organisation Description Data Engineer - Surrey - Hybrid As the Data Engineer you will help design, build, and scale a modern Azure-based data platform. This is your chance to play a key role in shaping how data is used to drive smarter decisions and real business impact. Develop, maintain, and More ❯

is a company of Euronext, the leading pan-European exchange in the Commcise is seeking an experienced and passionate individual to join our team to: build-out new Data Products integrate AI into existing business functionality. As a Data Product Developer, you'll play a crucial role in shaping our data-driven solutions. This … position can be considered "Full Stack", combining Data Science analysis with engineering solutions for final product delivery to our clients. We're looking for someone with a positive, entrepreneurial mindset who can collaborate effectively with cross-functional teams to build innovative data products and seamlessly integrate AI capabilities into our existing business functionality. The role entails … in data product development. Strong understanding of data structures, algorithms, and statistical concepts. Proficiency in Python and ETL frameworks Deep knowledge of data pipeline architectures and products such as Snowflake or similar Experience with delivering data products to clients via APIs Familiarity with data visualization tools Knowledge of locating More ❯

Capital, Slow Ventures (Sam Lessin), Helios Partners (Souleymane Ba), Crossbeam Ventures (Ali Hamed), Nikesh Arora, Samih Toukan, and many other context-specific angels The Role As a Senior Data Engineer, you will create components of a modern data platform that will be the foundation of Taptap Send's decision-making ability. The systems you help create … the success of TTS. You will play a critical part in the functioning of every team, with stakeholders ranging from customer success, growth, markets, product, and finance. The Data Engineer will be implementing critical data pipelines, and innovating and improving infrastructure to support these pipelines while advancing best practices in privacy and data and … information security. Responsibilities Apply automation mindset and DevSecOps principles to data systems and architectures Integrate with APIs of 3rd party data sets to enable data pipelines and reporting use cases Build data systems and pipelines using SaaS systems like AWS and DBT Cloud Build solutions to various business objectives using your technical More ❯

Role: Senior Data Engineer Salary/Rate: £600-700 per day inside IR35 Location: hybrid multiple locations available, 2 days on siteContract Duration: 4 months, potential to extend We are currently looking for a Senior Data Engineer for our government client. This Senior Data Engineer role is hybrid, based between 2 days per week … on site and the remainder of the week working remotely. Office locations include most major towns, with London being a preference. The contract for the Senior Data Engineer position is for 4-months with potential to extend, operating inside IR35. Security Clearance: Security Check ("SC Clearance") This role is inside IR35 - Due to the service of the role … it will now be based on an Umbrella solution. Essential skills/experience required: Strong experience designing, building and maintaining data pipelines using modern, cloud-based tools and practices Proficiency in Python and SQL for data engineering tasks Experience with DBT and a good understanding of data modelling approaches (e.g. star schema, dimensional modelling More ❯

Data Engineering Specialist (Assembly, Bristol, United Kingdom) Why this job matters Defending BT Group against cyber-attacks is the focus of PBT Cyber Operations. BT faces threats from the full range of threat actors from sophisticated threat nation state actors developing their tactics to new heights and targeting our industry, through to criminal groups seeking to monetize efforts … drives security decision making impacting all levels of the organization. As a large, distributed, multinational IT-based company, BT has a unique view of global cyber threat, including data sets that have never been available to the industry before. We are developing novel and sophisticated ways of analysing this data to ensure we stay ahead in … this exciting and challenging environment. As an experienced data engineer, you will be responsible for developing and maintaining data pipelines, so that this highly skilled team of data scientists, data engineers and developers, continue to generate unique, innovative and impactful intelligence. This role is hybrid (3 days in office) & can be based More ❯

Join Barclays as a Digital Customer Data Engineer, where you'll be leading the development for a new shared data platform that is transforming how individuals/organisations interact with the bank. Your role involves using the latest data and AI engineering skills to deliver a digital capability. As part of our team, you … ll also benefit from being part of a vast professional network, collaborating with industry mentors and experts. To be successful you should have experience with: Modern data engineering practices, inc. event-driven and data lake. Digital platform development, inc. experience developing colleague and customer facing applications. Banking software development. Deep technical awareness of cloud and data technology, such as Kafka, Data Bricks, microservices, API. Some other highly valued skills may include: Technical design: Analysis and documentation of system characteristics, inc. designing solutions to meet multi-faceted non-functional requirements. Communication Skills: Ability to clearly convey project goals to senior leadership, updates, and technical details to stakeholders at all levels, including non-technical More ❯

About the role: We're looking for a hands-on Data Engineer to join us on a 12-month max-term contract and play a key role in supporting and scaling our growing data infrastructure. In this role, you'll be responsible for building and maintaining scalable ETL/ELT pipelines using Databricks and modern cloud … to temporarily support our business intelligence needs, developing and maintaining reports and dashboards in ThoughtSpot (or a similar BI platform). You'll collaborate closely with our Lead Data Engineer, who will provide architectural guidance and help drive the strategic direction of our data transformation initiatives. This role is a great fit for a data … data warehouse architecture. Translate business requirements into reliable and scalable data solutions. Collaborate with the Lead Data Engineer on data modeling, pipeline design, and cloud infrastructure best practices. Implement monitoring, alerting, and logging for data pipelines to ensure data integrity and reliability. Participate in sprint planning, technical More ❯

Job Position: Graduate Data Analyst (Engineer/Scientist) - via the Graduate Development Programme Locations: Sheffield and South Yorkshire Starting Salary: £25,000 Application Requirements: Minimum 2:1 or above in a STEM (Science, Technology, Engineering, and Math) subject. Experience in analysing data. Right to work in the UK unsponsored for the duration of the programme. Ability to work … delivering excellence. If you have a keen attention to detail and accuracy, a knack for spotting trends and patterns and the ability to tell a compelling story using data, you'll thrive in our environment. We value resourcefulness, resilience, and a passion for driving change. Join us and be part of a community that cares, collaborates, and thrives … together. Understanding the types of roles available to a Data Analyst: Data Analyst: Kick-start your career as a Data Analyst, where you'll transform complex data into actionable insights, create dynamic visualisations and drive business decisions. You'll work with cutting-edge tools, collaborate with stakeholders, and develop automated reports and More ❯

constituent of the FTSE 100 index of the London Stock Exchange. The Position Our roster has an opening with your name on it! We are seeking a Staff Data Engineer to lead the technical design and implementation of our most critical data infrastructure and products. In this senior-level individual contributor role, you'll be responsible … for designing scalable systems, setting data architecture standards, and solving complex technical challenges that power analytics, data science, and business function use cases across the company. You will collaborate closely with engineers, product managers, and business stakeholders to architect data solutions that are performant, reliable, and built with a long-term, customer-centric mindset. … batch & streaming data pipelines and architectures that support enterprise-wide data needs Define standards for data modeling, data product design, and pipeline orchestration using modern tools and cloud-native technologies Collaborate with cross-functional stakeholders to translate business and analytical requirements into end-to-end data solutions Establish and More ❯

throughout all levels of the client organization, generating results that allow our clients to thrive. What You'll Do Join a dynamic team transforming our organization into a data-driven enterprise! The Data Layer Team is where we build essential data platforms, data products, and capabilities to empower our clients and colleagues … with high-quality, actionable insights. Our Data Layer Team focuses on creating scalable data solutions and advancing our data infrastructure to drive informed decision-making across the company. As a Quality Engineer on the Data Layer Team, you will play a vital role in upholding engineering and quality best practices across our … data infrastructure. You will design and implement robust testing strategies to validate scalable data pipelines and ensure data accuracy, integrity, and performance across our platforms. Collaborating closely with data engineers, solution architects, product owners, and technical leads, you'll help deliver trusted data solutions that power critical business insights. This More ❯