101 to 125 of 484 Data Pipeline Jobs in the UK excluding London

Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing category? If so, you might be … the ideal candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program, Digital First, has been mobilized by the Mars Pet Nutrition (PN) leadership team. Digital First places … processing tools. Stron g technical proficiency in data modelin g , SQL, NoSQL databases, and data warehousing . Hands-on experience with data pipeline development, ETL processes, and big data technolo g ies (e. g ., Hadoop, Spark, Kafka). Proficiency in cloud platforms such as AWS, Azure, or Goo g More ❯

hunt for builders . No, we've not ventured into construction in our quest to conquer the world, rather a designer and builder of systems for all things data related where we are conquering the Data World. We can offer an interesting insight into projects spanning a variety of sectors, which may include industries such as … to explore our dynamic team where you can truly act as an expert in your field in support of our clients and their challenges in the world of data and technology, read on! The Team We're Intuita - a fast growing consultancy that's making waves in both the consultancy and technology space. With our ambitious goals for … in the data pipelines. • Stay updated with the latest Azure technologies and industry best practices to continuously enhance data engineering capabilities. Looking at our current pipeline of work, we can also consider those with an Analytics Engineering lean, with experience within BigQuery (GCP) with data modelling in DBT and mobile/telecoms industry More ❯

Join Ten10 as a Software Development Engineer in Test (Data Automation Focus) Job Type: Permanent Location: London (Hybrid working with occasional client travel) Passionate about data and automation? At Ten10, were at the forefront of helping organisations harness the power of data through quality engineering and innovative test solutions. Were looking for a Software … Development Engineer in Test (SDET) with a strong focus on data automation to join our dynamic team. If you're driven by complex data challenges and thrive in high-performance environments where ETL testing has become second nature, this is the role for you. ?? Important: All applicants must be eligible for SC clearance Why Ten10? At … one of the UKs leading independent Quality Engineering, Software Testing, and DevOps consultancies. We empower top-tier organisations to accelerate software delivery while maintaining confidence in qualityespecially in data-driven environments. Heres why youll love working with us: Data-Driven Projects: Collaborate on exciting and complex data pipelines, platforms, and automation solutions across industries More ❯

Senior Machine Learning Operations Engineer Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £65,000 - £75,000 - depending on experience Department: Technology and Data We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they … our colleagues too; we won Insurance Employer of the Year at the British Insurance Awards 2024 and our Glassdoor score is pretty mega too! We're big on data: it gives us the insights we need to give the right cover to the right customers at the right price. But it's the people inside and outside our … Deploying Infrastructure as Code (IAC) across various environments such as dev, uat and prod Handling large volumes of data in various stages of the data pipeline, from ingestion to processing Proven experience with feature stores, using them for both offline model development and online production usage Building integrations between cloud-based systems using APIs, specifically More ❯

Senior Machine Learning Operations Engineer Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £65,000 - £75,000 - depending on experience Department: Technology and Data We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they … our colleagues too; we won Insurance Employer of the Year at the British Insurance Awards 2024 and our Glassdoor score is pretty mega too! We're big on data: it gives us the insights we need to give the right cover to the right customers at the right price. But it's the people inside and outside our … Deploying Infrastructure as Code (IAC) across various environments such as dev, uat and prod Handling large volumes of data in various stages of the data pipeline, from ingestion to processing Proven experience with feature stores, using them for both offline model development and online production usage Building integrations between cloud-based systems using APIs, specifically More ❯

Senior Machine Learning Operations Engineer Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £65,000 - £75,000 - depending on experience Department: Technology and Data We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they … our colleagues too; we won Insurance Employer of the Year at the British Insurance Awards 2024 and our Glassdoor score is pretty mega too! We're big on data: it gives us the insights we need to give the right cover to the right customers at the right price. But it's the people inside and outside our … Deploying Infrastructure as Code (IAC) across various environments such as dev, uat and prod Handling large volumes of data in various stages of the data pipeline, from ingestion to processing Proven experience with feature stores, using them for both offline model development and online production usage Building integrations between cloud-based systems using APIs, specifically More ❯

Job Title: Senior Data Engineer Location: Warwick, Hybrid - 2 days per week onsite Remuneration: Up to £650 per day Contract Details: Fixed Term Contract (6 months) Working Pattern: Full Time Join a leading organisation dedicated to connecting people to the energy they use safely, reliably, and efficiently! We're on the lookout for a talented Senior Data Engineer to elevate our data capabilities and drive our projects forward. If you're passionate about data engineering and thrive in a dynamic environment, we want to hear from you! Responsibilities: Lead the design, development, and maintenance of large-scale data systems, including data warehouses, data lakes, and … data pipelines. Create and manage ETL processes using tools like Matillion for seamless data integration. Develop and maintain data warehouse objects such as tables, views, and security roles in Snowflake. Extract data from various sources, ensuring accuracy and consistency throughout the process. Transform and cleanse data, implementing data More ❯

Octopus Investments and Octopus Money. Check out the Seccl website for the latest on our products and our mission to shape the future of investments. The role The Data Squad engineering manager's purpose is to lead and empower a high-performing team of data engineers to deliver scalable, reliable, and secure data capabilities. … This role is central to enabling internal and external data products, supporting business insights, and developing a modern data platform. The role will work closely with Product, Engineering, and Data Operations to align delivery with business outcomes, support the team's growth, and help shape our overall data strategy. On a typical … day you will Guide and mentor, a team of data engineers, fostering their professional growth and ensuring high performance.Setting clear, measurable goals with regular performance reviews, development plans, and recognition. Collaborate with product managers and engineering leaders to define priorities and align data initiatives with business goals. Provide technical guidance and architectural oversight across the data More ❯

Octopus Investments and Octopus Money. Check out the Seccl website for the latest on our products and our mission to shape the future of investments. The role The Data Squad engineering manager's purpose is to lead and empower a high-performing team of data engineers to deliver scalable, reliable, and secure data capabilities. … This role is central to enabling internal and external data products, supporting business insights, and developing a modern data platform. The role will work closely with Product, Engineering, and Data Operations to align delivery with business outcomes, support the team's growth, and help shape our overall data strategy. On a typical … day you will Guide and mentor, a team of data engineers, fostering their professional growth and ensuring high performance.Setting clear, measurable goals with regular performance reviews, development plans, and recognition. Collaborate with product managers and engineering leaders to define priorities and align data initiatives with business goals. Provide technical guidance and architectural oversight across the data More ❯

Principal Data Engineer - Bristol (hybrid 50:50) - Up to £80,000 (+bonus and great package) Our client are creating a new data platform to be the engine-room of their new digital products and tools. They need a hands on, talented Principal Data Engineer who can demonstrate versatility and has a broad of skills … from designing, implementing, and maintaining data pipelines, developing data solutions, configuring cloud environments, establishing new processes and adhering to strong governance. The successful candidate will be an experienced data engineering professional with 5+ years’ experience. The position is very likely to grow into a 'head of' role over time. You will scope, design and … Git for source code management and collaboration in a development environment o Experience using CI/CD best practices and tools like Azure DevOps to automate data pipeline deployment. o Experience with scripting languages like Python, particularly in data engineering tasks like data processing, automation, and integrating with external systems (e.g., APIs, databases More ❯

City & Capital are currently representing a highly respected & fast-growing property finance lender who are achieving exciting growth. They have engaged our services to appoint a technical & experienced Data Architect who will take oversight of the company’s overall data architecture. The Company Our client is known for supporting property developers & investors with access to funds … in their sector & ahead of the pack in terms of innovation and engagement with tech and systems that drive business performance and lending efficiency. The Department & Team The Data Architect is a senior member of the IT department and will work closely with the Head of IT and CTO on critical projects that drive the growing technological landscape … of the firm. The IT team is set to grow considerably in light of the planned projects, making the appointment of a capable and forward thinking data architect absolutely critical to success. The department works closely with senior leaders & users in operational departments, so the capacity to communicate across the business is a firm requirement for this role. More ❯

Data Architect (18-Month Fixed Term Contract) Salary: £65,000 - £72,000 per annum + benefits Location: London/Hybrid Our client is underway with an exciting Transformation Programme and is looking to recruit an experienced Data Architect. The role is critical in helping to shape their future as a data-led organisation.The Data … will be instrumental in building the foundational architecture, governance and strategy needed to bring that vision to life. Key Responsibilities Include Defining and owning the enterprise and commercial data strategy aligned with the digital transformation goals Establishing data governance policies, metadata standards, data stewardship roles, and classification models Designing scalable data architecture … that integrates corporate services and operational data systems Architect data pipelines and semantic layers to support BI, advanced analytics, and future AI capabilities. Presenting data models, architecture diagrams, and governance strategies to executive and technical stakeholders Key Skills Required Demonstrable hands-on systems integration and enterprise-scale data strategy experience Expertise in More ❯

seeking an experienced Product Owner to become an integral part of our Agile development team. In this role, you'll drive the evolution and implementation of Finance and data products, ensuring high-quality, accessible, and trusted data that fuels analytics, machine learning, and personalised experiences. You will work cross-functionally to create data products … that empower teams across the business, from marketing to operations, and enable insight-driven decisions. Acting as the bridge between Finance business stakeholders, data scientists, analysts and engineers, you'll manage the Finance product backlog and ensure continuous delivery of capabilities that align with enterprise objectives. Acting as a liaison between stakeholders and the development team, you will … translate the product vision into a prioritised & actionable backlog that maximizes business value while ensuring to addresses customer needs. About You Strong experience as a Product Owner or Data Product Owner in Agile environments. Ideally experience managing Finance and data products or platforms, ideally data warehouses (e.g. Snowflake, BigQuery), or data lakes. More ❯

and want to take your career further in a thriving office environment? Are you a strong communicator who works well within a team? Do you understand data pipeline tools and data modelling? Were seeking an SQL Developer to join our expanding Database team in Leeds! In the role, you will: Analyse business requirements through collaboration … with stakeholders, IT Management, and the user community Develop new systems, integrate third-party platforms, and maintain existing applications Use data to deliver business improvements and support informed decision-making Work with stakeholders on data extraction and manipulation tasks Write and optimise in-application SQL statements Provide user support for report errors, debugging, and issue resolution … experience in a database developer/data engineer role Proficiency in SQL and Python Experience with cloud platforms (AWS, GCP, or Azure) Familiarity with data pipeline tools (e.g., SSIS, Spark) Strong grasp of data warehousing and data modelling principles Experience undertaking development work in C# Ability to create and troubleshoot SSRS More ❯

Head of Enterprise Data Engineering - FCDO - G6 London, Milton Keynes or East Kilbride - You will be required to work from this location in line with FCDO policies on Hybrid Working (minimum 60% in the office). About the job Job summary The Foreign, Commonwealth & Development Office pursues our national interests and projects the UK's role in the … Directorate (IDD) is responsible for delivering the Foreign Secretary's ambition to make the FCDO the most technologically integrated and innovative foreign ministry globally. This means harnessing digital, data, technology, IT security and information management to support the FCDO and UK Government partners on our platform to deliver our diplomatic, development and consular aims. All while keeping our … to global network management, from supporting staff in using the latest Microsoft toolsets, to creating corporate applications, harnessing AI and much more in line with the FCDO Digital, Data and Technology (DDaT) Strategy. The Directorate is made up of a wide range of talented staff and experts including specialist, contractors, home civil servants and diplomats who have served More ❯

Head of Enterprise Data Engineering - FCDO - G6 London, Milton Keynes or East Kilbride - You will be required to work from this location in line with FCDO policies on Hybrid Working (minimum 60% in the office). About the job Job summary The Foreign, Commonwealth & Development Office pursues our national interests and projects the UK's role in the … Directorate (IDD) is responsible for delivering the Foreign Secretary's ambition to make the FCDO the most technologically integrated and innovative foreign ministry globally. This means harnessing digital, data, technology, IT security and information management to support the FCDO and UK Government partners on our platform to deliver our diplomatic, development and consular aims. All while keeping our … to global network management, from supporting staff in using the latest Microsoft toolsets, to creating corporate applications, harnessing AI and much more in line with the FCDO Digital, Data and Technology (DDaT) Strategy. The Directorate is made up of a wide range of talented staff and experts including specialist, contractors, home civil servants and diplomats who have served More ❯

Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £60,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital transformation and building a cloud-first, data-led approach to support major environmental goals. Think scalable pipelines, secure platforms, and data systems that … directly contribute to a greener future. As a Senior Data Engineer, you'll play a key role in designing and delivering robust, cloud-based data infrastructure. You'll work with large datasets, build scalable pipelines, and help ensure data is high quality, secure, and accessible, while mentoring more junior engineers and working closely with … stakeholders across the business. Key Responsibilities: Develop scalable and secure data architectures ensuring optimal data flow Cloud data platform development, data modelling, shaping and technical planning Implementing best practices around data security, governance, privacy, and compliance Ensure company data is secure, accurate, maintained and available. Mentor data More ❯

Senior Data Engineer Next-gen diagnostics start-up Take ownership of data strategy and architecture from the ground up. Flexible, remote-first working with visits to a high-impact biotech lab. Cutting-edge work combining AI, genomics, and diagnostics to save lives. Were working with a biotech start-up thats tackling one of modern medicines biggest … theyre scaling fast and now looking for their very first Data Engineer. Youll take the reins on all things data - shaping the architecture, strategy, and pipeline design that supports a life-saving platform. Youll be leading on the design and implementation of scalable, secure data pipelines - getting experimental and genomic data into formats that data scientists and machine learning engineers can easily work with. This role combines classic data engineering work with data management strategy, data lineage tracking, and storage infrastructure design; from cold archiving through to high-speed access for ML models, youll be the go-to person. You'll More ❯

Place Informatics is helping redefine how the UK's leading organisations understand people and places. We transform billions of data points on movement and demographics into powerful insights that drive smarter decisions in Retail, Tourism, Local Government, Outdoor Leisure and Real Estate. As part of our passionate team, you'll help the team who unlock patterns in human … that make a real-world impact. If you're driven by curiosity and want your work to influence the future of location analytics, join us and help make data work smarter. About the Role: Senior Database Administrator (DBA)/Data Ops Engineer You will be responsible for the management, optimisation, and reliability of our databases and … implement processes for loading, validating, and managing data sets Ensure data security, integrity, and compliance with relevant standards Automate routine database and data pipeline tasks to improve efficiency Support the development and deployment of new data-driven products and features Collaborate with cross-functional teams to deliver high-quality data More ❯

a great place to work and as our business expands, we are looking for ambitious, talented people to join us. We are looking for a technically proficient Senior Data Engineer to join our growing Data team. Your primary focus will be on ensuring data quality, stability, and reliability … from the moment data arrives in its rawest form to when it is used in decision-making dashboards and customer-facing reports. You will optimise the transformation pipeline from start to finish, guaranteeing that datasets are robust, tested, secure, and business-ready. Our data platform is built using Databricks, with data pipelines written … in PySpark and orchestrated using Airflow. You will be expected to challenge and improve current transformations, ensuring they meet our performance, scalability, and data governance needs. This includes work with complex, nested data structures, ensuring they are reliably parsed and transformed. Experience in managing sensitive data (PII) and implementing GDPR policies is required. You More ❯

A Manchester based FMCG is seeking a highly skilled Senior/LeadData Engineer to join their growing data team. This role will be instrumental in designing, building, and maintaining a modern data warehouse and data infrastructure to support advanced analytics and reporting needs for a fast-growing organisation. Key Responsibilities: Design, develop, and maintain … scalable data pipelines using SQL and Python (PySpark) . Ingest, transform, and curate data from multiple sources into Azure Data Lake and Delta Lake formats. Build and optimize datasets for performance and reliability in Azure Databricks . Collaborate with analysts and business stakeholders to translate data requirements into robust technical solutions. Implement … and maintain ETL/ELT pipelines using Azure Data Factory or Synapse Pipelines . Design and develop a fit-for-purpose enterprise data warehouse to serve reporting and analytics. Ensure data quality, data integrity, and adherence to governance policies. Monitor and troubleshoot production jobs and processes. Preferred Skills & Experience: Strong proficiency in More ❯

Job Description: We are seeking a highly skilled Data Architect for Gen AI Engineering to lead the design and implementation of robust data architectures that support our generative AI initiatives across various business functions, including Marketing, Product Development, and Customer Insights. This role is transformation-funded and therefore has an expected end date of 31st December … 2026. What are we looking for? A seasoned data architect with 8+ years of experience in data architecture and engineering, specifically in the context of generative AI and machine learning applications. Strong expertise in designing scalable data models and architectures, with proficiency in … cloud platforms such as AWS, GCP, or Azure, and familiarity with data warehousing solutions. Experience with data integration tools, ETL processes, and data pipeline development, along with a solid understanding of data governance and security best practices. Proven leadership skills in managing cross-functional teams, driving data strategy, and More ❯

Data Engineer - Azure/Microsoft Fabric City of London - Hybrid Working Circa £55-65k + Bonus & Benefits Our client, a forward-thinking and globally connected staffing & consulting organization is seeking a skilled and driven Data Engineer to join their growing Data & Analytics team. Based in the City of London, this role presents a … fantastic opportunity for someone with 2-3 years of data engineering experience who is passionate about building robust data solutions using Microsoft Azure and Microsoft Fabric technologies. This is a hands-on technical role where you'll work closely with the Lead Data Architect and collaborate across the business to design, build, and support … scalable data infrastructure that powers business intelligence, reporting, and analytics. The ideal candidate will be eager to grow their skills and take ownership of impactful data projects within a fast-paced, modern tech environment. Key Responsibilities: Design, develop, and maintain data pipelines and data warehousing solutions using Azure services Work with stakeholders More ❯

As a Data Engineer, you will design, build, and maintain data pipelines and solutions to support business needs. This role involves leveraging your technical expertise to enable data-driven decision-making. Client Details Data Engineer - Surrey - Hybrid Our client is a well-established organisation undergoing a significant digital and data transformation. With a focus on innovation and technology, they are investing in building modern, cloud-based data capabilities to drive smarter decision-making, improve customer experience, and support future growth. This is an exciting time to join a business that is placing data at the heart of its strategy and creating opportunities for impactful … work across the organisation Description Data Engineer - Surrey - Hybrid As the Data Engineer you will help design, build, and scale a modern Azure-based data platform. This is your chance to play a key role in shaping how data is used to drive smarter decisions and real business impact. Develop, maintain, and More ❯

Job Title: Data Architect – Clinical Knowledge Graph Location: London (Hybrid) Job Type: Contract (Inside IR35) About the Role We are looking for an experienced and self-driven Data Architect to support the continuous improvement and delivery of a cutting-edge Clinical Knowledge Graph platform. This role is central to driving innovation in Health Informatics and Clinical … to extract clinical insights Collaborate with analysts and data scientists to define and meet data requirements Ensure data quality and consistency across the pipeline lifecycle Stay up to date with advancements in graph technology , data modeling , and semantic architecture Mandatory Skills Proven experience with SPARQL and Python Hands-on expertise with … Neo4j, Graph DB Experience with Clinical Knowledge Graphs/Clinical Intelligence platforms Strong understanding of data modeling , schema design , and semantic technologies Familiarity with data pipeline orchestration tools such as Apache Airflow or Luigi Strong problem-solving skills and ability to work autonomously Preferred Qualifications Degree in Computer Science , Data Science , or related More ❯