26 to 50 of 576 Data Pipeline Jobs in the UK

energy and utilities, financial services, government and public services, health and life sciences, and transport. The Data Engineer will have experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. You will join the business at a period of huge growth. WE … growth area for the business with a diverse and growing capability, and we are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such … requirements You thrive in problem-solving and analytical thinking You enjoy collaborating with multiple stakeholders in a fast-paced environment Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing scripts, extracting data More ❯

Select how often (in days) to receive an alert: Location: UK - Hatfield Job-ID: 215349 Contract type: Standard Business Unit: Data Management/Reporting Life on the team Hatfield based (with min of 2 days in the office) Competitive basic salary + Core & flexible benefits Join Data Management within our Data & Analytics function. We … operate across four pillars: Data Management, Data Strategy, Data Governance and Data Delivery. We work in agile, delivering in sprints with modern software engineering and DevOps practices to ship reliable data products at pace. The team owns the Group Data Warehouse, a global data platform that … supports Computacenter's combined reporting requirements across the world. In Data Management, you will turn Data Demand into prioritised backlog requirements and partner with business units to deliver maximum customer value from data. If you enjoy practical delivery, measurable outcomes and helping teams make better decisions with trusted data, you will fit right in. More ❯

Overview We're seeking a Senior Data Scientist to lead the development of advanced analytics and AI/ML solutions that unlock real value across our business. This is a contract role for 6 months . In this contract role, you'll work with proprietary and B2B research datasets to design, deliver, and scale data-driven … Research, and Technology, you'll help turn strategic ideas into working MVPs-ensuring high standards of methodology, quality, and business relevance throughout. You'll also help shape the data science environment by working alongside our tech teams to support a robust and flexible infrastructure, including sandbox environments for onboarding and evaluating new data sources. This is … refined and productionized in the future. Work with Tech colleagues to improve the Data Science workspace, including providing requirements for Data Lake, Data Pipeline, and Data Engineering teams. Expand on the tools and techniques already developed. Help us understand our customers (both internal and external) better so we can provide the More ❯

products and ship updates to customers rapidly. Could you be the next innovator to join us? What’s it all about? Insight and Intelligence drives Atom. As a Data Engineer you will be creating an efficient, sustainable, and agile data analytics platform for a data driven digital bank. You will be using a range … of database technologies and a combination of event driven techniques and batch processing methodologies. In addition you will be expanding and optimizing our cloud-based data & data pipelines as part of a cross functional team. As a Data Engineer at Atom, you will support our software engineers, data architects, and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. What will your ‘typical’ day look like.... (there’s no 2 days the same in Atom): Build and maintain data ETL jobs using a range of tools & techniques Effective use of database and streaming techniques and More ❯

Principal Data Engineer - Core Systems Team Hybrid in London/Remote within UK The company Imagine a world where every small business has the power to thrive. That's the world we're building at iwoca. Small businesses aren't just statistics - they're the heartbeat of our communities, the character of our high streets, and the engine … leading fintech innovators. But we're just getting started. Our mission? To empower one million businesses with the financial tools they deserve. We combine cutting-edge technology and data science with genuine human understanding to make finance feel less like a barrier and more like a superpower. Whether it's managing cash flow or seizing unexpected opportunities, we … funds they need - often within minutes. The team You'll join the Core Systems team, who are responsible for driving innovation across the business by optimising development, building data systems, and continuously improving iwoca products. We follow Agile-inspired processes, using continuous integration and delivery, so that features go live in days or weeks, not months or years. More ❯

Data Engineer Active SC essential Croydon - up to 1 day per week £500/day outside until the end of June 2026 Please note, this in an outside IR-35 position on a Statement of Work basis, ideally we would prefer candidates with experience working to those arrangements. Essential skills: AWS Data Engineering Snowflake Databricks Responsibilities … Develop and manage data models, schemas, and metadata to support analytics and reporting needs. Collaborate with Data Analysts, Scientists, and Business Analysts to ensure data availability and usability. Implement data quality checks, validation routines, and monitoring to ensure data integrity and reliability. Optimise data workflows for performance, cost-efficiency, and maintainability using tools such as Azure Data Factory, AWS Data Pipeline for Data Orchestration, Databricks, or Apache Spark. Support the integration of data into visualisation platforms (e.g. Power BI, ServiceNow) and other analytical environments. Ensure compliance More ❯

Data Engineer Join the Team Powering the Future of Data at Vivedia Location: Sheffield - Hybrid (3 days per week) Salary : £50,000 to £60,000 depending on experience Department: Data Team At Vivedia , data isn’t just numbers — it’s the engine driving every decision, every innovation, and every customer experience. We … re growing, and we’re looking for a Data Engineer who’s ready to build the foundations of a smarter, more connected future. Why You’ll Love This Role You’ll play a pivotal role in designing, building, and optimizing the data systems that power our business. From robust pipelines to scalable platforms, your work will … help every team at Vivedia unlock insights, drive performance, and make data-driven decisions that matter. This is your chance to shape the future of our data ecosystem — and see your impact ripple across an entire organisation. What You’ll Do Build the backbone of our data universe Design, develop, and deploy scalable, secure More ❯

Job Title: Senior Data Engineer Location: Leeds, on-site 2x per week Salary: Up to £85,000 Why Apply? Our client is looking for a talented Senior Data Engineer to play a key role in their ongoing digital transformation. This position offers the chance to develop the initial data strategy, design scalable pipelines from … scratch, and create a data lake that will be central to reporting initiatives. If you are experienced in managing AWS based data infrastructures and eager to drive innovative solutions, this role is perfect for you. This is a unique opportunity to influence the data strategy and define data architecture from the outset … ll work in a collaborative, forward thinking environment where innovation is encouraged, with flexible working arrangements and opportunities for professional growth. Responsibilities Design, build, and optimise scalable, automated data pipelines to ingest, process, and deliver quality data across internal systems. Lead the setup and ongoing evolution of a centralised data lake in AWS to More ❯

FDM is a global business and technology consultancy seeking a Senior Data Engineer to work for our client within the transport sector. This is initially a 6-month contract with the potential to extend and will be a hybrid role based in Manchester. Our client is looking for an experienced Senior Data Engineer with a strong … background in Azure Data Services and Data Fabric to support the design, build, and optimisation of enterprise-grade data solutions. The role requires hands-on expertise in developing advanced data pipelines, architecting data lake structures, aligning governance frameworks, and enabling robust reporting capabilities. The ideal candidate will be someone who … can take end-to-end ownership of data engineering initiatives and deliver solutions aligned with enterprise data architecture as well as governance principles. Responsibilities Build complex ETL/ELT pipelines from scratch, integrating multiple data sources while implementing advanced transformations using mapping data flows Optimise performance and manage dependencies, ensuring robust monitoring More ❯

Data Engineer (with Data Analytics Background) Location: City of London Employment Type: Full-time Salary: £90,000-£100,000 Sector: Fintech We're looking for a well-rounded, communicative Data Engineer with a strong background in data analytics and experience within the Fintech sector . This role is ideal for someone who … began their career as a Data Analyst and has since transitioned into a more engineering-focused position, someone who enjoys understanding the business context just as much as building the data solutions behind it. You'll work extensively with Python , Snowflake , SQL , and dbt to design, build, and maintain scalable, high-quality data pipelines … and models that support decision-making across the business. This is a hands-on, collaborative role, suited to someone who's confident communicating with data, product, and engineering teams, not a 'heads-down coder' type. Top 4 Core Skills Python - workflow automation, data processing, and ETL/ELT development. Snowflake - scalable data architecture, performance More ❯

Contract Role – Data AWS Engineer – Northampton/Hybrid – 6 months – Inside IR35 7+ years of experienced in designing, building, and maintaining data pipelines and architectures on the Amazon Web Services (AWS) cloud platform. Skilled in scalable, reliable, and efficient data solutions, often using AWS services like S3, Redshift, EMR, Glue, and Kinesis. This involves … designing ETL processes, ensuring data security, and collaborating with other teams for data analysis and business requirements Role Overview: Job Title: Data AWS Engineer Location: Northampton (hybrid: 2-3 days in office) Contract Type: Contract Duration: 6 months Key Responsibilities: Designing and Building Data Pipelines: Creating and implementing data pipelines … to move data between different systems and applications on AWS. Data Warehouse Management: Designing, building, and maintaining data warehouses using AWS services like Redshift. ETL Process Development: Developing and maintaining Extract, Transform, Load (ETL) processes to move and transform data. Data Governance and Security: Implementing data governance and security policies More ❯

and want to take your career further in a thriving office environment? Are you a strong communicator who works well within a team? Do you understand data pipeline tools and data modelling? We're seeking an SQL Developer to join our expanding Database team in Leeds! In the role, you will: Analyse business requirements through … collaboration with stakeholders, IT Management, and the user community Develop new systems, integrate third-party platforms, and maintain existing applications Use data to deliver business improvements and support informed decision-making Work with stakeholders on data extraction and manipulation tasks Write and optimise in-application SQL statements Provide user support for report errors, debugging, and issue … experience in a database developer/data engineer role Proficiency in SQL and Python Experience with cloud platforms (AWS, GCP, or Azure) Familiarity with data pipeline tools (e.g., SSIS, Spark) Strong grasp of data warehousing and data modelling principles Experience undertaking development work in C# Ability to create and troubleshoot SSRS More ❯

Role: Data Team Lead Location: Milton Keynes (Hybrid 3 Days On-site Weekly) Salary: £55,000 - £65,000 Benefits: Bonus, Company Cars, Flexible Benefit Package Network IT is recruiting for a Data Team Lead to join a leading organisations UK IT function. This role will see you managing and developing a high-performing data team, while ensuring the delivery of effective and scalable data solutions. Youll play a key role in setting direction, building capability, and aligning data initiatives with business priorities. The role requires strong leadership, stakeholder management, and the ability to oversee data programmes from strategy through to delivery. Key Responsibilities: Lead, mentor, and … data leadership roles within complex organisations. Proven track record of leading and developing technical teams. Good understanding of data warehousing, ETL, and data pipeline solutions. Experience with data governance, compliance, and security frameworks. Strong stakeholder engagement, vendor management, and planning skills. Experience managing budgets and resources effectively. Excellent communication, leadership, and More ❯

Join us as a Data Platform Engineer for our client. At Peregrine, we re always seeking Specialist Talent that have the ideal mix of skills, experience, and attitude, to place with our vast array of clients. From Business Analysts in large government organisations to Software Developers in the private sector we are always in search of the best … you will be deployed across our portfolio of clients as a specialist consultant, working on a wide array of complex projects across multiple industries. The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and onpremises … with over 3 years of relevant experience in data engineering, platform engineering, or a related field, with demonstrated hands-on expertise in NiFi and data pipeline design in regulated environments. Responsibilities: Design, develop, and maintain robust and secure data pipelines using NiFi and related big data technologies. • Troubleshoot and optimize NiFi More ❯

Join us as a Data Platform Engineer for our client. At Peregrine, we’re always seeking Specialist Talent that have the ideal mix of skills, experience, and attitude, to place with our vast array of clients. From Business Analysts in large government organisations to Software Developers in the private sector – we are always in search of the best … you will be deployed across our portfolio of clients as a specialist consultant, working on a wide array of complex projects across multiple industries. The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and onpremises … with over 3 years of relevant experience in data engineering, platform engineering, or a related field, with demonstrated hands-on expertise in NiFi and data pipeline design in regulated environments. Responsibilities: Design, develop, and maintain robust and secure data pipelines using NiFi and related big data technologies. • Troubleshoot and optimize NiFi More ❯

Qualifications Bachelor's or Master's degree in Computer Science, Mathematics or similar field (PhDs will be given preference) 7+ years of experience working with massive data Strong knowledge of public cloud (AWS) Experience with data acquisition (API calls/FTP downloads), ETL, transformation/normalization Proficiency in ETL process is mandatory Experienced building components for … enterprise central data platforms (data warehouses, Operational Data Stores, Access layers with APIs, file extracts, user queries) Hands-on experience with SQL, Python, Spark, Kafka Excellent communication skills, including a good working proficiency in verbal and written English About this Job Scopeworker Business Intelligence real time processes enterprise customer data. We develop and maintain … design, build and automate, scalable solutions, massive data sets and bring software engineering experience to the complex process of data processing and data pipeline development. You will lead big data challenges in an agile way and build data models to deliver insightful analytics while ensuring the highest standard of More ❯

Remote Data Architect sought by a well-established company in their industry; our client is seeking an adept professional to spearhead strategic leadership and technical expertise within their data solutions landscape, focussed on cloud data platforms, but including IoT analytics, data integration, and migration projects. This unique opportunity is offered on a … remote-first basis, but with an open invitation to their headquarters any time. Role Responsibilities: The Data Architect will be pivotal in shaping the approach to designing and developing data solutions using cloud technologies such as AWS and Azure. This position involves: - Leading the design and implementation of innovative cloud data platforms. - Setting standards … using Azure, AWS, or exceptional on-premise design expertise. - At least 5 years in data engineering or business intelligence roles. - Proficiency in ETL and data pipeline design, with a technology-agnostic approach. - A solid understanding of data warehouse and data lake principles. - Expert SQL skills and demonstrable data modelling More ❯

Remote Data Architect sought by a well-established company in their industry; our client is seeking an adept professional to spearhead strategic leadership and technical expertise within their data solutions landscape, focussed on cloud data platforms, but including IoT analytics, data integration, and migration projects. This unique opportunity is offered on a … remote-first basis, but with an open invitation to their headquarters any time. Role Responsibilities: The Data Architect will be pivotal in shaping the approach to designing and developing data solutions using cloud technologies such as AWS and Azure. This position involves: - Leading the design and implementation of innovative cloud data platforms. - Setting standards … using Azure, AWS, or exceptional on-premise design expertise. - At least 5 years in data engineering or business intelligence roles. - Proficiency in ETL and data pipeline design, with a technology-agnostic approach. - A solid understanding of data warehouse and data lake principles. - Expert SQL skills and demonstrable data modelling More ❯

Remote Data Architect sought by a well-established company in their industry; our client is seeking an adept professional to spearhead strategic leadership and technical expertise within their data solutions landscape, focussed on cloud data platforms, but including IoT analytics, data integration, and migration projects. This unique opportunity is offered on a … remote-first basis, but with an open invitation to their headquarters any time. Role Responsibilities: The Data Architect will be pivotal in shaping the approach to designing and developing data solutions using cloud technologies such as AWS and Azure. This position involves: - Leading the design and implementation of innovative cloud data platforms. - Setting standards … using Azure, AWS, or exceptional on-premise design expertise. - At least 5 years in data engineering or business intelligence roles. - Proficiency in ETL and data pipeline design, with a technology-agnostic approach. - A solid understanding of data warehouse and data lake principles. - Expert SQL skills and demonstrable data modelling More ❯

Remote Data Architect sought by a well-established company in their industry; our client is seeking an adept professional to spearhead strategic leadership and technical expertise within their data solutions landscape, focussed on cloud data platforms, but including IoT analytics, data integration, and migration projects. This unique opportunity is offered on a … remote-first basis, but with an open invitation to their headquarters any time. Role Responsibilities: The Data Architect will be pivotal in shaping the approach to designing and developing data solutions using cloud technologies such as AWS and Azure. This position involves: - Leading the design and implementation of innovative cloud data platforms. - Setting standards … using Azure, AWS, or exceptional on-premise design expertise. - At least 5 years in data engineering or business intelligence roles. - Proficiency in ETL and data pipeline design, with a technology-agnostic approach. - A solid understanding of data warehouse and data lake principles. - Expert SQL skills and demonstrable data modelling More ❯

We are searching for an experienced GIS Data Specialist/Geospatial Data Specialist for an extremely exciting technology focused business, someone who has extensive experience of working with and managing Geospatial Data and Geodata . This role is offered on a hybrid or remote working basis. You MUST however be able to attend team … will need to live within a commutable distance of one of the above offices, either Reading or Exeter. We are searching for someone who is very passionate about data, automation, and driving change through smart processes. You will be leading the way with regards to transforming how data is managed, processed and delivered across our client … s business. You will take ownership of complex ETL workflows, you will be developing automation tools, and you will ensure data is accurate, delivered in a timely fashion whilst making sure it is fit for purpose. Key Duties: - Lead and maintain ETL processes, improving automation and data quality. Use tools like Power BI/Excel or More ❯

Who We Are BCG Expand is a specialist firm providing unique data-driven business intelligence as a trusted advisor to senior executives across the world's leading financial services firms to help them to operate more effectively. Expand's activities are focused on data benchmarking in technology, operations, FinTech and market data, with expertise … our professional, supportive and entrepreneurial working culture that we all enjoy. What You'll Do We're looking for a highly skilled Principal Engineer with a passion for data, cloud technologies, and building robust, scalable solutions - who also brings strategic product thinking and cross-functional leadership . In this role, you'll not only lead the design and … implementation of the data infrastructure that powers advanced analytics and data science across our platforms, but also contribute to the strategic direction, roadmap, and execution of data products in collaboration with senior stakeholders. Architect & Build Scalable Data Solutions Collaborate closely with senior product stakeholders to understand data needs and architect More ❯

Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £65,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital transformation and building a cloud-first, data-led approach to support major environmental goals. Think scalable pipelines, secure platforms, and data systems that … directly contribute to a greener future. As a Senior Data Engineer, you'll play a key role in designing and delivering robust, cloud-based data infrastructure. You'll work with large datasets, build scalable pipelines, and help ensure data is high quality, secure, and accessible, while mentoring more junior engineers and working closely with … stakeholders across the business. Key Responsibilities: Develop scalable and secure data architectures ensuring optimal data flow Cloud data platform development, data modelling, shaping and technical planning Implementing best practices around data security, governance, privacy, and compliance Ensure company data is secure, accurate, maintained and available. Mentor data More ❯

Senior Data Engineer Hybrid working - 1 day a week onsite in either London or Portsmouth Permanent - Up to £75k Overview: We are seeking a talented Senior Data Engineer specialising in Starburst (Trino) and Dell Data Lakehouse to join our AI & Data team. You will be responsible for deploying, maintaining and optimising Starburst … installations & Dell Data Lakehouse, enabling our clients to seamlessly access their data across multiple platforms. The ideal candidate will have excellent communication skills, an advanced understanding of Starburst & Dell Data Lakehouse, and proficiency with troubleshooting and root cause analysis. Responsibilities: Deploy and manage Starburst Enterprise/Galaxy and Dell Data Lakehouse installations … such as Ansible. Knowledge of data requirements for AI and machine learning workloads. Familiarity with Data Federation and Cached Services Familiarity with Data pipeline (Series of steps that move and transform data from one source to another for analyses and storage) Experience with Dell Data Lakehouse administration. Experience in More ❯

Senior Data Engineer Hybrid working - 1 day a week onsite in either London or Portsmouth Permanent - Up to £75k Overview: We are seeking a talented Senior Data Engineer specialising in Starburst (Trino) and Dell Data Lakehouse to join our AI & Data team. You will be responsible for deploying, maintaining and optimising Starburst … installations & Dell Data Lakehouse, enabling our clients to seamlessly access their data across multiple platforms. The ideal candidate will have excellent communication skills, an advanced understanding of Starburst & Dell Data Lakehouse, and proficiency with troubleshooting and root cause analysis. Responsibilities: Deploy and manage Starburst Enterprise/Galaxy and Dell Data Lakehouse installations … such as Ansible. Knowledge of data requirements for AI and machine learning workloads. Familiarity with Data Federation and Cached Services Familiarity with Data pipeline (Series of steps that move and transform data from one source to another for analyses and storage) Experience with Dell Data Lakehouse administration. Experience in More ❯