19 of 19 Data Pipeline Jobs in Yorkshire

Job summary The UKHSA Digital and Data Directorate strategically manages a suite of modern, secure data tools and platforms, ensuring access to high-quality data services. The DD&A team within the directorate comprises solution architects, data architects, and data modelers, and collaborates with organizational units throughout UKHSA. They provide … expertise in data modelling, flow design, and tooling, utilizing top-tier cloud and on-prem solutions to deliver insights for safeguarding public health. As a Senior Data Architect, you will lead data design programmes, collaborating with peers to analyse, design, and implement our evolving data and analytics estate. Main duties of the … job o Analyse and translate business need into sustainable data flows.o Evaluate, understand, and document existing data systems.o Assess the impact of change, and effectively communicate data design and change implications.o Collaborate with and guide multiple stakeholders on data-centric initiatives.o Maintain a broad knowledge of our existing and planned data More ❯

Lead Data Engineer- AWSLeeds (Hybrid) About the Business: Our client is a nationally recognised leader in their industry, operating across the UK with a reputation for innovation and excellence. As part of their continued investment in data, they are building a high-performing data function to support business-wide transformation and insights. This is … a greenfield opportunity to help shape the future of data engineering in a complex, large-scale environment. The Role: We are seeking an experienced Lead Data Engineer to play a pivotal role in the design, build, and implementation of a new enterprise data platform. The business is currently migrating to AWS, and you will … S3, Glue, Lambda, Redshift, Athena, EMR). Experience designing and building data lakes and modern data platforms. Proficiency with Python, SQL, and data pipeline orchestration tools (e.g., Airflow, dbt). Strong understanding of data modelling, ETL/ELT processes, and distributed systems. Knowledge of data security, governance, and compliance More ❯

Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £65,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital transformation and building a cloud-first, data-led approach to support major environmental goals. Think scalable pipelines, secure platforms, and data systems that … directly contribute to a greener future. As a Senior Data Engineer, you'll play a key role in designing and delivering robust, cloud-based data infrastructure. You'll work with large datasets, build scalable pipelines, and help ensure data is high quality, secure, and accessible, while mentoring more junior engineers and working closely with … stakeholders across the business. Key Responsibilities: Develop scalable and secure data architectures ensuring optimal data flow Cloud data platform development, data modelling, shaping and technical planning Implementing best practices around data security, governance, privacy, and compliance Ensure company data is secure, accurate, maintained and available. Mentor data More ❯

now to be part of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of roles including but not … limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis and investigation. Working with others is key, you could be working with other engineers, developers More ❯

AWS Data Engineer – Leeds/Hybrid - Upto £60K We’re looking for a Data Engineer to join a growing data team and play a key role in designing, building, and maintaining cloud-native data platforms. The role is based in Leeds (2 days per week on-site) with flexibility for hybrid working. … The role: Design and implement scalable data architectures in the cloud, ensuring secure and reliable data pipelines. Work across the full data lifecycle, supporting data scientists, analysts, and engineering teams. Lead development projects, data modelling, and cloud data platform deployments. Mentor data engineers and contribute to … best practices across the team. Key skills: Strong experience with AWS data services (S3, Redshift, Glue, Lambda, Lake Formation, CloudFormation). Proficiency in SQL, Python (Pandas), Spark or Iceberg. Experience with data warehouse design, ETL/ELT, and CI/CD pipelines (GitHub, CodeBuild). Knowledge of infrastructure as code, performance tuning, and data More ❯

AWS Data Engineer – Leeds/Hybrid - Upto £60K We’re looking for a Data Engineer to join a growing data team and play a key role in designing, building, and maintaining cloud-native data platforms. The role is based in Leeds (2 days per week on-site) with flexibility for hybrid working. … The role: Design and implement scalable data architectures in the cloud, ensuring secure and reliable data pipelines. Work across the full data lifecycle, supporting data scientists, analysts, and engineering teams. Lead development projects, data modelling, and cloud data platform deployments. Mentor data engineers and contribute to … best practices across the team. Key skills: Strong experience with AWS data services (S3, Redshift, Glue, Lambda, Lake Formation, CloudFormation). Proficiency in SQL, Python (Pandas), Spark or Iceberg. Experience with data warehouse design, ETL/ELT, and CI/CD pipelines (GitHub, CodeBuild). Knowledge of infrastructure as code, performance tuning, and data More ❯

Data Engineering Manager Location: York/Leeds or Manchester (Hybrid) Salary: up to £62,000 + benefits Elevation Recruitment Group are looking for a Data Engineering Manager to lead our clients existing team of data engineers, driving delivery in a complex, fast-moving environment. The successful Data Engineering Manager will have a … strong background as a hands-on data engineer before moving into leadership, be capable of navigating diverse data sources spread across multiple systems and helping the organisation unlock the power of its data. Experience with modern data platform rollouts, especially Microsoft Fabric on Azure will set you apart, as will a track record of … delivering in Agile/Scrum settings. Key duties & Responsibilities: Manage, mentor and develop an existing high-performing data engineering team. Oversee the design, development, and optimisation of data pipelines, warehouses and platforms. Lead projects in complex, multi-source data environments. Maintain governance standards, data lineage and data dictionaries. Collaborate with More ❯

make Smoove a great place to work and as our business expands, we are looking for ambitious, talented people to join us. We are seeking an experienced Principal Data Engineer to define, lead, and scale the technical strategy of our data platform. This is a senior, hands-on leadership role at the intersection of architecture, governance … and engineering excellence, where you will shape how data is collected, processed, and delivered across the organisation. You will own the end-to-end quality, performance, and scalability of our data systems - from raw ingestion through to trusted datasets powering business-critical analytics and reporting. This includes setting standard sand influencing the strategic roadmap for data infrastructure. Our stack is built on both AWS and Azure, using Databricks across data domains and you will lead the evolution of this ecosystem to meet future business needs. You'll ensure that data is secure, compliant, discoverable, and business-ready, enabling analysts, data scientists, and stakeholders to make confident, data More ❯

Overview: We are working with a Public Sector organsiation based in Bradford, they are looking for a skilled Data Engineer to support the migration from their current Azure Data Warehouse to Microsoft Fabric. The role will focus on integrating multiple data sources into a central data warehouse and building efficient data pipelines. The role is a 2 year fixed term contract. Key Responsibilities: Migrate data solutions from Azure Data Warehouse to Microsoft Fabric Integrate multiple data sources including risk databases, HR systems and other operational systems Develop and maintain Azure Synapse pipelines for data extraction, transformation and loading (ETL) Ensure data quality, consistency and integrity across all sources Collaborate with stakeholders to understand requirements and deliver robust data engineering solutions Requirements: Strong experience with Azure Data Warehouse and Microsoft Fabric Proficiency in building and maintaining Azure Synapse pipelines Proven track record in integrating multiple data sources into a single data warehouse More ❯

Data Engineering Manager Location: Leeds (Mostly Remote 1 Day On-Site) Salary: Up to £75,000 per annum Are you an experienced Senior Data Engineer ready to step into a leadership role? We re looking for a Lead Data Engineer to join our client's team based in Leeds, working mostly remotely with just … one day on-site per week. You ll lead the design and delivery of scalable, cloud-based data solutions using Databricks, Python, and SQL, while mentoring a team and driving engineering best practices. About You You might currently be a Senior/Lead Data Engineer ready to grow your leadership skills. You re passionate about building … robust, efficient data pipelines and shaping cloud data architecture in an agile environment. Key Responsibilities Lead development of data pipelines and solutions using Databricks, Python, and SQL Design and maintain data models supporting analytics and business intelligence Build and optimise ELT/ETL processes on AWS or Azure Collaborate closely with analysts More ❯

Data Engineering Manager Location: Leeds (Mostly Remote – 1 Day On-Site) Salary: Up to £75,000 per annum Are you an experienced Senior Data Engineer ready to step into a leadership role? We’re looking for a Lead Data Engineer to join our client's team based in Leeds, working mostly remotely with just … one day on-site per week. You’ll lead the design and delivery of scalable, cloud-based data solutions using Databricks, Python, and SQL, while mentoring a team and driving engineering best practices. About You You might currently be a Senior/Lead Data Engineer ready to grow your leadership skills. You’re passionate about building … robust, efficient data pipelines and shaping cloud data architecture in an agile environment. Key Responsibilities Lead development of data pipelines and solutions using Databricks, Python, and SQL Design and maintain data models supporting analytics and business intelligence Build and optimise ELT/ETL processes on AWS or Azure Collaborate closely with analysts More ❯

Lead Data Engineer ££64,000 GBP Hybrid WORKING Location: Leeds, Yorkshire and the Humber - United Kingdom Type: Permanent This is an exciting opportunity for a skilled Lead Data Engineer to advance their career while remaining deeply technical. The role offers a clear path for progression without requiring a move into management or sales, allowing individuals to … focus on what they do best-engineering high-quality, scalable data solutions. Why Join? This organisation values continuous learning and personal growth. Team members benefit from a dedicated learning allowance, enabling them to shape their own development journey. Paid overtime and a strong emphasis on work-life balance ensure that individuals are recognised and supported-especially during demanding … projects. The business is committed to employee wellbeing and fosters a positive, inclusive culture. Role Overview The Lead Data Engineer will take a hands-on technical leadership role, guiding the delivery of high-impact solutions within cloud-based environments. This position is ideal for professionals who are passionate about modern data engineering and want to influence More ❯

Job Title: Senior Data Engineer Salary: Up to £60,000 Location: Leeds (Hybrid - 2 days a week in the office) Are you a data engineering expert ready to take the next step in your career? We're hiring a Senior Data Engineer to join our growing team in Leeds. You'll play a critical … role in designing, building, and managing modern data pipelines and cloud-based data solutions. What you'll be doing: Designing and maintaining scalable data pipelines Building and optimising data warehousing solutions Working … with Databricks and modern cloud platforms (AWS) Collaborating with cross-functional teams to deliver high-impact data products Leading best practices in data engineering and pipeline architecture What we're looking for: Proven experience in data engineering at a senior level Strong hands-on knowledge of Databricks Experience with AWS cloud platforms inlcuding More ❯

Data Engineer – Leeds – Hybrid - Azure An innovative fintech scale-up revolutionising how financial institutions leverage their data assets. Based in Leeds, they're building next-generation solutions that help banks, investment firms, and financial services companies unlock the true potential of their data to drive smarter investment decisions and enhance customer experiences. The Role … They need a talented Data Engineer to join their rapidly expanding engineering team in Leeds. You'll be architecting robust data systems that power critical financial analytics, working with modern cloud technologies whilst tackling real-world challenges in the fast-paced fintech sector. This is an excellent opportunity for someone ready to make their mark in … be brilliant Understanding of CI/CD processes for deploying data solutions Some exposure to big data technologies and distributed processing Nice to haves: ML pipeline experience Previous fintech or financial services exposure If you are on the market for a new role and are looking to join a business making real impact, APPLY NOW More ❯

Your new company A Principal Data Engineer is required on a permanent basis for a forward-thinking organisation at the heart of Leeds. The Data Services team are on a mission to unlock the value of data by delivering high-quality, secure, and accessible data services. With a focus on modern cloud … based technologies and strong partnerships, they help colleagues navigate the complexities of a data-driven world. Your new role As a Principal Data Engineer, you will be instrumental in shaping the organisations strategic cloud data platform. You'll lead the design and implementation of scalable data pipelines, drive innovation in data … leadership role where you'll establish best practices, ensure compliance, and deliver smart, customer-focused solutions. What you'll need to succeed You'll bring extensive experience in data engineering within Azure environments, with a strong track record in modernisation and large-scale migration projects. You'll be confident designing metadata-driven frameworks and managing Databricks environments, with More ❯

model? We are seeking a Senior Backend Developer to support the development of our AI-driven marketing platform, with a strong focus on performance, scalability, and data pipeline architecture. This role is ideal for someone experienced in backend API development and working with modern data infrastructure. At Ask BOSCO® , we're on a mission to … Senior Backend Developer you won't just write code - you'll shape the future of a high-growth MarTech product, lead technical strategy, and work directly with founders, data scientists, and clients to deliver impactful, intelligent solutions. If you're excited by ownership, innovation, and the chance to make a real mark in a scaling business, this is … of profits donated to 1moreChild orphanage yearly Markets: Marketing & eCommerce Agencies. eCommerce retailers. Your Expertise: Highly experienced Developer with experience of backend API development and working with modern data infrastructure. At ASK BOSCO® , part of Modo25, we're building a smarter, faster, people-first marketing tech business. We're entering a phase of accelerated growth, and you'll More ❯

Job Title: Data Engineer Salary: £40k - £60k + Excellent Benefits Package Location: Huddersfield (Hybrid) Key Skills: SQL, PowerBI, Airflow Summary A new role has opened up for a Data Engineering with SQL, BI, Cloud and Airflow DAG to join a media-focused business. The role has opened up as the company are heavily investing, and have … exciting plans for their data team. i This a permanent position being offered on a hybrid basis with 2 days onsite from their Huddersfield office. The Company You would be joining a highly-regarded business with over 20 years' experience in their field. Their mission is to provide their impressive client-base with the tools to run their … an employee you will have access to retail discounts, flexitime, health and wellbeing programs, and company pension schemes. The Role You will play a key role in transforming data sets to access insights to access the company, and their client base. Your responsibilities will cover: Develop data models to support company Business Intelligence Write and optimize More ❯

DATA ENGINEER £65,000 + BENEFITS Remote (UK based) Looking for a role where you can take ownership of a modern cloud data warehouse, optimise pipelines, and make data more scalable, reliable, and cost-effective? THE COMPANY: I'm working with a global retail & e-commerce brand that's expanding rapidly across the UK. … With a growing digital and physical presence, their central data team plays a key role in powering insights across e-commerce, retail, finance, and marketing. THE ROLE: This is a hands-on data engineering role where you'll focus on building, optimising, and scaling pipelines into BigQuery (GCP) from a wide range of sources. You'll … work closely with BI developers and analysts to ensure clean, reliable data is available for reporting and decision-making. Manage and optimise pipelines from ERP, website, APIs, app stores, social media, and more. Work with BigQuery, Google Buckets, Python scripts, and Talend (transitioning to Dataform/Cloud workflows). Support migrations between GCP projects and ensure the warehouse More ❯

on in code and c30% leading - making key architectural decisions, mentoring, and setting technical direction. Responsibilities Own the architecture of the software systems, from drone control to cloud data pipelines Build backend control systems in Go, with critical components in C++ Design scalable cloud orchestration strategies (Railway, AWS, Kubernetes) Deliver advanced features including multi-drone (M:N) coordination … growing team of developers across multiple disciplines Drive technical standards, code quality, and test-driven development Upcoming Projects: Multi-drone coordination and control systems Next-gen data pipeline and product architecture Distributed and cloud-native scaling of core systems Advanced weather-intelligence and autonomy features Our Tech Stack Backend: Go C++ (Either or both - will allow upskill More ❯