23 of 23 DemandTrendPermanent Data Pipeline Jobs in Yorkshire

Lead Data Engineer- AWSLeeds (Hybrid) About the Business: Our client is a nationally recognised leader in their industry, operating across the UK with a reputation for innovation and excellence. As part of their continued investment in data, they are building a high-performing data function to support business-wide transformation and insights. This is … a greenfield opportunity to help shape the future of data engineering in a complex, large-scale environment. The Role: We are seeking an experienced Lead Data Engineer to play a pivotal role in the design, build, and implementation of a new enterprise data platform. The business is currently migrating to AWS, and you will … S3, Glue, Lambda, Redshift, Athena, EMR). Experience designing and building data lakes and modern data platforms. Proficiency with Python, SQL, and data pipeline orchestration tools (e.g., Airflow, dbt). Strong understanding of data modelling, ETL/ELT processes, and distributed systems. Knowledge of data security, governance, and compliance More ❯

and want to take your career further in a thriving office environment? Are you a strong communicator who works well within a team? Do you understand data pipeline tools and data modelling? Were seeking an SQL Developer to join our expanding Database team in Leeds! In the role, you will: Analyse business requirements through collaboration … with stakeholders, IT Management, and the user community Develop new systems, integrate third-party platforms, and maintain existing applications Use data to deliver business improvements and support informed decision-making Work with stakeholders on data extraction and manipulation tasks Write and optimise in-application SQL statements Provide user support for report errors, debugging, and issue resolution … experience in a database developer/data engineer role Proficiency in SQL and Python Experience with cloud platforms (AWS, GCP, or Azure) Familiarity with data pipeline tools (e.g., SSIS, Spark) Strong grasp of data warehousing and data modelling principles Experience undertaking development work in C# Ability to create and troubleshoot SSRS More ❯

now to be part of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of roles including but not … limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis and investigation. Working with others is key, you could be working with other engineers, developers More ❯

now to be part of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of roles including but not … limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis and investigation. Working with others is key, you could be working with other engineers, developers More ❯

AWS Data Engineer – Leeds/Hybrid - Upto £60K We’re looking for a Data Engineer to join a growing data team and play a key role in designing, building, and maintaining cloud-native data platforms. The role is based in Leeds (2 days per week on-site) with flexibility for hybrid working. … The role: Design and implement scalable data architectures in the cloud, ensuring secure and reliable data pipelines. Work across the full data lifecycle, supporting data scientists, analysts, and engineering teams. Lead development projects, data modelling, and cloud data platform deployments. Mentor data engineers and contribute to … best practices across the team. Key skills: Strong experience with AWS data services (S3, Redshift, Glue, Lambda, Lake Formation, CloudFormation). Proficiency in SQL, Python (Pandas), Spark or Iceberg. Experience with data warehouse design, ETL/ELT, and CI/CD pipelines (GitHub, CodeBuild). Knowledge of infrastructure as code, performance tuning, and data More ❯

AWS Data Engineer – Leeds/Hybrid - Upto £60K We’re looking for a Data Engineer to join a growing data team and play a key role in designing, building, and maintaining cloud-native data platforms. The role is based in Leeds (2 days per week on-site) with flexibility for hybrid working. … The role: Design and implement scalable data architectures in the cloud, ensuring secure and reliable data pipelines. Work across the full data lifecycle, supporting data scientists, analysts, and engineering teams. Lead development projects, data modelling, and cloud data platform deployments. Mentor data engineers and contribute to … best practices across the team. Key skills: Strong experience with AWS data services (S3, Redshift, Glue, Lambda, Lake Formation, CloudFormation). Proficiency in SQL, Python (Pandas), Spark or Iceberg. Experience with data warehouse design, ETL/ELT, and CI/CD pipelines (GitHub, CodeBuild). Knowledge of infrastructure as code, performance tuning, and data More ❯

Data Engineering Manager Location: York/Leeds or Manchester (Hybrid) Salary: up to £62,000 + benefits Elevation Recruitment Group are looking for a Data Engineering Manager to lead our clients existing team of data engineers, driving delivery in a complex, fast-moving environment. The successful Data Engineering Manager will have a … strong background as a hands-on data engineer before moving into leadership, be capable of navigating diverse data sources spread across multiple systems and helping the organisation unlock the power of its data. Experience with modern data platform rollouts, especially Microsoft Fabric on Azure will set you apart, as will a track record of … delivering in Agile/Scrum settings. Key duties & Responsibilities: Manage, mentor and develop an existing high-performing data engineering team. Oversee the design, development, and optimisation of data pipelines, warehouses and platforms. Lead projects in complex, multi-source data environments. Maintain governance standards, data lineage and data dictionaries. Collaborate with More ❯

make Smoove a great place to work and as our business expands, we are looking for ambitious, talented people to join us. We are seeking an experienced Principal Data Engineer to define, lead, and scale the technical strategy of our data platform. This is a senior, hands-on leadership role at the intersection of architecture, governance … and engineering excellence, where you will shape how data is collected, processed, and delivered across the organisation. You will own the end-to-end quality, performance, and scalability of our data systems - from raw ingestion through to trusted datasets powering business-critical analytics and reporting. This includes setting standard sand influencing the strategic roadmap for data infrastructure. Our stack is built on both AWS and Azure, using Databricks across data domains and you will lead the evolution of this ecosystem to meet future business needs. You'll ensure that data is secure, compliant, discoverable, and business-ready, enabling analysts, data scientists, and stakeholders to make confident, data More ❯

Role: Data Engineering Manager Salary: £65,000- £75,000 per annum Location: Leeds (One day on site). VIQU have partnered with a leading supply chain organisation who are looking to expand their data teams. The Data Engineering Manager will manage a team of eight to help with an on-going digital transformation. The … the clients Databricks platform (AWS is preferred but open to Azure.GCP experience also), utilising Python and SQL, contribute to CI/CD pipelines, strategy development, cost optimisation and data governance frameworks. Job duties of the Data Engineering Manager: Manage a team of eight engineers, helping to mentor and coach the team. Manage the adoption of automated … experience in a managerial role, coaching similar sized teams. Deep knowledge of the Databricks platform. Hands on Python development experience. SQL optimisation. Experience with large scale data pipeline optimisation. Experience with Streaming and Batch Spark workloads. Strong people management skills. Role: Data Engineering Manager Salary: £65,000- £75,000 per annum Location: Leeds (One day More ❯

Data Engineering Manager Location: Leeds (Mostly Remote – 1 Day On-Site) Salary: Up to £75,000 per annum About the Role Are you an experienced Senior Data Engineer ready to step into a managerial role? We are seeking a Data Engineering Manager to lead our Leeds-based team, working mostly remotely with one day … on-site per week. In this role, you will manage the design and delivery of scalable, cloud-based data solutions using Databricks, Python, and SQL. You will lead and mentor a team of data engineers, drive engineering best practices, and own the data architecture strategy in an agile environment. Key Responsibilities Manage the development … of data pipelines and solutions using Databricks, Python, and SQL Oversee the design and maintenance of data models that support analytics and business intelligence needs Ensure efficient ELT/ETL processes on AWS or Azure cloud platforms Collaborate with analysts, architects, and stakeholders to deliver high-quality data products Promote best practices in testing More ❯

Lead Data Architect £67,000 - 76,000 GBP Hybrid WORKING Location: Leeds, Yorkshire and the Humber - United Kingdom Type: Permanent Lead Data Architect Locations: Leeds, Manchester, Birmingham, Bristol, Glasgow, or London (Hybrid - up to 2 days on-site per week, remainder remote) Salary: £67,000 - £76,000 (non-London)/Up to £83,000 (London) + … Benefits A respected digital consultancy is hiring a Lead Data Architect to join its growing Data Engineering practice. Known for delivering modern, human-centred services across public and private sectors, this organisation supports clients through meaningful transformation by combining data, design, and engineering. This role is ideal for experienced architects who enjoy shaping cloud … native data platforms, working in multidisciplinary teams, and embedding data governance and architectural rigour across complex service ecosystems. The Role: As a Lead Data Architect, you'll play a key role in designing scalable, secure, and accessible data platforms that enable insight-driven decision-making. You'll work closely with engineering teams More ❯

Data Engineering Manager Location: Leeds (Mostly Remote 1 Day On-Site) Salary: Up to £75,000 per annum Are you an experienced Senior Data Engineer ready to step into a leadership role? We re looking for a Lead Data Engineer to join our client's team based in Leeds, working mostly remotely with just … one day on-site per week. You ll lead the design and delivery of scalable, cloud-based data solutions using Databricks, Python, and SQL, while mentoring a team and driving engineering best practices. About You You might currently be a Senior/Lead Data Engineer ready to grow your leadership skills. You re passionate about building … robust, efficient data pipelines and shaping cloud data architecture in an agile environment. Key Responsibilities Lead development of data pipelines and solutions using Databricks, Python, and SQL Design and maintain data models supporting analytics and business intelligence Build and optimise ELT/ETL processes on AWS or Azure Collaborate closely with analysts More ❯

Data Engineering Manager Location: Leeds (Mostly Remote – 1 Day On-Site) Salary: Up to £75,000 per annum Are you an experienced Senior Data Engineer ready to step into a leadership role? We’re looking for a Lead Data Engineer to join our client's team based in Leeds, working mostly remotely with just … one day on-site per week. You’ll lead the design and delivery of scalable, cloud-based data solutions using Databricks, Python, and SQL, while mentoring a team and driving engineering best practices. About You You might currently be a Senior/Lead Data Engineer ready to grow your leadership skills. You’re passionate about building … robust, efficient data pipelines and shaping cloud data architecture in an agile environment. Key Responsibilities Lead development of data pipelines and solutions using Databricks, Python, and SQL Design and maintain data models supporting analytics and business intelligence Build and optimise ELT/ETL processes on AWS or Azure Collaborate closely with analysts More ❯

Lead Data Engineer ££64,000 GBP Hybrid WORKING Location: Leeds, Yorkshire and the Humber - United Kingdom Type: Permanent This is an exciting opportunity for a skilled Lead Data Engineer to advance their career while remaining deeply technical. The role offers a clear path for progression without requiring a move into management or sales, allowing individuals to … focus on what they do best-engineering high-quality, scalable data solutions. Why Join? This organisation values continuous learning and personal growth. Team members benefit from a dedicated learning allowance, enabling them to shape their own development journey. Paid overtime and a strong emphasis on work-life balance ensure that individuals are recognised and supported-especially during demanding … projects. The business is committed to employee wellbeing and fosters a positive, inclusive culture. Role Overview The Lead Data Engineer will take a hands-on technical leadership role, guiding the delivery of high-impact solutions within cloud-based environments. This position is ideal for professionals who are passionate about modern data engineering and want to influence More ❯

Job Title: Senior Data Engineer Salary: Up to £60,000 Location: Leeds (Hybrid - 2 days a week in the office) Are you a data engineering expert ready to take the next step in your career? We're hiring a Senior Data Engineer to join our growing team in Leeds. You'll play a critical … role in designing, building, and managing modern data pipelines and cloud-based data solutions. What you'll be doing: Designing and maintaining scalable data pipelines Building and optimising data warehousing solutions Working with Databricks … and modern cloud platforms (Azure or AWS) Collaborating with cross-functional teams to deliver high-impact data products Leading best practices in data engineering and pipeline architecture What we're looking for: Proven experience in data engineering at a senior level Strong hands-on knowledge of Databricks Experience with Azure or AWS cloud More ❯

Job Title: Senior Data Engineer Salary: Up to £60,000 Location: Leeds (Hybrid - 2 days a week in the office) Are you a data engineering expert ready to take the next step in your career? We're hiring a Senior Data Engineer to join our growing team in Leeds. You'll play a critical … role in designing, building, and managing modern data pipelines and cloud-based data solutions. What you'll be doing: Designing and maintaining scalable data pipelines Building and optimising data warehousing solutions Working … with Databricks and modern cloud platforms (AWS) Collaborating with cross-functional teams to deliver high-impact data products Leading best practices in data engineering and pipeline architecture What we're looking for: Proven experience in data engineering at a senior level Strong hands-on knowledge of Databricks Experience with AWS cloud platforms inlcuding More ❯

Data Engineer - SQL, Snowflake - Remote Were looking for a Data Engineer to join a small, agile team and help build a modern, scalable data platform. Youll design and maintain data pipelines, transform raw datasets into usable insights, and make data accessible for analytics and decision-making. What youll do Build … and optimize data pipelines with tools like dbt, Snowflake, and Airflow Develop scalable data models for self-service BI (Tableau, Power BI) Collaborate with cross-functional teams to deliver data solutions Apply best practices in software development and DataOps Ensure compliance with data security and governance standards What were looking for Strong … SQL skills with experience across multiple sources Hands-on experience with dbt, Snowflake, and Airflow Knowledge of BI tools and data modelling best practices Solid Excel skills Collaborative, proactive, and eager to work with evolving tech Nice to have Cloud platform experience ( AWS, Azure, GCP ) Familiarity with Git, CI/CD, and Python More ❯

Data Engineer – Leeds – Hybrid - Azure An innovative fintech scale-up revolutionising how financial institutions leverage their data assets. Based in Leeds, they're building next-generation solutions that help banks, investment firms, and financial services companies unlock the true potential of their data to drive smarter investment decisions and enhance customer experiences. The Role … They need a talented Data Engineer to join their rapidly expanding engineering team in Leeds. You'll be architecting robust data systems that power critical financial analytics, working with modern cloud technologies whilst tackling real-world challenges in the fast-paced fintech sector. This is an excellent opportunity for someone ready to make their mark in … be brilliant Understanding of CI/CD processes for deploying data solutions Some exposure to big data technologies and distributed processing Nice to haves: ML pipeline experience Previous fintech or financial services exposure If you are on the market for a new role and are looking to join a business making real impact, APPLY NOW More ❯

Your new company A Principal Data Engineer is required on a permanent basis for a forward-thinking organisation at the heart of Leeds. The Data Services team are on a mission to unlock the value of data by delivering high-quality, secure, and accessible data services. With a focus on modern cloud … based technologies and strong partnerships, they help colleagues navigate the complexities of a data-driven world. Your new role As a Principal Data Engineer, you will be instrumental in shaping the organisations strategic cloud data platform. You'll lead the design and implementation of scalable data pipelines, drive innovation in data … leadership role where you'll establish best practices, ensure compliance, and deliver smart, customer-focused solutions. What you'll need to succeed You'll bring extensive experience in data engineering within Azure environments, with a strong track record in modernisation and large-scale migration projects. You'll be confident designing metadata-driven frameworks and managing Databricks environments, with More ❯

model? We are seeking a Senior Backend Developer to support the development of our AI-driven marketing platform, with a strong focus on performance, scalability, and data pipeline architecture. This role is ideal for someone experienced in backend API development and working with modern data infrastructure. At Ask BOSCO® , we're on a mission to … Senior Backend Developer you won't just write code - you'll shape the future of a high-growth MarTech product, lead technical strategy, and work directly with founders, data scientists, and clients to deliver impactful, intelligent solutions. If you're excited by ownership, innovation, and the chance to make a real mark in a scaling business, this is … of profits donated to 1moreChild orphanage yearly Markets: Marketing & eCommerce Agencies. eCommerce retailers. Your Expertise: Highly experienced Developer with experience of backend API development and working with modern data infrastructure. At ASK BOSCO® , part of Modo25, we're building a smarter, faster, people-first marketing tech business. We're entering a phase of accelerated growth, and you'll More ❯

Job Title: Data Engineer Salary: £40k - £60k + Excellent Benefits Package Location: Huddersfield (Hybrid) Key Skills: SQL, PowerBI, Airflow Summary A new role has opened up for a Data Engineering with SQL, BI, Cloud and Airflow DAG to join a media-focused business. The role has opened up as the company are heavily investing, and have … exciting plans for their data team. i This a permanent position being offered on a hybrid basis with 2 days onsite from their Huddersfield office. The Company You would be joining a highly-regarded business with over 20 years' experience in their field. Their mission is to provide their impressive client-base with the tools to run their … an employee you will have access to retail discounts, flexitime, health and wellbeing programs, and company pension schemes. The Role You will play a key role in transforming data sets to access insights to access the company, and their client base. Your responsibilities will cover: Develop data models to support company Business Intelligence Write and optimize More ❯

DATA ENGINEER £65,000 + BENEFITS Remote (UK based) Looking for a role where you can take ownership of a modern cloud data warehouse, optimise pipelines, and make data more scalable, reliable, and cost-effective? THE COMPANY: I'm working with a global retail & e-commerce brand that's expanding rapidly across the UK. … With a growing digital and physical presence, their central data team plays a key role in powering insights across e-commerce, retail, finance, and marketing. THE ROLE: This is a hands-on data engineering role where you'll focus on building, optimising, and scaling pipelines into BigQuery (GCP) from a wide range of sources. You'll … work closely with BI developers and analysts to ensure clean, reliable data is available for reporting and decision-making. Manage and optimise pipelines from ERP, website, APIs, app stores, social media, and more. Work with BigQuery, Google Buckets, Python scripts, and Talend (transitioning to Dataform/Cloud workflows). Support migrations between GCP projects and ensure the warehouse More ❯

on in code and c30% leading - making key architectural decisions, mentoring, and setting technical direction. Responsibilities Own the architecture of the software systems, from drone control to cloud data pipelines Build backend control systems in Go, with critical components in C++ Design scalable cloud orchestration strategies (Railway, AWS, Kubernetes) Deliver advanced features including multi-drone (M:N) coordination … growing team of developers across multiple disciplines Drive technical standards, code quality, and test-driven development Upcoming Projects: Multi-drone coordination and control systems Next-gen data pipeline and product architecture Distributed and cloud-native scaling of core systems Advanced weather-intelligence and autonomy features Our Tech Stack Backend: Go C++ (Either or both - will allow upskill More ❯