17 of 17 Permanent Data Pipeline Jobs in Leeds

Senior Data Ops Data EngineerLeeds 2/3 days per week£55,000-£67,000+ Excellent Benefits18 Months FTC with long term potential Your New Company Our large public sector organisation are seeking a senior Data Platform DataOps Engineer to serve as our clients first DataOps specialist in a growing team of Data Engineers and DevOps professionals.In this pivotal role, you will focus on operationalising and automating their data lifecycle to ensure that data workflows perform with reliability and efficiency. You will integrate CI/CD data pipelines, streamline deployment processes, enforce robust data governance, and optimise operational costs within our Microsoft Azure … APIM. Proficiency in developing CI/CD data pipelines and strong programming skills in Python, SQL, Bash, and PySpark for automation. Strong aptitude for data pipeline monitoring and an understanding of data security practices such as RBAC and encryption. Implemented data and pipeline observability dashboards, ensuring high data More ❯

Purpose of the Job: Design, build, and maintain robust data systems and pipelines that support data storage, processing, and analysis on the Cloud. Work with large datasets, ensuring data quality, scalability, and performance, while collaborating. closely with data scientists, analysts, and other engineering teams to understand their data needs and … provide them with high-quality, accessible data. They are responsible for ensuring that the underlying data infrastructure supports the organizations broader data and business goals, enabling more effective data-driven decision-making. Key Accountabilities: • Design and implement scalable, efficient, and secure data architectures, ensuring optimal data flow across systems in … and process across the team along with BI lead. • Influence the evolution of business and system requirements and contribute to the design of technical solutions to feed a delivery pipeline that increasingly employs Agile methods such as SCRUM and Kanban • You will be required to develop unit tested code and then support test cycles including post implementation validation. You More ❯

Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £60,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital transformation and building a cloud-first, data-led approach to support major environmental goals. Think scalable pipelines, secure platforms, and data systems that … directly contribute to a greener future. As a Senior Data Engineer, you'll play a key role in designing and delivering robust, cloud-based data infrastructure. You'll work with large datasets, build scalable pipelines, and help ensure data is high quality, secure, and accessible, while mentoring more junior engineers and working closely with … stakeholders across the business. Key Responsibilities: Develop scalable and secure data architectures ensuring optimal data flow Cloud data platform development, data modelling, shaping and technical planning Implementing best practices around data security, governance, privacy, and compliance Ensure company data is secure, accurate, maintained and available. Mentor data More ❯

a great place to work and as our business expands, we are looking for ambitious, talented people to join us. We are looking for a technically proficient Senior Data Engineer to join our growing Data team. Your primary focus will be on ensuring data quality, stability, and reliability … from the moment data arrives in its rawest form to when it is used in decision-making dashboards and customer-facing reports. You will optimise the transformation pipeline from start to finish, guaranteeing that datasets are robust, tested, secure, and business-ready. Our data platform is built using Databricks, with data pipelines written … in PySpark and orchestrated using Airflow. You will be expected to challenge and improve current transformations, ensuring they meet our performance, scalability, and data governance needs. This includes work with complex, nested data structures, ensuring they are reliably parsed and transformed. Experience in managing sensitive data (PII) and implementing GDPR policies is required. You More ❯

JOB TITLE: Senior Data Engineer SALARY: £70,929 - £78,810 LOCATION: Edinburgh, Manchester, Leeds or Bristol HOURS: Full time WORKING PATTERN: Hybrid, 40% (or two days) in an office site About this opportunity At Lloyds Banking Group, we're moving to the next stages of our digital transformation, and it's our job within the Chief Security Office … CSO) to ensure that we keep our customers, colleagues and assets safe from threat. The CSO's Security Data Services lab does this by using data to build security insights by working collaboratively with our Data Management and Analytics teams. This is an exciting opportunity for a Senior Data Engineer to join … the Security Data Services lab to collaborate with the Data Operations, Software Engineers, Data Scientists, and Business SMEs to design, develop, integrate and test Data Product features on the product roadmaps to meet customer needs. What you'll do Engineer Data Products that are stable, scalable, performant, accessible, testable and More ❯

SENIOR ANALYTICS ENGINEER UP TO £80,000 + BENEFITS PRIMARILY REMOTE Looking to take ownership of scalable data models, shape a brand-new analytics function, and work with the modern data stack from day one? THE COMPANY: I'm working with a fast-scaling, tech-driven organisation that's investing heavily in its data capabilities. As part of a wider data transformation, they're building out a dedicated Analytics Engineering team focused on creating scalable, trusted data infrastructure. With strong support from BI, Data Science, and Engineering teams, this function is central to how the business defines and uses data going forward. THE ROLE … skills and hands-on experience with dbt (or similar tools) Experience designing as well as building data models Exposure to Snowflake and/or data pipeline tools Understanding of testing, CI/CD, and data quality frameworks THE BENEFITS: You will receive a salary dependent on experience-up to £80,000. On top More ❯

Role: Data Engineering Manager Salary: £65,000- £75,000 per annum Location: Leeds (One day on site). VIQU have partnered with a leading supply chain organisation who are looking to expand their data teams. The Data Engineering Manager will manage a team of eight to help with an on-going digital transformation. The … the clients Databricks platform (AWS is preferred but open to Azure.GCP experience also), utilising Python and SQL, contribute to CI/CD pipelines, strategy development, cost optimisation and data governance frameworks. Job duties of the Data Engineering Manager: Manage a team of eight engineers, helping to mentor and coach the team. Manage the adoption of automated … experience in a managerial role, coaching similar sized teams. Deep knowledge of the Databricks platform. Hands on Python development experience. SQL optimisation. Experience with large scale data pipeline optimisation. Experience with Streaming and Batch Spark workloads. Strong people management skills. Role: Data Engineering Manager Salary: £65,000- £75,000 per annum Location: Leeds (One day More ❯

Lead Data Architect £67,000 - 76,000 GBP Hybrid WORKING Location: Leeds, Yorkshire and the Humber - United Kingdom Type: Permanent Lead Data Architect Locations: Leeds, Manchester, Birmingham, Bristol, Glasgow, or London (Hybrid - up to 2 days on-site per week, remainder remote) Salary: £67,000 - £76,000 (non-London)/Up to £83,000 (London) + … Benefits A respected digital consultancy is hiring a Lead Data Architect to join its growing Data Engineering practice. Known for delivering modern, human-centred services across public and private sectors, this organisation supports clients through meaningful transformation by combining data, design, and engineering. This role is ideal for experienced architects who enjoy shaping cloud … native data platforms, working in multidisciplinary teams, and embedding data governance and architectural rigour across complex service ecosystems. The Role: As a Lead Data Architect, you'll play a key role in designing scalable, secure, and accessible data platforms that enable insight-driven decision-making. You'll work closely with engineering teams More ❯

Lead Data Engineer - Leeds This is an exciting opportunity for a skilled Lead Data Engineer to advance their career while remaining deeply technical. The role offers a clear path for progression without requiring a move into management or sales, allowing individuals to focus on what they do best-engineering high-quality, scalable data solutions. … ensure that individuals are recognised and supported-especially during demanding projects. The business is committed to employee wellbeing and fosters a positive, inclusive culture. Role Overview The Lead Data Engineer will take a hands-on technical leadership role, guiding the delivery of high-impact solutions within cloud-based environments. This position is ideal for professionals who are passionate … about modern data engineering and want to influence best practices, architectural decisions, and agile delivery across teams. The role involves close collaboration with multidisciplinary teams and requires strong communication skills to translate technical approaches for non-technical audiences, including senior stakeholders and clients. Key Responsibilities Lead the design, development, and optimisation of robust data pipelines and More ❯

Azure Data Engineer - Leeds (Hybrid) - £65,000 Are you an experienced Azure Data Engineer with a passion for building scalable, cloud-native data solutions? We're recruiting on behalf of a dynamic organisation in Leeds that's investing in its data platform - and they're looking for someone with strong Databricks expertise … to join their team. About the role: Designing and developing robust data pipelines using Azure Data Factory, Databricks, and Synapse Analytics. Working with Delta Lake and Azure Data Lake Storage to manage and optimise large datasets. Collaborating with data analysts, engineers, and business stakeholders to deliver clean, reliable data. Supporting the migration … of legacy systems to a modern Azure-based architecture Ensuring best practices in data governance, security, and performance tuning Requirements: Proven experience with Azure Data Services (ADF, Synapse, Data Lake) Strong hands-on experience with Databricks (including PySpark or SQL) Solid SQL skills and understanding of data modelling and ETL/ELT More ❯

Job Title: Senior Data Engineer Salary: Up to £60,000 Location: Leeds (Hybrid - 2 days a week in the office) Are you a data engineering expert ready to take the next step in your career? We're hiring a Senior Data Engineer to join our growing team in Leeds. You'll play a critical … role in designing, building, and managing modern data pipelines and cloud-based data solutions. What you'll be doing: Designing and maintaining scalable data pipelines Building and optimising data warehousing solutions Working with Databricks … and modern cloud platforms (Azure or AWS) Collaborating with cross-functional teams to deliver high-impact data products Leading best practices in data engineering and pipeline architecture What we're looking for: Proven experience in data engineering at a senior level Strong hands-on knowledge of Databricks Experience with Azure or AWS cloud More ❯

Lead Data Engineer - Remote - UK About the Role: We're hiring on behalf of a fast-growing, tech-driven organisation looking for a Lead Data Engineer to take ownership of their data infrastructure. This is a fully remote role open to candidates based anywhere in the UK. You'll lead the design and development … of scalable data pipelines, mentor a small team of engineers, and work closely with cross-functional teams to deliver high-impact data solutions. Key Responsibilities: Architect and maintain robust data pipelines using AWS services (Glue, Lambda, S3, Airflow) Lead the migration and optimisation of data workflows into Snowflake. Collaborate with analysts, data scientists, and product teams to deliver clean, reliable data. Define and enforce best practices in data engineering and governance. Mentor junior engineers and contribute to a culture of technical excellence Requirements: Proven experience in a Lead or Senior Data Engineering role Strong hands-on expertise with AWS (Glue, Lambda, S3) Deep experience with Snowflake More ❯

AWS Data Engineer - IT Consultancy - Leeds - Hybrid Are you a data engineer with a passion for AWS and solving real-world business problems? I am working with a fast-growing IT consultancy based in Leeds that's delivering cutting-edge cloud and data solutions to clients across the UK. They're looking for their … next AWS Data Engineer to join the team. As an AWS Data Engineer, you'll be working on a variety of client projects, helping to design, build, and optimise scalable data pipelines and cloud-native architectures. You'll collaborate with cross-functional teams to deliver high-impact solutions that drive business value. Requirements: Experience … as a Data Engineer using AWS: Glue, Lambda, S3, Redshift, Athena, EMR. Snowflake experience (Not essential) Strong Python SQL & NoSQL databases CI/CD tools : GitHub Actions or CodePipeline Infrastructure as Code (Terraform is preferable) Experience building ETL/ELT pipelines Familiarity with data lake and data warehouse concepts Excellent communication and stakeholder engagement More ❯

Senior Data Engineers with a background are required by this major client, who is creating a new start up engineering capability in their Leeds offices, where you will provide best in class Data Engineering services to a wide range of major Public Sector organisations. As a result of the work that they do, this client requires … national or dual UK national. Please note your application will not be taken forward if you cannot fulfil these requirements. In order to secure one of these Senior Data Engineer roles you must be able to demonstrate the following experience: Experience in prominent languages such as Python, Scala, Spark, SQL. Good experience in using Databricks Experience working with … Knowledge and experience using at least one Data Platform Technology such as Quantexa, or Palantir Knowledge of test automation frameworks and ability to automate testing within the pipeline This is an opportunity for significant growth, but with a start-up feel and mentality. In this role you will have the chance to build and be part of More ❯

What you’ll be doing We’re looking for someone who has experience guiding teams and supporting clients to use data to make better decision making. Data is at the heart of everything we do and we're working on some amazing projects across both our Health and Private clients. If you're interested in being … involved in work that delivers real value then we'd love to hear from you! What you’ll bring to Answer Designing and implementing complex data pipelines, leveraging both NoSQL and relational databases. Develop and manage cloud-based data solutions, ensuring scalability and security. Lead and mentor junior data engineers, promoting knowledge sharing and … professional growth. Implement and oversee CI/CD pipelines, ensuring efficient deployment of data services. Proficiency in Python, SQL, and other relevant backend languages. Utilise backend programming languages effectively for data processing and manipulation. It would be great if you also had experience in some of these, but if not we’ll help you with them More ❯

Job Title: Data Engineer Location: Leeds/Hybrid (2x per week on site) Salary: Up to £55,000 per annum Why Apply? This is an exciting opportunity for an experienced Data Engineer to play a pivotal role in a business critical data transformation project. With a major migration to Microsoft Fabric underway, you'll … the very beginning of this journey, contributing to tooling decisions, shaping future architecture, and helping to knowledge share with the wider team. Responsibilities: Design, build, and maintain scalable data pipelines and ELT processes using Microsoft Fabric and related tools Optimise data flows and models for performance, scalability, and cost efficiency Collaborate closely with Analysts to deliver … data for reporting and insight Work alongside the Governance team to ensure data is secure and well managed Support the migration from an on-prem SQL Server data warehouse to Microsoft Fabric Contribute to knowledge sharing and training across the wider team Requirements: Proven experience designing and implementing solutions in Microsoft Fabric Proficiency in More ❯

SENIOR DATAOPS ENGINEER £60,000 + BENEFITS LEEDS (Hybrid) Looking for a role where you can take a step back, look across the whole data platform, and make it faster, smarter, and more cost-efficient? THE COMPANY: I'm working with a central data function in financial services that's building a high-performing platform team … focus on improving the efficiency, observability, and cost-effectiveness of data pipelines running across a modern cloud stack. Take a "helicopter view" of the platform and monitor pipeline performance Identify bottlenecks, streamline processes, and optimise job run times Drive automation and reduce manual intervention across the platform Ensure pipelines are production-grade: scalable, monitored, and cost-efficient … successful Senior DataOps Engineer will have the following skills and experience: Strong hands-on experience with Azure Background in Data Engineering Experience with monitoring, observability, and resolving pipeline issues Experience automating workflows and improving data system reliability THE BENEFITS: You will receive a salary, dependent on experience. Salary is up to £60,000 On top More ❯