1 to 25 of 37 Data Pipeline Jobs in Lancashire

allowance based on a skills assessment Published on 10 July 2025 Deadline 30 July 2025 Location Croydon, Manchester, Sheffield About the job Job summary As a Lead Data Architect, you will create and uphold data architecture across critical Home Office systems, enabling secure, data-driven services that keep the country safe. Working under the … vision set by the Principal Data Architect, you'll design robust data models, metadata systems, and governance frameworks to serve diverse stakeholders. Your leadership will span strategic planning, mentoring junior data architects, and aligning technical decisions with business objectives. If you thrive on architecting solutions that integrate emerging technologies such as cloud-native platforms … data lakehouses, streaming data pipelines and AI-powered analytics while collaborating with multi disciplinary teams, this role offers you the chance to elevate how the Home Office exploits data for maximum public impact. Due to business requirements this post is available on a full time/flexible working basis. Where business needs allow, some More ❯

that adventure. Our employees are at the heart of delivering impactful and meaningful work for our clients and helping them to reach for and realise their vision. Snowflake Data Architect Slalom is seeking an experienced Snowflake Data Architect to contribute to its growing Data Capability. The ideal candidate is a professional with experience in … designing, developing, validating and communicating enterprise data solutions using Snowflake. Deep experience in developing enterprise data management strategies including data lake/warehouse implementations, data movement, data services, data acquisition, data conversion, and archive/recovery. What will you do? Lead as a hands-on architect … and governance concepts such as data quality, metadata management, etc. Experience in designing data engineering solutions using open source and proprietary cloud data pipeline tools Experience in leading data platform development teams Knowledge of data science and visualisation Must have Snowflake SnowPro Core Certification and ideally SnowPro Advanced too More ❯

As a Lead Data Architect, you will create and uphold data architecture across critical Home Office systems, enabling secure, data-driven services that keep the country safe. Working under the vision set by the Principal Data Architect, you'll design robust data models, metadata systems, and governance frameworks to serve … diverse stakeholders. Your leadership will span strategic planning, mentoring junior data architects, and aligning technical decisions with business objectives. If you thrive on architecting solutions that integrate emerging technologies such as cloud-native platforms, data lakehouses, streaming data pipelines and AI-powered analytics while collaborating with multi disciplinary teams, this role offers you the … chance to elevate how the Home Office exploits data for maximum public impact. In this role, you will translate strategic data vision into tangible designs and solutions, ensuring data assets are secure, well-structured, and aligned with evolving Home Office priorities. Partnering with Technical Architects, Principal Data Architects, and various data More ❯

DEPT/AI has a single mission: to make the best work in the industry using Data & AI to enhance everything we do. This role sits within our Data & AI practice, which has deep expertise in leveraging AI. The team includes data strategists, consultants, data scientists and analysts that work alongside DEPT … and most challenging problems facing some of the best loved brands in the world - and doing this alongside an experienced team. This role is part of our EMEA Data craft team, an integrated craft across Europe driving data engineering, data science, and AI initiatives. We combine our expertise in data architecture, analytics … and AI to deliver exceptional data-driven solutions that build lasting relationships with our clients like Footlocker, Nikon, Rituals, and Philips ROLE OVERVIEW The Lead Data Engineer is responsible for building and leading our data engineering capabilities across EMEA and setting technical standards. This senior technical leadership role will drive the strategic vision for More ❯

hunt for builders . No, we've not ventured into construction in our quest to conquer the world, rather a designer and builder of systems for all things data related where we are conquering the Data World. We can offer an interesting insight into projects spanning a variety of sectors, which may include industries such as … to explore our dynamic team where you can truly act as an expert in your field in support of our clients and their challenges in the world of data and technology, read on! The Team We're Intuita - a fast growing consultancy that's making waves in both the consultancy and technology space. With our ambitious goals for … in the data pipelines. • Stay updated with the latest Azure technologies and industry best practices to continuously enhance data engineering capabilities. Looking at our current pipeline of work, we can also consider those with an Analytics Engineering lean, with experience within BigQuery (GCP) with data modelling in DBT and mobile/telecoms industry More ❯

Senior Machine Learning Operations Engineer Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £65,000 - £75,000 - depending on experience Department: Technology and Data We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they … our colleagues too; we won Insurance Employer of the Year at the British Insurance Awards 2024 and our Glassdoor score is pretty mega too! We're big on data: it gives us the insights we need to give the right cover to the right customers at the right price. But it's the people inside and outside our … Deploying Infrastructure as Code (IAC) across various environments such as dev, uat and prod Handling large volumes of data in various stages of the data pipeline, from ingestion to processing Proven experience with feature stores, using them for both offline model development and online production usage Building integrations between cloud-based systems using APIs, specifically More ❯

Job Position: Graduate Data Analyst (Engineer/Scientist) - via the Graduate Development Programme Locations: We are able to consider candidates across the North West Starting Salary: £25,000 Application Requirements: Minimum 2:1 or above in a STEM (Science, Technology, Engineering, and Math) subject. Experience in analysing data. Right to work in the UK unsponsored for the duration … delivering excellence. If you have a keen attention to detail and accuracy, a knack for spotting trends and patterns and the ability to tell a compelling story using data, you'll thrive in our environment. We value resourcefulness, resilience, and a passion for driving change. Join us and be part of a community that cares, collaborates, and thrives … together. Understanding the types of roles available to a Data Analyst: Data Analyst: Kick-start your career as a Data Analyst, where you'll transform complex data into actionable insights, create dynamic visualisations and drive business decisions. You'll work with cutting-edge tools, collaborate with stakeholders, and develop automated reports and More ❯

Data Engineer - Leading Pharmaceutical Company - Manchester(Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies)About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge … technologies and contribute to exciting projects in a collaborative environment.About the Role: Our client is seeking an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone passionate … about improving processes, ensuring data quality, and maintaining compliance with regulatory standards. focusing on designing, developing, and maintaining data pipelines, ETL processes, and databases. If you are passionate about driving continuous improvement and ensuring data quality and compliance, we want to hear from you.Key Responsibilities:Design, develop, maintain, and optimise data pipelines More ❯

Our Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing high-quality, cost-efficient data platforms and services tailored to clients' needs. They develop, operate, and maintain these services, ensuring maximum value for data consumers, including analysts, scientists, and business stakeholders. Key responsibilities As a Senior … Data Engineer, you may assume multiple roles based on our clients' needs. The role is highly hands-on, supporting project delivery as a senior contributor and upskilling client team members. You might also take on a technical architect role, collaborating with the MadeTech team to identify growth opportunities within the account. You'll need a drive to deliver … criteria. Enthusiasm for learning and self-development Proficiency in Git (including Github Actions) and understanding of branch strategies Experience gathering and meeting requirements from clients and users on data projects Strong experience in Infrastructure as Code (IaC) and deploying infrastructure across environments Managing cloud infrastructure with a DevOps approach Handling and transforming various data types (JSON More ❯

passionate about helping our people get more out of life too; building careers with real growth, a sense of purpose, belonging and wellbeing. About the role This Principal Data Engineer role will work exclusively within our AdTech business unit whilst ensuring alignment to best practices, standards, and policies. The strategic direction is led by the Data … and input from this role. This role will work within the AdTech squad focusing on their priorities that will enable a consistent, efficient, and effective use of the Data Lake, Enterprise Data Warehouse, and marketing tools. Any experience with automating process and embedding re-useable patterns is interesting. As our AdTech Principal Data Engineer … includes technically managing AdTech priorities across various technologies and collaborate with architecture, product owners and delivery lead to ensure timely, efficient solution creation/maintenance. The AdTech Principal Data Engineer will interact with the core Data Engineering team, and collaborate and align with agreed solutions, policies, and delivery mechanisms. In this space we run daily stand More ❯

SENIOR ANALYTICS ENGINEER UP TO £80,000 + BENEFITS PRIMARILY REMOTE Looking to take ownership of scalable data models, shape a brand-new analytics function, and work with the modern data stack from day one? THE COMPANY: I'm working with a fast-scaling, tech-driven organisation that's investing heavily in its data capabilities. As part of a wider data transformation, they're building out a dedicated Analytics Engineering team focused on creating scalable, trusted data infrastructure. With strong support from BI, Data Science, and Engineering teams, this function is central to how the business defines and uses data going forward. THE ROLE … skills and hands-on experience with dbt (or similar tools) Experience designing as well as building data models Exposure to Snowflake and/or data pipeline tools Understanding of testing, CI/CD, and data quality frameworks THE BENEFITS: You will receive a salary dependent on experience-up to £80,000. On top More ❯

Prestigious opportunity for a Data Platform Engineer within a pioneering technology team based in Manchester. Following a period of significant growth, investment and a cloud transformation, we are inviting you to join our success story! As our Azure Data Platform Engineer, you will be responsible for:- Designing, building, and maintaining scalable data solutions on … Microsoft Azure. Designing and implementing scalable data pipelines using Azure Data Factory, Databricks, Synapse Analytics, and other Azure services. Leading technical workstreams and supporting project delivery. Acting as the subject-matter expert for cloud-based data engineering. Ensure data governance, security, and compliance standards are met. Monitoring and troubleshooting data platform performance and issues. Automate data ingestion, transformation, and integration processes. Document technical solutions and maintain best practices. If you possess a combination of some of the following skills, then LETS TALK! Proven experience with Azure data services (SQL, Data Factory, Data Lake, Synapse, Databricks, Azure SQL and Cosmos DB More ❯

Who We Are TetraScience is the Scientific Data and AI Cloud company. We are catalyzing the Scientific AI revolution by designing and industrializing AI-native scientific data sets, which we bring to life in a growing suite of next gen lab data management solutions, scientific use cases, and AI-enabled outcomes. TetraScience is the … in this vital new market, generating more revenue than all other companies in the aggregate. In the last year alone, the world's dominant players in compute, cloud, data, and AI infrastructure have converged on TetraScience as the de facto standard, entering into co-innovation and go-to-market partnerships: Latest News and Announcements TetraScience Newsroom In connection … EU. The ideal candidate should have expertise in customer and field enablement, adult learning principles, educational program creation, use case architecture and implementation, and a genuine passion for Data and AI technologies. The candidate should be driven by a desire to educate and inspire, and have the technical skills to quickly prototype new ideas and solutions. And finally More ❯

Haywards Heath, Home Office (Remote) or Manchester Salary: £55,000 - £65,000 depending on experience Department: Finance We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great value insurance with an excellent service. And that's … Lead Finance Solutions Developer 1st Central are on the lookout for a technically strong and analytically minded Lead Finance Solutions Developer who can bridge the gap between finance, data engineering, and actuarial analytics. If you're passionate about delivering high-quality, scalable data solutions to support business-critical decisions, and you enjoy working across multidisciplinary teams … this could be the perfect role for you. You'll play a key role in designing and maintaining data pipelines and tools that enable complex financial and actuarial modelling, reporting, and insight. Even if your background is more analytical or engineering-focused - and you don't meet every single requirement - we still encourage you to apply . We More ❯

Data Engineer Join a Trailblazing Team in Clinical Research Data ManagementStep into a role that places you at the cutting edge of clinical trials, leveraging Electronic Health Record (EHR) data to revolutionise patient care and research. Based in the innovative Manchester Science Park, this position offers the chance to be part of a world … is usually on Tuesdays and Thursdays but can be subject to change. Strong benefits package This role focuses on the development, performance, management, and troubleshooting of ETL processes, data pipelines, and data infrastructure. The successful candidate will ensure the effective and reliable operation of these systems, adopting new tools and technologies to stay ahead of industry … best practices. Collaboration across teams to define solutions, requirements, and testing approaches is essential, as is ensuring compliance with regulatory standards.Key Responsibilities:- Design, develop, maintain, and optimise data pipelines, ETL processes, and databases.- Drive continuous improvement by refining processes and identifying new tools and standards.- Collaborate with cross-functional teams to define solutions and testing approaches.- Ensure compliance More ❯

AWS Data Engineer - Manchester - Hybrid - £75,000 We're working with a global insurance company that's redefining the industry through technology. As a key end user of AWS, they're leveraging cloud-native solutions and advanced analytics to transform how they serve millions of customers. They're looking for Data Engineers who are passionate about … building scalable data platforms and want to be part of a forward-thinking team. You'll work on modern data pipelines, cloud infrastructure, and real-time analytics projects that directly impact business outcomes. As an AWS Data Engineer, you'll play a critical role in building and maintaining our cloud-based data infrastructure. You'll work closely with data scientists, analysts, and other engineers to design, develop, and deploy scalable data solutions on the AWS platform. The client operates with a hybrid working model, with two days per week in their Manchester office. Responsibilities: -Design, build, and maintain data pipelines using AWS services such More ❯

Lead Data Engineer - Manchester - Hybrid - £75k - £80k This is an excellent opportunity for a highly experienced data engineer to join a growing tech consultancy and contribute to the leadership of their data engineering practice. If you are an experienced and capable data engineer with a history of using Microsoft products and working … of clients to gather requirements and deliver solutions. Be willing to engage and assist in pre-sales activities, bids, proposals etc. Use key techniques such as Governance, Architecture, Data Modelling, ETL/ELT, Data Lakes, Data Warehousing, Master Data, and BI. Consistently utilise key processes in the engineering delivery cycle including Agile … and DevOps, Git, APIs, Containers, Microservices and Data Pipelines. Assist in building out, developing, and training the data engineering function. What do I need to apply Strong MS data engineering expertise (Fabric, ADF, ADL, Synapse, SQL) Expert use of Databricks Strong Python experience Consultancy experience Leadership experience My client are looking to book in More ❯

DATA ENGINEER/MANCHESTER/HYBRID/£60,000 - £67,000 PLUS BENEFITS WEX Europe Services Ltd are the owner of the Esso Card Fuel Card Portfolio, and with offices across Europe and the US are one of the Europe’s largest providers of fuel cards. As a Data Engineer at WEX, you’ll be responsible … for building and maintaining the bridge between our data and the rest of the organization. You’ll work with stakeholders to understand business requirements and then implement SQL-first transformation workflows to deploy analytics code. You’ll help ensure the integrity, reliability, and usability of data for stakeholders, so they can make critical data … are a critical thinker with strong analytical and problem-solving abilities. You are self-motivated and able to work independently with minimum supervision. We are seeking an experienced Data Engineer to play a critical role in the development of WEX's data & analytics capabilities. You will be part of an organization focusing on the development and More ❯

Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: from £70,000 depending on experience Department: Technology and Data We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great value insurance with an … design, through development and testing, to deployment, production, monitoring and continuous improvement optimising cutting-edge AI solutions across the business. One day you might be collaborating with our Data Scientists, Software Engineers and Architects on a new GenAI capability. The next, you're fine-tuning prompts or experimenting with Computer Vision and Natural Language Processing (NLP). You … control, and continuous integration. Develop and maintain automated frameworks for testing, validation, and monitoring of AI model accuracy, performance, and reliability. Establish best practices for AI data pipeline development and integration with infrastructure to support scalable deployment. Collaborate closely with Data Scientists, Data Engineers, Software Developers, and Architects for seamless execution of AI More ❯

Data Engineer Hybrid Lancashire (2 Days Onsite per Week) Permanent | 37 Hours | £55,000£65,000 + Benefits Looking to use your data engineering skills … on meaningful projects? We're working with an established UK-based technology business that develops solutions to support critical national infrastructure. With demand growing and new projects in the pipeline, the company is expanding its data team and looking for a proactive, cloud-savvy Data Engineer. What Youll Be Doing: Designing and building scalable data pipelines across a modern cloud platform. Driving automation and ensuring data quality in complex data workflows. Contributing to the design and development of robust data architecture. Collaborating with internal teams to solve data challenges and support analytics. Sharing best practices and mentoring less experienced colleagues. What Youll Need: Hands-on More ❯

defence leaders to act with confidence in an increasingly complex world. Our trusted defence, security, and geopolitical information delivered through seamless digital platforms and system integrations-turns overwhelming data into clear, actionable intelligence and insight. By filling critical information gaps, Janes helps customers analyse threats, accelerate decisions, and stay ahead of emerging challenges. Job purpose: We are seeking … experienced Software Engineers with expertise in one of a number of identified technical areas, who have a strong background working with complex data, comprehensive experience in developing, high impact scalable systems, transforming and delivering complex datasets, and showing a high appreciation for data quality. You will be working as part of a multi-functional team based … DocumentDB/MongoDB RDF Graph database such as GraphDB ML/AI such as Sagemaker/Bedrock Search technologies such as SOLR or Opensearch/ElasticSearch Data pipeline engineering utilising cloud-based technologies (AWS) Write high quality clean, testable code, with a focus on incremental innovation. Take part in code and design reviews helping to improve overall More ❯

Data Engineer (AI-Driven SaaS plaform)(Python, Snowflake, Data Modelling, ETL/ELT, Apache Airflow, Kafka, AWS)Large-scale data environmentUp to £70,000 plus benefitsFULLY REMOTE UK Are you a Data Engineering enthusiast who thrives from designing and implementing robust ETL processes, highly scalable data structures and data pipelines within a truly enterprise-scale data processing environment? Do you want to work on an AI-Driven SaaS platform that's utilised by some of the biggest brands in the world? If so - look no further.This is your chance to help my client build their new Data Infrastructure and essentially help them to … leverage the power of data, working on large-scale data processing systems.They have an award-winning, enterprise-scale SaaS platform that was without a doubt, revolutionized its industry and is being utilised by some of the biggest companies and brand names in the WORLD. They have grown quickly and have truly made an impact in their More ❯

SQL Data Engineer – Cloud Architecture & Web App Focus Are you a SQL expert with a passion for cloud-based data systems and real-world impact? We're hiring a SQL Data Engineer to support the development of a modern, data-driven web application — and we’re looking for someone who thrives at … the intersection of cloud infrastructure and application data flows. This isn’t just about writing queries -it’s about building the right foundation for data to power a product. What we’re looking for: Strong SQL skills – you write clean, efficient queries and understand how to structure data for scale Cloud architecture experience – you … ve worked with cloud-first data environments (AWS, Azure, or GCP) Web application exposure – you understand how data integrates with live, user-facing applications and backend services Experience designing, building, and managing cloud-native data pipelines Comfortable collaborating with cross-functional teams (engineering, product, stakeholders) Nice to have: Familiarity with tools like dbt, Airflow More ❯

Data Engineer Location: Burnley, Lancashire Contract: Permanent - 37.5 hours per week Hybrid (2 days a week in office) Salary: £50-55,000 + performance bonuses + great benefits Are you a passionate Data Engineer looking to work on meaningful projects that make a difference to the environment? Fancy joining a friendly, inclusive team where your ideas … and growing organisation thats been a pioneer in water network monitoring for over 20 years. As the sector steps up to meet new environmental challenges, the demand for data-driven solutions is growing fast - and this team is at the forefront of it all. If youre excited by working with large, complex datasets, building scalable data pipelines, and helping to solve real-world problems, wed love to hear from you. What youll be doing: Designing and building pipelines in the data platform, with automation, quality and resilience at the core. Supporting the development of a scalable data architecture and engineering roadmap. Helping colleagues across the business solve data More ❯

Lead Data Engineer - Remote - UK About the Role: We're hiring on behalf of a fast-growing, tech-driven organisation looking for a Lead Data Engineer to take ownership of their data infrastructure. This is a fully remote role open to candidates based anywhere in the UK. You'll lead the design and development … of scalable data pipelines, mentor a small team of engineers, and work closely with cross-functional teams to deliver high-impact data solutions. Key Responsibilities: Architect and maintain robust data pipelines using AWS services (Glue, Lambda, S3, Airflow) Lead the migration and optimisation of data workflows into Snowflake. Collaborate with analysts, data scientists, and product teams to deliver clean, reliable data. Define and enforce best practices in data engineering and governance. Mentor junior engineers and contribute to a culture of technical excellence Requirements: Proven experience in a Lead or Senior Data Engineering role Strong hands-on expertise with AWS (Glue, Lambda, S3) Deep experience with Snowflake More ❯