24 of 24 Data Pipeline Jobs in Lancashire

We are seeking a Data Support Engineer (Level 3) to provide expert technical support and drive the performance and reliability of our data infrastructure. In this role, you will serve as the go-to expert for complex data issues, collaborate with data engineers, analysts, and IT teams to optimize data pipelines, and resolve integration and performance challenges. You will play a key role in ensuring data quality and supporting data-driven decision-making while leveraging your expertise in cloud and on-premises technologies. A … integration and processing issues, troubleshoot performance bottlenecks, and ensure high availability of critical data services with minimal downtime. Data Pipeline Management & Optimization : Oversee and optimize data pipelines (ETL/ELT) across on-premise and cloud environments, ensuring seamless data flow More ❯

the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business … enterprise. Role & Responsibilities: Data Infrastructure & Support: Provide first-line support for data engineering tasks, such as managing and monitoring data pipelines, resolving issues, and ensuring data integrity. Work with both structured and unstructured datasets to design and implement data models … -related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency More ❯

Certifications That Can Boost Your Data Science Career in 2024 In today's data science landscape, how does one set themselves apart from the competition? Let's take a look at seven of the best certifications out there. In today's data science landscape … how does one set themselves apart from the competition? Certifications in data science can greatly enhance your career by proving your skills and creating new job opportunities in 2024. Data science certificates help to gain knowledge about data science. They also help to validate … s degree and three years of experience or seven years of non-analytics experience are also sufficient. The exam includes topics such as data preparation and model building. Cost: $375 for members, $575 for non-members Validity: 3 years Google Certified Professional Data Engineer The Google More ❯

Description We're seeking a talented and motivated Data Platform Engineer to join our Data Platform and Engineering team. Our aim is to deliver a robust platform that enables Machine Learning and analytics to drive indemnity savings, efficiency benefits and improved customer outcomes. We're focused … on developing our data engineering capability so that machine learning and AI solutions can be developed and deployed internally in a sustainable way within claims analytics. You'll have the opportunity to develop your skills in data orchestration, data governance, CI/CD and … MLOps. You'll also assist in the development of robust data pipelines, optimise data storage and retrieval, and contribute to the overall success of our data-driven initiatives. At AXA we work smart, empowering our people to balance their time between home and the More ❯

UK Head Office - Manchester Hybrid/PERMANENT/SALARY: COMPETITIVE Job Purpose The Data Lead is responsible for leading and growing MPM's data capabilities. Managing the data team, overseeing the design, delivery, and governance of data infrastructure, pipelines, and analytics solutions. … The Data Lead is also responsible for setting and executing the vision for data within the organisation, enabling accurate, timely, and actionable insights through data practices, collaboration, and strong leadership. This role deals with a wide variety of tasks including, but not limited to … the following: Manage, mentor, and grow the newly formed Data Team to deliver high-quality solutions that meet evolving business objectives. Define and maintain the roadmap for data infrastructure, tools, and quality standards. Lead a data-first culture across the organisation, championing data More ❯

Social network you want to login/join with: ZONTAL is revolutionizing data management and digital transformation for the life sciences industry. Our cutting-edge platform enables seamless data integration, standardization, and accessibility—empowering scientists and organizations to drive innovation, enhance compliance, and accelerate breakthroughs in … a subject matter expert in the ZONTAL Platform and its customer use-cases. Analyze business requirements for customer-facing projects, with emphasis on data flows and data formats as they feed into & out of the ZONTAL Platform. Create functional and design specifications for the proposed solution … software, such as Scientific Data Management Systems (SDMS) or Laboratory Information Management Systems (LIMS). Hands-on experience with data pipeline orchestration tools (e.g., Apache Airflow) and data parsing. Familiarity with cloud service models, SaaS infrastructure, and related SDLC. Familiarity with containerization and More ❯

Prestigious opportunity for a Data Platform Engineer within a pioneering technology team based in Manchester. Following a period of significant growth, investment and a cloud transformation, we are inviting you to join our success story! As our Azure Data Platform Engineer, you will be responsible for … Designing, building, and maintaining scalable data solutions on Microsoft Azure. Designing and implementing scalable data pipelines using Azure Data Factory, Databricks, Synapse Analytics, and other Azure services. Leading technical workstreams and supporting project delivery. Acting as the subject-matter expert for cloud-based data engineering. Ensure data governance, security, and compliance standards are met. Monitoring and troubleshooting data platform performance and issues. Automate data ingestion, transformation, and integration processes. Document technical solutions and maintain best practices. If you possess a combination of some of the following More ❯

Head of Data Engineering & Governance, preston, lancashire Client: Data Science Talent Location: preston, lancashire, United Kingdom Job Category: Other - EU work permit required: Yes Job Views: 3 Posted: 04.06.2025 Expiry Date: 19.07.2025 Job Description: Head of Data Engineering & Governance Investment & Wealth Management Hybrid … on wealth management. But now? This company – a trusted name in the UK financial services sector – fully recognise this. They understand that embracing data and AI is what will continue to position them at the forefront of the UK’s investment management sector. This isn’t a dalliance … for investment or dragging people with you. Now, following a recent acquisition, they’re ready to embark on the next phase – transforming the data and harnessing its power. And that’s where you come in. Where you fit in As one of three new leaders in the newly More ❯

Social network you want to login/join with: Data & AI Solutions Deployment Architect, preston, lancashire col-narrow-left Client: Bytes Software Services Location: preston, lancashire, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 8 Posted: 06.06.2025 Expiry Date: 21.07.2025 col … collaboration, recognition and inclusivity and offer a wide range of benefits to support staff wellbeing. Your Future Starts Here PURPOSE OF JOB: The Data & AI Solutions Deployment Architect will be instrumental in architecting and deploying Azure Data & AI Solutions. A solid, technical, ‘hands-on’ (not just … grasp of Azure Fabric is essential as we navigate clients through all of the infrastructure, coding, and product development lifecycle challenges around successful Data and AI implementation and deployment. This customer-centric position involves delivering projects, conducting workshops and physically working on client’s environments via Python, and More ❯

Social network you want to login/join with: Lead Data Scientist (Equity Only) - 1%, Preston, Lancashire Client: Location: Preston, Lancashire, United Kingdom Job Category: Other EU work permit required: Yes Job Views: 4 Posted: 16.06.2025 Expiry Date: 31.07.2025 Job Description: Lead Data Scientist - Equity-Only … for diverse creators from marginalized communities. It will highlight their work and offer access to social media opportunities. Job Description: As a Lead Data Scientist at Luupli, you will leverage AWS analytics services to analyze data and extract insights. You will work with cross-functional teams … to develop data-driven solutions and provide actionable recommendations. Your expertise will shape our data strategy and support business growth. Responsibilities: Collaborate with teams to understand objectives, identify data needs, and set analytics goals. Develop data analysis strategies using AWS services like More ❯

Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: from £70,000 depending on experience Department: Technology and Data We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million … to deployment, production, monitoring and continuous improvement optimising cutting-edge AI solutions across the business. One day you might be collaborating with our Data Scientists, Software Engineers and Architects on a new GenAI capability. The next, you're fine-tuning prompts or experimenting with Computer Vision and Natural … and maintain automated frameworks for testing, validation, and monitoring of AI model accuracy, performance, and reliability. Establish best practices for AI data pipeline development and integration with infrastructure to support scalable deployment. Collaborate closely with Data Scientists, Data Engineers, Software Developers, and Architects More ❯

network you want to login/join with: We’re working with a forward-thinking Microsoft partnered consultancy who are looking for a Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on … projects on Databricks implementations. You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. You will work on the full end-to-end product lifecycle from platform … design to insights creation. This is a fantastic opportunity for someone who is passionate about building scalable, high-performance data solutions utilising the latest cutting-edge cloud technologies. As part of this role, you will be responsible for some of the following areas • Design and develop scalable data More ❯

expert support, we ensure reliable and hassle-free healthcare so our customers can focus on their well-being. Role Description As a Senior Data Engineer , you’ll be the lead technical resource for Chemist4U’s modern data platform, helping to shape how data flows … across the organisation. You’ll turn raw dispensing, e-commerce, and marketing data into clean, reliable, query-ready assets that drive decisions across pharmacy operations, commercial, and digital teams. You'll design and build robust, automated data pipelines using AWS services like Glue, Athena, Lambda, and … S3. You’ll enforce data quality SLA's, improve observability, utilise best practices in data engineering, and collaborate with analysts and stakeholders. Responsibilities Data Architecture: Design and maintain scalable, modular pipelines using AWS services (Glue, Lambda, Step Functions, S3), supporting ingestion, transformation, and storage More ❯

Social network you want to login/join with: Senior Data Engineer (SC Cleared), preston, lancashire col-narrow-left Client: CALIO Consulting Group (CCG) Location: preston, lancashire, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 10.06.2025 Expiry Date: 25.07.2025 … col-wide Job Description: Key Responsibilities Lead the technical delivery of complex data engineering projects, ensuring solutions are scalable, secure, and aligned with our delivery framework, and client goals. Design and build high-quality data pipelines and integration workflows, setting the technical direction and ensuring engineering … with multidisciplinary teams, including a wide range of other roles, to shape solutions that meet both technical and business requirements. Mentor and support data engineering teams, fostering a culture of continuous improvement, knowledge sharing, and technical excellence. Support testing activities by ensuring pipelines are testable, observable, and reliable More ❯

expert support, we ensure reliable and hassle-free healthcare so our customers can focus on their well-being. Role Description As a Senior Data Engineer , you’ll be the lead technical resource for Chemist4U’s modern data platform, helping to shape how data flows … across the organisation. You’ll turn raw dispensing, e-commerce, and marketing data into clean, reliable, query-ready assets that drive decisions across pharmacy operations, commercial, and digital teams. You'll design and build robust, automated data pipelines using AWS services like Glue, Athena, Lambda, and … S3. You’ll enforce data quality SLA's, improve observability, utilise best practices in data engineering, and collaborate with analysts and stakeholders. Responsibilities Data Architecture: Design and maintain scalable, modular pipelines using AWS services (Glue, Lambda, Step Functions, S3), supporting ingestion, transformation, and storage More ❯

Social network you want to login/join with: Legal Data Analyst & Researcher, preston, lancashire col-narrow-left Client: The Sponsor Legal Intelligence Platform Location: preston, lancashire, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 10.06.2025 Expiry Date: 25.07.2025 … col-wide Job Description: Legal Data Analyst & Researcher (Part-Time, Remote) Location: Initially Remote moving to in-house Job Type: Part-Time (with potential to transition into Full-Time post-launch) Start Date: Mid-late June About The Sponsor The Sponsor is a legal intelligence platform designed to … provide law firms, professionals, and business leaders with a comprehensive view of the legal industry. Through curated deal data, AI-generated firm rankings, and editorially enriched insights, we help users stay ahead of the legal market. Currently in pre-launch, The Sponsor is backed by industry relevant investors More ❯

Social network you want to login/join with: Data/Business Analyst, preston, lancashire col-narrow-left Client: Location: preston, lancashire, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 15 Posted: 06.06.2025 Expiry Date: 21.07.2025 col-wide Job Description: Job … Title: Data/Business Analyst Location: Remote (UK-based) with occasional client site visits This position sits within the Solution Consulting function of a data-focused consultancy, supporting the delivery of data projects across a range of strategic clients. The role involves working both … remotely and on-site to lead analysis efforts and engage with business stakeholders to define and document data-driven requirements. Key Responsibilities: - Lead business and data analysis activities across multiple clients. - Gather, analyse, and document requirements for data pipelines, system migrations, and reporting needs. More ❯

Job Title: Data Engineer Location: Barrow-in-Furness. We offer a range of hybrid and flexible working arrangements – please speak to your recruiter about the options for this particular role. Salary: From £40,748 per annum What you’ll be doing: Working on a broad range of projects … as part of a multi-disciplinary team whilst driving new operational and customer insights based on data intelligence. Help drive our cultural business change, covering a wide range of technical solutions, which depend heavily on data to enable and offer the customer the required capability. Apply … an analytical mind-set to deliver continual insight to the business. Design, develop and optimise efficient ETL data pipelines. Administer and monitor ETL batch jobs and support incident resolution and root cause analysis. Your skills and experiences: You will need to hold good ETL/Data More ❯

A leading Financial Services client in the City of London is now seeking an experienced Data Engineering Manager to join on a permanent basis. This role is offering a base of £85,000 + a strong benefits package and flexible working. The ideal Data Engineering Manager … will come from a data engineering background and have strong knowledge in SQL, Snowflake, Microsoft Azure, Azure Data Factory and Azure DevOps. The Engineering Manager will design, improve and maintain robust data pipelines within data architecture. To be considered for this role … you will need the following: Experience designing, improving and maintaining robust data pipelines Strong SQL programming skills. Knowledge of other programming languages such as Python, C++ and Java beneficial Possesses a strong understanding of Snowflake - beneficial Experience managing small teams of Data Engineers Strong experience working More ❯

Machine Learning Engineer to drive the development, deployment, and optimization of machine learning solutions. As a technical leader, you will collaborate closely with data scientists, software engineers, and product managers to bring cutting-edge ML models into production at scale. You'll play a key role in shaping … the end-to-end development of machine learning models, from prototyping to production deployment. Architect scalable ML pipelines and infrastructure. Work closely with data scientists to transition research models into robust production systems. Collaborate with engineering teams to integrate ML models into applications and services. Manage and mentor … a team of machine learning and data engineers. Establish best practices for model development, evaluation, monitoring, and retraining. Design experiments, analyze results, and iterate rapidly to improve model performance. Stay current with the latest research and developments in machine learning and AI. Define and enforce ML model governance More ❯

Are you a talented Product Owner with a good understanding of data engineering concepts? Are you interested in progressing to the role of Product Manager over time? Are you excited by sports and sports data, and taking ownership of a new team? If so, this could … be the perfect next role for you! This global leader in real-time sports data delivery is used by some of the world's largest betting operators. Having recently hired a new Chief Product Officer, the product team is only a few months old, and this role will … join a newly formed data engineering and analytics team. What are they looking for: 2-3 years of experience as a Product Owner or Product Manager Good understanding of data engineering concepts and data pipelines Familiarity with data analytics practices, modern BI More ❯

Please Note that this is an FTC for 12 months. This data engineer will be responsible for the successful delivery of key software and business change projects. The role is crucial in supporting and advancing RSM's Workday journey, involving implementation, configuration, and support of Workday integrations. The … data engineer will be expected to: Collaborate on designing and developing high-quality data pipelines using Microsoft Azure and other sources to enhance the Workday platform. Utilize experience with the Workday platform to integrate it within the broader data and business environment. Translate business … process requirements into technical solutions to support new working practices. Optimize data retrieval, storage, and accessibility for users and data professionals. Create comprehensive solution documentation, including source-to-target mappings. Work with data architects to develop scalable, adaptive solutions providing timely, accurate data. Design More ❯

right Job Views: 4 Posted: 31.05.2025 Expiry Date: 15.07.2025 col-wide Job Description: Actian is transforming how enterprises discover, understand, and govern their data assets through our innovative data catalog and intelligence platform. Our customers rely on us to provide a seamless and scalable experience, and … management skills to ensure customers see long-term success with Actian solutions. Responsibilities: Technical Implementation & Onboarding Lead technical onboarding process for new Zeenea Data Intelligence Platform customers Develop and execute customer implementation plans ensuring smooth deployment and adoption Manage the technical setup, configuration, and deployment of Zeenea, ensuring … case studies showcasing innovative metadata implementations Skills and Expertise: 5+ years in technical implementation, consulting, professional services, or customer success in a SaaS, data management, or cloud-based environment Excellent ability to translate customer needs into actionable technical requirements Experience managing multiple concurrent implementation projects with enterprise customers More ❯

teams' approach to testing - e.g. a framework for test driven development Design and develop automated test scripts with a focus on SQL-based data validation, ensuring the accuracy of data flows and transformation. Integrate automated tests into CI/CD pipelines. Be the person on-point … following: RESTful services, Message Queues, Relational Databases. Experience of SQL scripting and proven capability of writing sophisticated queries to analyse problems, and interrogate data pipelines Experience a range of testing methodologies and techniques including agile, with the ability to write test procedures, plans and report development/implementation. More ❯