20 of 20 Data Pipeline Jobs in Lancashire

for our clients and helping them to reach for and realise their vision. Azure and Databricks Architect Slalom is seeking an experienced Azure Data Architect to contribute to its growing Data Capability. The ideal candidate is a professional with experience in designing, developing, validating, and communicating … enterprise data solutions using Azure and Databricks. Deep experience in developing enterprise data management strategies, including data lake/warehouse implementations, data movement, data services, data acquisition, data conversion, and archive/recovery. Experience or an … data quality, metadata management, etc. Experience in designing data engineering solutions using open source and proprietary cloud data pipeline tools Ability to implement data processing and transformation pipelines in Databricks Experience in leading data platform development teams Knowledge of More ❯

At Victrex, we are dedicated to harnessing the power of data to drive innovation and deliver exceptional value. We are seeking a talented and experienced IT Data Engineering Manager to join our dynamic team and lead our data engineering efforts. As Data Engineering Manager you will beresponsible for leading the data engineering team to design, build, and maintain scalable, high-performance data infrastructure and pipelines. This role ensures the availability, reliability, and security of data systems to support business intelligence, analytics, and data … a dynamic and fast-paced environment. Strong understanding of data architecture, data modelling, ETL/ELT processesand data pipeline development. Competency with cloud platforms (e.g., AWS, Azure, GCP) and big data technologies (e.g., Hadoop, Spark, Kafka etc). Excellent communication and More ❯

or Manchester Salary: £60,000 - £65,000 depending on experience Department: Finance We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great value insurance with an … Employer of the Year at the British Insurance Awards 2024 and our Glassdoor score is pretty mega too! Are you passionate about driving data excellence within finance? Do you thrive on enhancing data functionality that supports business success? If so, we'd love to hear from … and Technology teams to define, capture, and document data requirements. Ensure smooth integration between finance systems and the wider data pipeline, including key logic and calculations. Help shape and evolve the Data Roadmap for Finance, aligning with strategic priorities and business needs. Collaborate More ❯

About the Machine Learning Engineer for CDAO Europe CDAO Europe is looking for a machine learning engineer to build efficient, data-driven AI systems that advance our predictive automation capabilities. The candidate should be highly skilled in statistics and programming, with the ability to confidently assess, analyze, and … reviewing use cases from around the business, and play a key role in Vanguard's model governance processes. Core Responsibilities Leverages data pipeline designs and supports the development of data pipelines to support model development. Proficient with software tools that develop data pipelines … a distributed computing environment (PySpark, GlueETL). Supports integration of model pipelines in a production environment. Develops understanding of SDLC for model production. Reviews pipeline designs, makes data model design changes as needed. Documents and reviews design changes with data science teams. Supports data More ❯

Based (Hybrid working model, 2 days a week office based, 3 days remote) Competitive Salary plus performance related bonus The Role: As a Data Ops Engineer, you will be responsible for enhancing the efficiency and reliability of our data management processes, supporting our advanced analytics, machine … learning, and AI initiatives. You will harness your engineering skills to develop and automate data pipelines, ensuring data is seamlessly integrated, processed, and available across our analytics platforms. Your role will include automating data workflows, improving data quality, and ensuring efficient delivery … pipelines. You will work alongside teams across the organization to address their data needs, craft agile solutions, and continuously improve the data environment. What will you be doing? Design and implement efficient ETL processes for data extraction, transformation, and loading. Build real-time data More ❯

Learning Operations Engineer Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £65,000 - £75,000 - depending on experience Department: Technology and Data We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on … Insurance Employer of the Year at the British Insurance Awards 2024 and our Glassdoor score is pretty mega too! We're big on data: it gives us the insights we need to give the right cover to the right customers at the right price. But it's the … across various environments such as dev, uat and prod Handling large volumes of data in various stages of the data pipeline, from ingestion to processing Proven experience with feature stores, using them for both offline model development and online production usage Building integrations between cloud More ❯

consultancy. We're a team that's energised by innovation and delivering exceptional results for our clients. We deliver cutting edge solutions across data & analytics, AI, cloud infrastructure or security that drive digital transformation and enable our customers to scale, modernise and thrive. In joining Qodea, you'll … eager to learn and grow, so if you want to supercharge your career, join Qodea! What you'll do: Develop and maintain automated data processing pipelines using Google Cloud: Design, build, and maintain data pipelines to support data ingestion, ETL, and storage Build and … maintain automated data pipelines to monitor data quality and troubleshoot issues Implement and maintain databases and data storage solutions: Stay up-to-date with emerging trends and technologies in big data and data engineering Ensure data quality, accuracy More ❯

Join our dynamic team as a Data Engineer and play a crucial role in engineering high-quality data solutions that empower our organisation to make data-driven decisions. This opportunity offers you a platform for growth and development within an innovative environment that values … personal work preferences. Working from the office is encouraged for tasks that require a high degree of collaboration. More about the role As Data Engineer you will contribute to the design and build … of required infrastructure to support optimal extraction, transformation, and load of data from various sources. Integration, setup, and maintenance of analytical tools. Pipeline maintenance, monitoring and performance. This role forms part of the IT department with specific responsibility for Business Intelligence. As part of this, the role More ❯

Senior Data Scientist at AJ Bell (Sponsorship Available) AJ Bell is looking for an experienced and driven Senior Data Scientist to join its dynamic team in Manchester, United Kingdom. This is a fantastic opportunity to contribute to data-driven innovation within one of the … leading investment platforms. Visa sponsorship may be available for exceptional candidates. The ideal candidate will have a minimum of 5 years' experience in data science or a related field, with extensive knowledge of advanced statistical analysis and machine learning algorithms. Proficiency in Python, R, and SQL is essential. … As a Senior Data Scientist, you will play a key role in developing data solutions that drive business strategy, improve customer experience, and enhance operational efficiency. Join AJ Bell and be part of a forward-thinking organisation that values expertise, innovation, and continuous learning in a More ❯

are seeking an experienced Power BI Developer for a 6-month interim contract to support a fast-paced retail business in transforming financial data into actionable insights. This role focuses on designing and building finance-focused Power BI dashboards and reports, leveraging data extracted from Microsoft … Responsibilities: Design, develop, and maintain Power BI dashboards and reports tailored to finance and retail business needs. Extract and transform financial and transactional data from Dynamics 365 via Azure Data Lake/Synapse/Data Factory (as applicable). Collaborate with finance and IT … teams to understand data requirements and reporting goals. Ensure data models are optimised for performance and scalability. Implement best practices in report design, data governance, and version control. Support the integration and automation of data pipelines from source systems to Power BI. More ❯

Prestigious opportunity with a Market Leading Global Retail organisation for a Senior Data Engineer to join our success story in Blackburn. Following a period of significant growth, we are expanding our team to further drive the business forward. You will be responsible for:- Designing, building and maintaining scalable … data pipelines using Python, MS SQL server and robust data pipelines to transform and store data. Managing the process of developing and implementing data models, schemas and architecture solutions. Working with stakeholders, data scientists and analysts to understand data requirements. … Providing insights into data trends and opportunities. Work on processes to improve efficiency, reduce latency and ensure high data availability. Monitoring, logging and alerting mechanisms to identify and resolve data-related issues. If you possess a combination of some of the following skills, then More ❯

Prestigious opportunity with a Market Leading Global Retail organisation for a Senior Data Engineer to join our success story in Blackburn. Following a period of significant growth, we are expanding our team to further drive the business forward. You will be responsible for:- Designing, building and maintaining scalable … data pipelines using Python, MS SQL server and robust data pipelines to transform and store data. Managing the process of developing and implementing data models, schemas and architecture solutions. Working with stakeholders, data scientists and analysts to understand data requirements. … Providing insights into data trends and opportunities. Work on processes to improve efficiency, reduce latency and ensure high data availability. Monitoring, logging and alerting mechanisms to identify and resolve data-related issues. If you possess a combination of some of the following skills, then More ❯

Prestigious opportunity with a Market Leading Global Retail organisation for a Senior Data Engineer to join our success story in Blackburn. Following a period of significant growth, we are expanding our team to further drive the business forward. You will be responsible for:- Designing, building and maintaining scalable … data pipelines using Python, MS SQL server and robust data pipelines to transform and store data. Managing the process of developing and implementing data models, schemas and architecture solutions. Working with stakeholders, data scientists and analysts to understand data requirements. … Providing insights into data trends and opportunities. Work on processes to improve efficiency, reduce latency and ensure high data availability. Monitoring, logging and alerting mechanisms to identify and resolve data-related issues. If you possess a combination of some of the following skills, then More ❯

Prestigious opportunity with a Market Leading Global Retail organisation for a Data Engineer to join our success story in Blackburn. Following a period of significant growth, we are expanding our team to further drive the business forward. You will be responsible for:- Designing, building and maintaining scalable data pipelines using Python, MS SQL server and robust data pipelines to transform and store data. Managing the process of developing and implementing data models, schemas and architecture solutions. Working with stakeholders, data scientists and analysts to understand data requirements. Providing … insights into data trends and opportunities. Work on processes to improve efficiency, reduce latency and ensure high data availability. Monitoring, logging and alerting mechanisms to identify and resolve data-related issues. If you possess a combination of some of the following skills, then LETS More ❯

Prestigious opportunity with a Market Leading Global Retail organisation for a Data Engineer to join our success story in Blackburn. Following a period of significant growth, we are expanding our team to further drive the business forward. You will be responsible for:- Designing, building and maintaining scalable data pipelines using Python, MS SQL server and robust data pipelines to transform and store data. Managing the process of developing and implementing data models, schemas and architecture solutions. Working with stakeholders, data scientists and analysts to understand data requirements. Providing … insights into data trends and opportunities. Work on processes to improve efficiency, reduce latency and ensure high data availability. Monitoring, logging and alerting mechanisms to identify and resolve data-related issues. If you possess a combination of some of the following skills, then LETS More ❯

Prestigious opportunity with a Market Leading Global Retail organisation for a Data Engineer to join our success story in Blackburn. Following a period of significant growth, we are expanding our team to further drive the business forward. You will be responsible for:- Designing, building and maintaining scalable data pipelines using Python, MS SQL server and robust data pipelines to transform and store data. Managing the process of developing and implementing data models, schemas and architecture solutions. Working with stakeholders, data scientists and analysts to understand data requirements. Providing … insights into data trends and opportunities. Work on processes to improve efficiency, reduce latency and ensure high data availability. Monitoring, logging and alerting mechanisms to identify and resolve data-related issues. If you possess a combination of some of the following skills, then LETS More ❯

Prestigious opportunity with a Market Leading Global Retail organisation for a Data Engineer to join our success story in Blackburn. Following a period of significant growth, we are expanding our team to further drive the business forward. You will be responsible for:- Designing, building and maintaining scalable data pipelines using Python, MS SQL server and robust data pipelines to transform and store data. Managing the process of developing and implementing data models, schemas and architecture solutions. Working with stakeholders, data scientists and analysts to understand data requirements. Providing … insights into data trends and opportunities. Work on processes to improve efficiency, reduce latency and ensure high data availability. Monitoring, logging and alerting mechanisms to identify and resolve data-related issues. If you possess a combination of some of the following skills, then LETS More ❯

Matillion is The Data Productivity Cloud. We are on a mission to power the data productivity of our customers and the world, by helping teams get data business ready, faster. Our technology allows customers to load, transform, sync and orchestrate their data. We are … a dent in the universe bigger than ourselves. About the role At Matillion, we're redefining what's possible in the world of data engineering by embedding cutting-edge AI into every layer of our platform. Our Data Science team-part of the Product organisation-is … AI systems that power the Data Productivity Cloud . From boosting the accuracy of our natural language interface to enabling AI-driven pipeline creation, your work will directly empower data engineers to process the most complex and unstructured data with ease. If you More ❯

growing as engineers, and having fun in a collaborative environment. Yelp's mission to connect people with great local businesses relies on powerful data infrastructure and backend systems that can scale across millions of users and businesses. As a Senior Data Backend Engineer on the Content … and Contributor Intelligence team, you will play a key role in building the data platforms and services that power some of Yelp's most innovative GenAI-driven features, from review insights and business summaries to conversational search experiences. You will work closely with machine learning engineers to design … and implement robust, scalable systems that process and serve data at scale. Whether it's streaming real-time content signals, building APIs for ML models, or managing large-scale distributed data stores, your work will directly impact the consumer experience on Yelp This opportunity requires you More ❯

Senior Web Developer - Data Dashboards and Platform Services Join a forward-thinking transport organisation using data and digital tools to shape infrastructure planning across the North of England. Working with partners like Network Rail, TfN, and the DfT, you'll lead the development of interactive platforms … and dashboards that make complex data clear and actionable. This role is within an analytics-focused team, collaborating with transport modelling, economic analysis, and GIS modelling teams to develop dashboards and visualization tools for data presentation. As a Web Developer, you will oversee full-cycle development … from conceptualization and understanding end-user needs, to creating platforms and delivering optimal user experiences. The organisation's work aims to utilize data for informed decision-making that influences infrastructure investment across the transportation network. Day-to-day duties may include: Designing and building modern web applications, dashboards More ❯