1 to 25 of 39 Big Data Jobs in the North of England

Lead Data Engineer (Databricks) - Leeds (Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI/CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead Data Engineer, Team Lead, Technical Lead … Senior Data Engineer, Data Engineer) Our client is a global innovator and world leader with one of the most recognisable names within technology. They are looking for a Lead Data Engineer with significant Databricks experience as well as leadership responsibility to run an exceptional Agile engineering team and provide technical leadership through coaching and mentorship. We are … seeking a Lead Data Engineer capable of leading client delivery, ensuring the highest standards. This will include working with architects, creating automated tests, instilling a culture of continuous improvement and setting standards for the team. You will be responsible for building a greenfield modern data platform using cutting-edge technologies, architecting big data solutions and developing More ❯

Job summary Interested in how data can shape the future of healthcare?Want to earn while you learn, gaining hands-on experience and a recognizedqualification in data analytics?Join the NHSBSA Data team and help turn NHS data into actionable insight. As aData Analyst Apprentice, you'll be part of a collaborative, purpose-drivenorganisation that supports … your growth and wellbeing. You'll work with experiencedprofessionals, learning to collect, analyse and present data that informs NHSdecision-making.This Level 4 Apprenticeship is a great chance to build a data career while making areal impact. You'll gain practical experience in coding, data science and statisticalanalysis, while developing key skills like communication, teamwork and problem solving.Eligibility … Active wellbeing and inclusion networks- Excellent pension- NHS Car lease scheme-Access to a wide range of benefits and high street discounts! Main duties of the job As a Data Analyst Apprentice, you'll be involved in a wide range of activities to support our Data & Insight team. Your responsibilities will include: Working with large datasets, cleaning and More ❯

Head of Data Engineering - Preston A Head of Data Engineering/Data Engineering Manager to lead the design, development, and enhancement of the data infrastructure and pipelines is required by a leading company based in Preston. The role offers Hybrid working, so 2 - 3 days in the office a week. You must have the following: Proven … experience as a lead data engineer/Data Engineering Manager with some management experience Experience handling large datasets, complex data pipelines, big data processing frameworks and technologies Experience with data modelling, data integration ETL processes and designing efficient data structures Strong programming skills in Python, Java, or Scala Data warehousing concepts … and dimensional modelling experience Any data engineering skills in Azure Databricks and Microsoft Fabric would be a bonus This new role involves building & managing a team of data engineers, fostering a culture of technical excellence and continuous improvement. Collaboration with cross-functional teams is essential to ensure robust, scalable, and aligned data solutions for delivering high-quality More ❯

API driven design to streamline internal processes, boost efficiency, and deliver innovative solutions. The team's expertise spans a wide range of technologies, including Java and Python based MicroServices, Data Platform services, AWS/GCP cloud backend systems, Big Data technologies like Hive and Spark, and modern Web applications. With a globally distributed presence across the US … platform and applications. You are execution focused and would develop a reputation for repeatedly delivering projects on time. What you'll be doing Architecture, Design, Development and Implementation of Data Warehousing, Big Data, Data Analytics software solutions in on premises or cloud environments Software development and Data Integration working on Data warehouse, Big Data processing and distributed systems. Drive architecture discussions, take ownership and responsibility over new projects, and deliver high quality software with tight timeline Partner with security and compliance teams to ensure the application meets compliance, security and audit requirements Participate in the continual improvement of engineering tools, cloud based technologies/services, and process Define and participate in More ❯

Lead Data Engineer - Preston A Lead Data Engineer to lead the design, development, and enhancement of the data infrastructure and pipelines is required by a leading company based in Preston. The role offers Hybrid working, so 2 - 3 days in the office a week. You must have the following: Proven experience as a Senior or Lead data engineer Experience handling large datasets, complex data pipelines, big data processing frameworks and technologies AWS or Azure cloud experience Experience with data modelling, data integration ETL processes and designing efficient data structures Strong programming skills in Python, Java, or Scala Data warehousing concepts and dimensional modelling experience Any data engineering skills … in Azure Databricks and Microsoft Fabric would be a bonus This new role involves leading a data team, fostering a culture of technical excellence and continuous improvement. Collaboration with cross-functional teams is essential to ensure robust, scalable, and aligned data solutions for delivering high-quality care. The ideal candidate will lead the design and execution of cloud More ❯

Job Title: Lead Data Engineer Location: York/Manchester/Leeds (3 times a week) Salary: up to £62,000 + Excellent Benefits Type: Full-Time, Permanent WRK Digital is proud to partner exclusively with a well-known, high-profile organisation on a transformative data journey. We are seeking a Lead Data Engineer to join its dynamic … Data & Business Intelligence function. This is a pivotal role in a data-driven organisation, where high-quality, well-governed, and accessible data is central to strategic and operational decision-making. As part of this first-class Data and Analytics team, you’ll play a key role in shaping how data powers every decision being made. … As the Lead Data Platform Engineer , you will lead the design, development, and optimisation of the organisation’s enterprise data platform and its pipelines, enabling data-driven decision-making and innovation. You will act as the technical lead for a team of skilled data engineers and align the data engineering strategy with business objectives. This More ❯

Job Title: Lead Data Engineer Location: York/Manchester/Leeds (3 times a week) Salary: up to £62,000 + Excellent Benefits Type: Full-Time, Permanent WRK Digital is proud to partner exclusively with a well-known, high-profile organisation on a transformative data journey. We are seeking a Lead Data Engineer to join its dynamic … Data & Business Intelligence function. This is a pivotal role in a data-driven organisation, where high-quality, well-governed, and accessible data is central to strategic and operational decision-making. As part of this first-class Data and Analytics team, you’ll play a key role in shaping how data powers every decision being made. … As the Lead Data Platform Engineer , you will lead the design, development, and optimisation of the organisation’s enterprise data platform and its pipelines, enabling data-driven decision-making and innovation. You will act as the technical lead for a team of skilled data engineers and align the data engineering strategy with business objectives. This More ❯

Data Engineer Location: Bolton (Hybrid – 2–3 days on-site per week) Salary: Up to £55,000 (depending on experience) Are you a skilled Data Engineer with a passion for Generative AI and emerging data technologies? This is your opportunity to play a key role in a growing international and cross-functional environment, supporting the design, development … and optimisation of data pipelines that power next-generation AI systems across a world-class defence organisation. The Role As a Data Engineer (Generative AI) , you’ll be responsible for evaluating, building, and maintaining high-quality data sets for internal customers—ensuring performance, reliability, and maintainability at every stage. You’ll work within MBDA’s IM GenAI … Delivery Office , contributing to the design and deployment of resilient, secure, and responsive data pipelines supporting AI and NLP initiatives. You’ll collaborate closely with internal stakeholders, leveraging your expertise in structured and unstructured data to ensure compliance with MBDA’s data governance standards, while actively shaping the organisation’s technology roadmap and advancing its use of More ❯

Data Engineer Location: Bolton (Hybrid – 2–3 days on-site per week) Salary: Up to £55,000 (depending on experience) Are you a skilled Data Engineer with a passion for Generative AI and emerging data technologies? This is your opportunity to play a key role in a growing international and cross-functional environment, supporting the design, development … and optimisation of data pipelines that power next-generation AI systems across a world-class defence organisation. The Role As a Data Engineer (Generative AI) , you’ll be responsible for evaluating, building, and maintaining high-quality data sets for internal customers—ensuring performance, reliability, and maintainability at every stage. You’ll work within MBDA’s IM GenAI … Delivery Office , contributing to the design and deployment of resilient, secure, and responsive data pipelines supporting AI and NLP initiatives. You’ll collaborate closely with internal stakeholders, leveraging your expertise in structured and unstructured data to ensure compliance with MBDA’s data governance standards, while actively shaping the organisation’s technology roadmap and advancing its use of More ❯

Data Engineer - Professional Services - £75,000 - Leeds (hybrid) A leading global professional services firm is seeking a Design Data Engineer to join its growing data and analytics team. This role offers the opportunity to play a pivotal part in shaping the firm’s data infrastructure and driving the intelligent use of data across global operations. … The successful candidate will design, develop, and optimise data pipelines, models, and systems that enable smarter insights, improved efficiency, and enhanced decision-making across the business. Key Responsibilities Design, develop, and maintain scalable and efficient data pipelines, integrations, and ETL processes to support analytics and reporting. Architect and optimize data models and database structures, ensuring scalability, consistency … and business alignment. Collaborate with data scientists, analysts, and business stakeholders to translate data requirements into actionable technical solutions. Ensure data quality, integrity, and governance through validation, monitoring, and documentation processes. Implement and oversee data security and compliance measures, protecting sensitive business and client information. Produce clear technical documentation for data architectures, workflows, and processes. More ❯

Data Engineer - Professional Services - £75,000 - Leeds (hybrid) A leading global professional services firm is seeking a Design Data Engineer to join its growing data and analytics team. This role offers the opportunity to play a pivotal part in shaping the firm’s data infrastructure and driving the intelligent use of data across global operations. … The successful candidate will design, develop, and optimise data pipelines, models, and systems that enable smarter insights, improved efficiency, and enhanced decision-making across the business. Key Responsibilities Design, develop, and maintain scalable and efficient data pipelines, integrations, and ETL processes to support analytics and reporting. Architect and optimize data models and database structures, ensuring scalability, consistency … and business alignment. Collaborate with data scientists, analysts, and business stakeholders to translate data requirements into actionable technical solutions. Ensure data quality, integrity, and governance through validation, monitoring, and documentation processes. Implement and oversee data security and compliance measures, protecting sensitive business and client information. Produce clear technical documentation for data architectures, workflows, and processes. More ❯

Lead Data Scientist – Azure Data Stack – Very Attractive Base + Bonus – Manchester City Centre A rapidly growing software house in the heart of Manchester is seeking a Senior Data Scientist to spearhead innovation within their Data & Analytics function. If you're a seasoned data science professional looking for a role where you can have significant … impact, mentor a developing team, and contribute to cutting-edge analytics solutions, this could be the perfect opportunity. Role Overview As a Senior Data Scientist, you'll be a pivotal member of a cross-functional team, leading the enhancement and development of state-of-the-art features for the platform. You'll be responsible for guiding the entire modelling … lifecycle, from data preparation and analysis to the development of robust machine learning models and the creation of impactful, actionable visualisations. You'll also have the opportunity to shape the team's technical direction and mentor junior colleagues. Key Responsibilities Architecting and overseeing data preparation, cleansing, and structuring processes for advanced model development. Leading investigations into patterns, trends More ❯

Lead Data Scientist - Azure Data Stack - Very Attractive Base + Bonus - Manchester City Centre A rapidly growing software house in the heart of Manchester is seeking a Senior Data Scientist to spearhead innovation within their Data & Analytics function. If you're a seasoned data science professional looking for a role where you can have significant … impact, mentor a developing team, and contribute to cutting-edge analytics solutions, this could be the perfect opportunity. Role Overview As a Senior Data Scientist, you'll be a pivotal member of a cross-functional team, leading the enhancement and development of state-of-the-art features for the platform. You'll be responsible for guiding the entire modelling … lifecycle, from data preparation and analysis to the development of robust machine learning models and the creation of impactful, actionable visualisations. You'll also have the opportunity to shape the team's technical direction and mentor junior colleagues. Key Responsibilities Architecting and overseeing data preparation, cleansing, and structuring processes for advanced model development. Leading investigations into patterns, trends More ❯

Lead Data Scientist – Azure Data Stack – Very Attractive Base + Bonus – Manchester City Centre A rapidly growing software house in the heart of Manchester is seeking a Senior Data Scientist to spearhead innovation within their Data & Analytics function. If you're a seasoned data science professional looking for a role where you can have significant … impact, mentor a developing team, and contribute to cutting-edge analytics solutions, this could be the perfect opportunity. Role Overview As a Senior Data Scientist, you'll be a pivotal member of a cross-functional team, leading the enhancement and development of state-of-the-art features for the platform. You'll be responsible for guiding the entire modelling … lifecycle, from data preparation and analysis to the development of robust machine learning models and the creation of impactful, actionable visualisations. You'll also have the opportunity to shape the team's technical direction and mentor junior colleagues. Key Responsibilities Architecting and overseeing data preparation, cleansing, and structuring processes for advanced model development. Leading investigations into patterns, trends More ❯

Lead Data Scientist – Azure Data Stack – Very Attractive Base + Bonus – Manchester City Centre A rapidly growing software house in the heart of Manchester is seeking a Senior Data Scientist to spearhead innovation within their Data & Analytics function. If you're a seasoned data science professional looking for a role where you can have significant … impact, mentor a developing team, and contribute to cutting-edge analytics solutions, this could be the perfect opportunity. Role Overview As a Senior Data Scientist, you'll be a pivotal member of a cross-functional team, leading the enhancement and development of state-of-the-art features for the platform. You'll be responsible for guiding the entire modelling … lifecycle, from data preparation and analysis to the development of robust machine learning models and the creation of impactful, actionable visualisations. You'll also have the opportunity to shape the team's technical direction and mentor junior colleagues. Key Responsibilities Architecting and overseeing data preparation, cleansing, and structuring processes for advanced model development. Leading investigations into patterns, trends More ❯

Data Architect (Salesforce)Rate - £675 (a day)Duration - 3 Months (Initially)Location - Manchester (Hybrid)Ir35 - Inside (Must use an umbrella company)We are looking for an experienced Enterprise Data Architect to lead the design and delivery of scalable data architecture solutions. Salesforce CRM experience is essential for this role and project. The role involves translating complex business … requirements into effective data models, implementing enterprise data management practices, and supporting strategic decision-making.Candidates should have strong expertise in relational data structures, data modelling tools, and enterprise repositories, along with a solid understanding of data governance, quality, and security standards.Familiarity with compliance regulations such as GDPR and CCPA is essential, as is the ability … to analyse and align data solutions with organisational needs.Desirable qualifications are TOGAF, Enterprise Big Data Professional and Certification in Business Data Analytics (CBDA). Salesforce Certifications are also desirable.Experience in Higher Education and/or CRM implementation projects is also desirable. What are the 3 most important things that you will be and looking for on More ❯

Data Architect (Salesforce) Rate - £675 (a day) Duration - 3 Months (Initially) Location - Manchester (Hybrid) Ir35 - Inside (Must use an umbrella company) We are looking for an experienced Enterprise Data Architect to lead the design and delivery of scalable data architecture solutions. Salesforce CRM experience is essential for this role and project. The role involves translating complex business … requirements into effective data models, implementing enterprise data management practices, and supporting strategic decision-making. Candidates should have strong expertise in relational data structures, data modelling tools, and enterprise repositories, along with a solid understanding of data governance, quality, and security standards. Familiarity with compliance regulations such as GDPR and CCPA is essential, as is … the ability to analyse and align data solutions with organisational needs. Desirable qualifications are TOGAF, Enterprise Big Data Professional and Certification in Business Data Analytics (CBDA). Salesforce Certifications are also desirable. Experience in Higher Education and/or CRM implementation projects is also desirable. What are the 3 most important things that you will be More ❯

Data Engineer Bolton- Hybrid £45,000 - £55,000 (dependent on experience) We're looking for a Data Engineer experienced in Generative AI to join our growing international and cross functional client. In this role, you'll be responsible for evaluating, building, and maintaining high quality data sets that support their internal stakeholders across the business. You'll … play a key part in ensuring data pipelines are secure, reliable, and scalable. Data Engineer Duties: Design, develop, and maintain robust data pipelines and architectures. Evaluate, build, and optimise data sets for internal customers. Ensure data systems comply with governance and security standards. Collaborate with internal teams to understand data needs and deliver effective … solutions. Stay ahead of emerging data and AI technologies, contributing to our innovation roadmap. Support the integration of generative AI capabilities into existing systems. As a Data Engineer, you will have: Strong experience with SQL (e.g., MS SQL, Oracle). Knowledge of NoSQL technologies (e.g., MongoDB, InfluxDB, Neo4J). Experience with data exchange and processing (ETL, ESB More ❯

Data Engineer - £50k-£60k + bonus - Liverpool (1dpw) La Fosse are recruiting a Data Engineer for a growing construction client. Recently kicking off a big data maturity transformation, they are now looking to bring in an ambitious Data Engineer to help shape and guide their development as they migrate to the cloud, scale their data … get real value out of their data. You will ideally be business-minded, with a couple years of engineering know-how behind you, with experience building out cloud and data platforms and now looking for the next step where you can play a more decisive role within a data team. This is a real opportunity to grow your … supportive team and business, and would suit someone with 2-4 years of experience. Requirements: SQL and/or Python Azure, AWS or GCP ETL and orchestration Knowledge of data warehousing solutions An understanding of data governance Please apply for full details. No sponsorship is on offer unfortunately. More ❯

Data Engineer - £50k-£60k + bonus – Liverpool (1dpw) La Fosse are recruiting a Data Engineer for a growing construction client. Recently kicking off a big data maturity transformation, they are now looking to bring in an ambitious Data Engineer to help shape and guide their development as they migrate to the cloud, scale their data … get real value out of their data. You will ideally be business-minded, with a couple years of engineering know-how behind you, with experience building out cloud and data platforms and now looking for the next step where you can play a more decisive role within a data team. This is a real opportunity to grow your … supportive team and business, and would suit someone with 2-4 years of experience. Requirements: SQL and/or Python Azure, AWS or GCP ETL and orchestration Knowledge of data warehousing solutions An understanding of data governance Please apply for full details. No sponsorship is on offer unfortunately. More ❯

Data Engineer - £50k-£60k + bonus – Liverpool (1dpw) La Fosse are recruiting a Data Engineer for a growing construction client. Recently kicking off a big data maturity transformation, they are now looking to bring in an ambitious Data Engineer to help shape and guide their development as they migrate to the cloud, scale their data … get real value out of their data. You will ideally be business-minded, with a couple years of engineering know-how behind you, with experience building out cloud and data platforms and now looking for the next step where you can play a more decisive role within a data team. This is a real opportunity to grow your … supportive team and business, and would suit someone with 2-4 years of experience. Requirements: SQL and/or Python Azure, AWS or GCP ETL and orchestration Knowledge of data warehousing solutions An understanding of data governance Please apply for full details. No sponsorship is on offer unfortunately. More ❯

Data Engineer - £50k-£60k + bonus – Liverpool (1dpw) La Fosse are recruiting a Data Engineer for a growing construction client. Recently kicking off a big data maturity transformation, they are now looking to bring in an ambitious Data Engineer to help shape and guide their development as they migrate to the cloud, scale their data … get real value out of their data. You will ideally be business-minded, with a couple years of engineering know-how behind you, with experience building out cloud and data platforms and now looking for the next step where you can play a more decisive role within a data team. This is a real opportunity to grow your … supportive team and business, and would suit someone with 2-4 years of experience. Requirements: SQL and/or Python Azure, AWS or GCP ETL and orchestration Knowledge of data warehousing solutions An understanding of data governance Please apply for full details. No sponsorship is on offer unfortunately. More ❯

Data Engineer - £50k-£60k + bonus – Liverpool (1dpw) La Fosse are recruiting a Data Engineer for a growing construction client. Recently kicking off a big data maturity transformation, they are now looking to bring in an ambitious Data Engineer to help shape and guide their development as they migrate to the cloud, scale their data … get real value out of their data. You will ideally be business-minded, with a couple years of engineering know-how behind you, with experience building out cloud and data platforms and now looking for the next step where you can play a more decisive role within a data team. This is a real opportunity to grow your … supportive team and business, and would suit someone with 2-4 years of experience. Requirements: SQL and/or Python Azure, AWS or GCP ETL and orchestration Knowledge of data warehousing solutions An understanding of data governance Please apply for full details. No sponsorship is on offer unfortunately. More ❯

Decisioning Salary: Up to £77,000 + Excellent Benefits About the Role WRK digital is proud to partner exclusively with a well-known, high-profile organisation on a transformative data journey. We are seeking a talented ML Engineer to play a pivotal role in a major data transformation initiative. This is an exceptional opportunity to join a forward … thinking company as they build an intelligent data platform in close collaboration with AWS engineers. This role will require the software and dev ops capabilities of an ML Ops engineer to build ML and CI-CD pipelines, proficiency in Infrastructure as Code and Sagemaker pipelines combined with Data Engineering capabilities. Role Summary: Working across projects within the business … parent company, you will have responsibility for: Designing and implementing automation pipelines to operationalise the ML platform and ML pipelines for CI/CD Pipelines Responsibility for mapping out data feeds into/out from the ML platform in collaboration with Solutions Architects and the IT Team Ensuring that the ML systems are developed and scaled reliably in line More ❯

Decisioning Salary: Up to £77,000 + Excellent Benefits About the Role WRK digital is proud to partner exclusively with a well-known, high-profile organisation on a transformative data journey. We are seeking a talented ML Engineer to play a pivotal role in a major data transformation initiative. This is an exceptional opportunity to join a forward … thinking company as they build an intelligent data platform in close collaboration with AWS engineers. This role will require the software and dev ops capabilities of an ML Ops engineer to build ML and CI-CD pipelines, proficiency in Infrastructure as Code and Sagemaker pipelines combined with Data Engineering capabilities. Role Summary: Working across projects within the business … parent company, you will have responsibility for: Designing and implementing automation pipelines to operationalise the ML platform and ML pipelines for CI/CD Pipelines Responsibility for mapping out data feeds into/out from the ML platform in collaboration with Solutions Architects and the IT Team Ensuring that the ML systems are developed and scaled reliably in line More ❯