1 to 25 of 26 Permanent Big Data Jobs in the North of England

Lead Data Engineer (Databricks) - Leeds (Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI/CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead Data Engineer, Team Lead, Technical Lead … Senior Data Engineer, Data Engineer) Our client is a global innovator and world leader with one of the most recognisable names within technology. They are looking for a Lead Data Engineer with significant Databricks experience as well as leadership responsibility to run an exceptional Agile engineering team and provide technical leadership through coaching and mentorship. We are … seeking a Lead Data Engineer capable of leading client delivery, ensuring the highest standards. This will include working with architects, creating automated tests, instilling a culture of continuous improvement and setting standards for the team. You will be responsible for building a greenfield modern data platform using cutting-edge technologies, architecting big data solutions and developing More ❯

Head of Data Engineering - Preston A Head of Data Engineering/Data Engineering Manager to lead the design, development, and enhancement of the data infrastructure and pipelines is required by a leading company based in Preston. The role offers Hybrid working, so 2 - 3 days in the office a week. You must have the following: Proven … experience as a lead data engineer/Data Engineering Manager with some management experience Experience handling large datasets, complex data pipelines, big data processing frameworks and technologies Experience with data modelling, data integration ETL processes and designing efficient data structures Strong programming skills in Python, Java, or Scala Data warehousing concepts … and dimensional modelling experience Any data engineering skills in Azure Databricks and Microsoft Fabric would be a bonus This new role involves building & managing a team of data engineers, fostering a culture of technical excellence and continuous improvement. Collaboration with cross-functional teams is essential to ensure robust, scalable, and aligned data solutions for delivering high-quality More ❯

a passion to make an impact. Harnessing our innovative technologies and strong partnerships, we aim to make travel easy and rewarding for everyone. Get to Know Our Team The Data department, based in Bangkok, oversees all of Agoda's data-related requirements. Our ultimate goal is to enable and increase the use of data in the company … through creative approaches and the implementation of powerful resources such as operational and analytical databases, queue systems, BI tools, and data science technology. We hire the brightest minds from around the world to take on this challenge and equip them with the knowledge and tools that contribute to their personal growth and success while supporting our company's culture … of diversity and experimentation. The role the Data team plays at Agoda is critical as business users, product managers, engineers, and many others rely on us to empower their decision making. We are equally dedicated to our customers by improving their search experience with faster results and protecting them from any fraudulent activities. Data is interesting only when More ❯

Data Engineer Location: Bolton (Hybrid – 2–3 days on-site per week) Salary: Up to £55,000 (depending on experience) Are you a skilled Data Engineer with a passion for Generative AI and emerging data technologies? This is your opportunity to play a key role in a growing international and cross-functional environment, supporting the design, development … and optimisation of data pipelines that power next-generation AI systems across a world-class defence organisation. The Role As a Data Engineer (Generative AI) , you’ll be responsible for evaluating, building, and maintaining high-quality data sets for internal customers—ensuring performance, reliability, and maintainability at every stage. You’ll work within MBDA’s IM GenAI … Delivery Office , contributing to the design and deployment of resilient, secure, and responsive data pipelines supporting AI and NLP initiatives. You’ll collaborate closely with internal stakeholders, leveraging your expertise in structured and unstructured data to ensure compliance with MBDA’s data governance standards, while actively shaping the organisation’s technology roadmap and advancing its use of More ❯

Data Engineer Location: Bolton (Hybrid – 2–3 days on-site per week) Salary: Up to £55,000 (depending on experience) Are you a skilled Data Engineer with a passion for Generative AI and emerging data technologies? This is your opportunity to play a key role in a growing international and cross-functional environment, supporting the design, development … and optimisation of data pipelines that power next-generation AI systems across a world-class defence organisation. The Role As a Data Engineer (Generative AI) , you’ll be responsible for evaluating, building, and maintaining high-quality data sets for internal customers—ensuring performance, reliability, and maintainability at every stage. You’ll work within MBDA’s IM GenAI … Delivery Office , contributing to the design and deployment of resilient, secure, and responsive data pipelines supporting AI and NLP initiatives. You’ll collaborate closely with internal stakeholders, leveraging your expertise in structured and unstructured data to ensure compliance with MBDA’s data governance standards, while actively shaping the organisation’s technology roadmap and advancing its use of More ❯

Lead Data Scientist – Azure Data Stack – Very Attractive Base + Bonus – Manchester City Centre A rapidly growing software house in the heart of Manchester is seeking a Senior Data Scientist to spearhead innovation within their Data & Analytics function. If you're a seasoned data science professional looking for a role where you can have significant … impact, mentor a developing team, and contribute to cutting-edge analytics solutions, this could be the perfect opportunity. Role Overview As a Senior Data Scientist, you'll be a pivotal member of a cross-functional team, leading the enhancement and development of state-of-the-art features for the platform. You'll be responsible for guiding the entire modelling … lifecycle, from data preparation and analysis to the development of robust machine learning models and the creation of impactful, actionable visualisations. You'll also have the opportunity to shape the team's technical direction and mentor junior colleagues. Key Responsibilities Architecting and overseeing data preparation, cleansing, and structuring processes for advanced model development. Leading investigations into patterns, trends More ❯

Lead Data Scientist – Azure Data Stack – Very Attractive Base + Bonus – Manchester City Centre A rapidly growing software house in the heart of Manchester is seeking a Senior Data Scientist to spearhead innovation within their Data & Analytics function. If you're a seasoned data science professional looking for a role where you can have significant … impact, mentor a developing team, and contribute to cutting-edge analytics solutions, this could be the perfect opportunity. Role Overview As a Senior Data Scientist, you'll be a pivotal member of a cross-functional team, leading the enhancement and development of state-of-the-art features for the platform. You'll be responsible for guiding the entire modelling … lifecycle, from data preparation and analysis to the development of robust machine learning models and the creation of impactful, actionable visualisations. You'll also have the opportunity to shape the team's technical direction and mentor junior colleagues. Key Responsibilities Architecting and overseeing data preparation, cleansing, and structuring processes for advanced model development. Leading investigations into patterns, trends More ❯

Lead Data Scientist – Azure Data Stack – Very Attractive Base + Bonus – Manchester City Centre A rapidly growing software house in the heart of Manchester is seeking a Senior Data Scientist to spearhead innovation within their Data & Analytics function. If you're a seasoned data science professional looking for a role where you can have significant … impact, mentor a developing team, and contribute to cutting-edge analytics solutions, this could be the perfect opportunity. Role Overview As a Senior Data Scientist, you'll be a pivotal member of a cross-functional team, leading the enhancement and development of state-of-the-art features for the platform. You'll be responsible for guiding the entire modelling … lifecycle, from data preparation and analysis to the development of robust machine learning models and the creation of impactful, actionable visualisations. You'll also have the opportunity to shape the team's technical direction and mentor junior colleagues. Key Responsibilities Architecting and overseeing data preparation, cleansing, and structuring processes for advanced model development. Leading investigations into patterns, trends More ❯

Data Engineer Bolton- Hybrid £45,000 - £55,000 (dependent on experience) We're looking for a Data Engineer experienced in Generative AI to join our growing international and cross functional client. In this role, you'll be responsible for evaluating, building, and maintaining high quality data sets that support their internal stakeholders across the business. You'll … play a key part in ensuring data pipelines are secure, reliable, and scalable. Data Engineer Duties: Design, develop, and maintain robust data pipelines and architectures. Evaluate, build, and optimise data sets for internal customers. Ensure data systems comply with governance and security standards. Collaborate with internal teams to understand data needs and deliver effective … solutions. Stay ahead of emerging data and AI technologies, contributing to our innovation roadmap. Support the integration of generative AI capabilities into existing systems. As a Data Engineer, you will have: Strong experience with SQL (e.g., MS SQL, Oracle). Knowledge of NoSQL technologies (e.g., MongoDB, InfluxDB, Neo4J). Experience with data exchange and processing (ETL, ESB More ❯

Overview DEPT/AI has a single mission: to make the best work in the industry using AI to enhance everything we do. This role sits within our Data & AI practice, which has deep expertise in leveraging AI. The team includes data strategists, consultants, data scientists and analysts that work alongside DEPT teams around the world across … the world - and doing this alongside an experienced team. JOB PURPOSE We are looking for an AI Consultant who not only knows exactly how to create impact with algorithms, big data, machine learning, and generative AI, but can also translate our tech offerings to our current and future clients as well as our wider digital marketing teams internally. … market. Define AI maturity, roadmaps, and use cases for our clients. Guide on prioritisation based on business impact and technical effort. Design (together with technical experts) and advise on data science and generative AI solutions for various business problems. Bring innovative ideas and emerging technologies to the table, fueling innovation within our teams. Communicate solutions and strategies effectively to More ❯

you will be responsible for driving Product & Supplier Manager (P&SM) performance improvements through strategic collaboration and influencing at various levels, including leadership teams. Responsibilities will include conducting regular data driven performance reviews with different levels of the P&SM team, identifying root causes of issues, and developing effective action plans. You will also explore and implement alternative ways … thorough analysis and mapping of business processes to identify areas for improvement. Stakeholder Management: Build and maintain strong, influential relationships with leadership teams, finance, and commercial teams, ensuring that data-driven insights directly shape key business decisions. Strategy Execution: Execution of the vision for how data is utilised across Product and Supplier Management. Implement strategies that enhance data … backgrounds. Collaborative team player across a business with fast moving, customer driven markets. Understanding of process and the value of organisational efficiency. Desirable skills and experience Certifications in relevant data and analytics technologies (e.g., AWS Certified Big Data Specialty, Snowflake, Microsoft Certified: Azure Data Engineer Associate) are desirable. Bachelor's or master's degree in computer More ❯

grow. In this UI Developer role you will be responsible for the look and feel of the front end of this reporting software dashboard. This is about presenting the data they collect in the best way and is a role for someone who gets data and will like exploring in order to make decisions on how it is … the task of implementing a web browser driven UI over databases. Their Reporting/Dashboard Tool is their clients’ window to the information they compute from millions of small data (messages) received from SIM cards. Messages carry data that indicates the mobile phone user's experience of their service provider (Quality of Experience or QoE). The reporting … accepting this role will have significant say in how they implement UI in the future as well as developing the actual tool to report their data. They are adopting 'Big Data' components and a recent Data Scientist hire is adding Machine Learning to the data we collect. Experience here would be a benefit. Requirements for the More ❯

grow. In this UI Developer role you will be responsible for the look and feel of the front end of this reporting software dashboard. This is about presenting the data they collect in the best way and is a role for someone who gets data and will like exploring in order to make decisions on how it is … the task of implementing a web browser driven UI over databases. Their Reporting/Dashboard Tool is their clients’ window to the information they compute from millions of small data (messages) received from SIM cards. Messages carry data that indicates the mobile phone user's experience of their service provider (Quality of Experience or QoE). The reporting … accepting this role will have significant say in how they implement UI in the future as well as developing the actual tool to report their data. They are adopting 'Big Data' components and a recent Data Scientist hire is adding Machine Learning to the data we collect. Experience here would be a benefit. Requirements for the More ❯

grow. In this UI Developer role you will be responsible for the look and feel of the front end of this reporting software dashboard. This is about presenting the data they collect in the best way and is a role for someone who gets data and will like exploring in order to make decisions on how it is … the task of implementing a web browser driven UI over databases. Their Reporting/Dashboard Tool is their clients’ window to the information they compute from millions of small data (messages) received from SIM cards. Messages carry data that indicates the mobile phone user's experience of their service provider (Quality of Experience or QoE). The reporting … accepting this role will have significant say in how they implement UI in the future as well as developing the actual tool to report their data. They are adopting 'Big Data' components and a recent Data Scientist hire is adding Machine Learning to the data we collect. Experience here would be a benefit. Requirements for the More ❯

grow. In this UI Developer role you will be responsible for the look and feel of the front end of this reporting software dashboard. This is about presenting the data they collect in the best way and is a role for someone who gets data and will like exploring in order to make decisions on how it is … the task of implementing a web browser driven UI over databases. Their Reporting/Dashboard Tool is their clients’ window to the information they compute from millions of small data (messages) received from SIM cards. Messages carry data that indicates the mobile phone user's experience of their service provider (Quality of Experience or QoE). The reporting … accepting this role will have significant say in how they implement UI in the future as well as developing the actual tool to report their data. They are adopting 'Big Data' components and a recent Data Scientist hire is adding Machine Learning to the data we collect. Experience here would be a benefit. Requirements for the More ❯

Job Title: Data Engineer Location: Manchester (hybrid) Type: Permanent Must have skills Working with AWS cloud services to manage and process data. Using AWS Glue for building and running data pipelines. Writing PySpark code in Python, along with SQL, to handle big data processing. Creating and running SQL queries to analyze and manage data More ❯

Job Title: Data Engineer Location: Manchester (hybrid) Type: Permanent Must have skills Working with AWS cloud services to manage and process data. Using AWS Glue for building and running data pipelines. Writing PySpark code in Python, along with SQL, to handle big data processing. Creating and running SQL queries to analyze and manage data More ❯

Job Title: Data Engineer Location: Manchester (hybrid) Type: Permanent Must have skills Working with AWS cloud services to manage and process data. Using AWS Glue for building and running data pipelines. Writing PySpark code in Python, along with SQL, to handle big data processing. Creating and running SQL queries to analyze and manage data More ❯

AWS, AI, OO, Enterprise scale applications Excellent opportunity for a Software Engineer passionate about technology and looking for a new challenge. Who we are: Founded in 2003, Mobysoft provides data-based insight solutions to a wide range of social housing clients, supplying technology to help landlords to improve their income-collection processes for the good of all involved. Mobysoft … is working towards a world in which intelligent technology significantly improves the quality of life for people who live in social housing and our mission is delivering accurate actionable data insights that help social housing providers to deliver a more consistent and equitable service What are we looking for? We are looking for a Software Engineer who will be … with AI-powered development tools, such as GitHub Copilot or other intelligent code assistants. AI tool champion, an advocate for AI tooling throughout the SDLC. Desirable Experience working with big data and with data products Leadership skills, including ability to motivate and coach others Exposure to other technologies and programming languages e.g. Java, NoSQL, ML, JavaScript, TypeScript More ❯

AWS, AI, OO, Enterprise scale applications Excellent opportunity for a Software Engineer passionate about technology and looking for a new challenge. Who we are: Founded in 2003, Mobysoft provides data-based insight solutions to a wide range of social housing clients, supplying technology to help landlords to improve their income-collection processes for the good of all involved. Mobysoft … is working towards a world in which intelligent technology significantly improves the quality of life for people who live in social housing and our mission is delivering accurate actionable data insights that help social housing providers to deliver a more consistent and equitable service What are we looking for? We are looking for a Software Engineer who will be … with AI-powered development tools, such as GitHub Copilot or other intelligent code assistants. AI tool champion, an advocate for AI tooling throughout the SDLC. Desirable Experience working with big data and with data products Leadership skills, including ability to motivate and coach others Exposure to other technologies and programming languages e.g. Java, NoSQL, ML, JavaScript, TypeScript More ❯

AWS, AI, OO, Enterprise scale applications Excellent opportunity for a Software Engineer passionate about technology and looking for a new challenge. Who we are: Founded in 2003, Mobysoft provides data-based insight solutions to a wide range of social housing clients, supplying technology to help landlords to improve their income-collection processes for the good of all involved. Mobysoft … is working towards a world in which intelligent technology significantly improves the quality of life for people who live in social housing and our mission is delivering accurate actionable data insights that help social housing providers to deliver a more consistent and equitable service What are we looking for? We are looking for a Software Engineer who will be … with AI-powered development tools, such as GitHub Copilot or other intelligent code assistants. AI tool champion, an advocate for AI tooling throughout the SDLC. Desirable Experience working with big data and with data products Leadership skills, including ability to motivate and coach others Exposure to other technologies and programming languages e.g. Java, NoSQL, ML, JavaScript, TypeScript More ❯

Gherkin Scenarios, Domain Modelling) Understanding of UI/UX principles. Contributions to open-source projects. Knowledge or experience working with text-to-code language models Knowledge or experience with big data analytics platforms (Databricks being a plus) Knowledge or data processing file format such as parquet, avro, csv) Who You Are Bachelor's degree in Computer Science More ❯

Gherkin Scenarios, Domain Modelling) Understanding of UI/UX principles. Contributions to open-source projects. Knowledge or experience working with text-to-code language models Knowledge or experience with big data analytics platforms (Databricks being a plus) Knowledge or data processing file format such as parquet, avro, csv) Who You Are Bachelor's degree in Computer Science More ❯

Gherkin Scenarios, Domain Modelling) Understanding of UI/UX principles. Contributions to open-source projects. Knowledge or experience working with text-to-code language models Knowledge or experience with big data analytics platforms (Databricks being a plus) Knowledge or data processing file format such as parquet, avro, csv) Who You Are Bachelor's degree in Computer Science More ❯

as: High level solution languages such as Java, TypeScript, Python, and Go Web libraries and frameworks such as React and Angular Designing, building, and maintaining CI/CD pipelines Big data technologies, such as NiFi, Hadoop, Spark Cloud and containerization technologies such as AWS, OpenShift, Kubernetes, Docker DevOps methodologies, such as infrastructure as code and GitOps Database technologies More ❯