17 of 17 Big Data Jobs in the North of England

Lead Data Engineer (Databricks) - Leeds (Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI/CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead Data Engineer, Team Lead, Technical Lead … Senior Data Engineer, Data Engineer) Our client is a global innovator and world leader with one of the most recognisable names within technology. They are looking for a Lead Data Engineer with significant Databricks experience as well as leadership responsibility to run an exceptional Agile engineering team and provide technical leadership through coaching and mentorship. We are … seeking a Lead Data Engineer capable of leading client delivery, ensuring the highest standards. This will include working with architects, creating automated tests, instilling a culture of continuous improvement and setting standards for the team. You will be responsible for building a greenfield modern data platform using cutting-edge technologies, architecting big data solutions and developing More ❯

Job summary The role holder is responsible for the leading the design, development, and ongoing enhancement of organisations data infrastructure and pipelines to support advanced data collection, storage, processing, and analysis. Main duties of the job The role holder is accountable for a team of data engineers, fostering a culture of technical excellence and continuous improvement. The … role holder will work collaboratively with cross-functional teams, including analysts, software engineers, and key stakeholders, to ensure that data solutions are robust, scalable, and aligned with the strategic goals of delivering high-quality care for our patients. About us Since 2012, CHEC has been working with the NHS to increase patient choice and provide better access to exceptional … successful applicants may be required to undertake an Enhanced Disclosure via the Disclosure and Barring Service (DBS). Job description Job responsibilities Lead the design and execution of scalable data storage solutions, including databases, data warehouses, and data lakes, ensuring efficient handling of large data volumes. Oversee development and optimisation of ETL pipelines for effective data More ❯

a passion to make an impact. Harnessing our innovative technologies and strong partnerships, we aim to make travel easy and rewarding for everyone. Get to Know Our Team The Data department, based in Bangkok, oversees all of Agoda's data-related requirements. Our ultimate goal is to enable and increase the use of data in the company … through creative approaches and the implementation of powerful resources such as operational and analytical databases, queue systems, BI tools, and data science technology. We hire the brightest minds from around the world to take on this challenge and equip them with the knowledge and tools that contribute to their personal growth and success while supporting our company's culture … of diversity and experimentation. The role the Data team plays at Agoda is critical as business users, product managers, engineers, and many others rely on us to empower their decision making. We are equally dedicated to our customers by improving their search experience with faster results and protecting them from any fraudulent activities. Data is interesting only when More ❯

Lead Cloud Data Engineer – Liverpool – Hybrid - £70k A well-established professional services business that's modernising their data infrastructure and embracing cloud-first technologies are looking for a Lead Cloud Data Enigneer. Based Liverpool City Centre, they're investing significantly in their data capabilities to enhance client services, improve operational efficiency, and drive strategic decision-making … through advanced analytics and robust data management practices. The Role They're looking for an exceptional Lead Cloud Data Engineer to spearhead their data engineering initiatives and drive technical excellence across their cloud infrastructure. You'll be architecting sophisticated data solutions that power critical business operations whilst leading a talented team of engineers. This is an … outstanding opportunity for someone who's passionate about cutting-edge technology and wants to shape the future of enterprise data management. What's on offer: Up to £70k DOE Hybrid working from their Liverpool office – 3 days on site Opportunity to work with industry-leading cloud technologies Leadership role with genuine career progression prospects Collaborative environment with cross-functional More ❯

Apply now to be part of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of roles including but not limited … to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will … be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis and investigation. Working with others is key, you could be working with other engineers, developers, data scientists, analysts and even stakeholders to understand their More ❯

Manchester, Birmingham, Leeds, Blackpool 3–6 Months (with strong extension potential) We’re seeking a hands-on Test Lead to join a major public sector programme driving large-scale, data-led transformation. This role combines technical leadership with active delivery—you’ll be leading test strategy, managing a small team, and directly contributing to the testing of complex ETL … processes, data warehouses, and large-scale data systems. What You’ll Be Doing Leading and managing a test team: overseeing day-to-day activities, allocating work, and ensuring quality delivery across multiple streams. Providing mentorship and coaching to junior and mid-level testers, raising capability, and embedding best practices. Hands-on testing of Big Data, ETL … workflows, APIs, and UIs—personally executing test cases and validating data accuracy and transformations. Designing, building, and maintaining manual and automated test suites using tools like Playwright, Pytest, and Behave. Developing and managing comprehensive test plans, scripts, and reports, ensuring traceability back to requirements. Driving quality across Agile teams by reviewing user stories, defining test conditions, and ensuring both More ❯

Manchester, Birmingham, Leeds, Blackpool 3–6 Months (with strong extension potential) We’re seeking a hands-on Test Lead to join a major public sector programme driving large-scale, data-led transformation. This role combines technical leadership with active delivery—you’ll be leading test strategy, managing a small team, and directly contributing to the testing of complex ETL … processes, data warehouses, and large-scale data systems. What You’ll Be Doing Leading and managing a test team: overseeing day-to-day activities, allocating work, and ensuring quality delivery across multiple streams. Providing mentorship and coaching to junior and mid-level testers, raising capability, and embedding best practices. Hands-on testing of Big Data, ETL … workflows, APIs, and UIs—personally executing test cases and validating data accuracy and transformations. Designing, building, and maintaining manual and automated test suites using tools like Playwright, Pytest, and Behave. Developing and managing comprehensive test plans, scripts, and reports, ensuring traceability back to requirements. Driving quality across Agile teams by reviewing user stories, defining test conditions, and ensuring both More ❯

Manchester, Birmingham, Leeds, Blackpool 3–6 Months (with strong extension potential) We’re seeking a hands-on Test Lead to join a major public sector programme driving large-scale, data-led transformation. This role combines technical leadership with active delivery—you’ll be leading test strategy, managing a small team, and directly contributing to the testing of complex ETL … processes, data warehouses, and large-scale data systems. What You’ll Be Doing Leading and managing a test team: overseeing day-to-day activities, allocating work, and ensuring quality delivery across multiple streams. Providing mentorship and coaching to junior and mid-level testers, raising capability, and embedding best practices. Hands-on testing of Big Data, ETL … workflows, APIs, and UIs—personally executing test cases and validating data accuracy and transformations. Designing, building, and maintaining manual and automated test suites using tools like Playwright, Pytest, and Behave. Developing and managing comprehensive test plans, scripts, and reports, ensuring traceability back to requirements. Driving quality across Agile teams by reviewing user stories, defining test conditions, and ensuring both More ❯

ready to explore our dynamic team where you can truly act as an expert in your field in support of our clients and their challenges in the world of data and technology, read on!?? The TeamWe're Intuita - a fast-growing consultancy that's making waves in both the consultancy and technology space. With our ambitious goals for … offer an interesting insight into projects spanning a variety of industries, which may include telecoms, insurance, healthcare, finance and mortgages across various sectors.?? The RoleWe are seeking a skilled Data Engineer, ideally Senior experience to join our Data Engineering team, ideally as a permanent consultant opportunity. We can move fast and adapt our selection period to our needs. … alongside permanent rights to work are essential, alongside other factors we'll consider. This is a hands-on Analytics Engineering role where you'll be at the heart of data-driven decisions. Day to day you will be transforming raw data in clean, reliable and performant data models using dbt within Google Cloud Platform (GCP). Your More ❯

Data Engineer - Generative AI & Secure Data Platforms Hybrid Working | UK-Based | SC Clearance Up to £60k + Paid Overtime + Bonus + Benefits Engineer the Future of Secure AI Innovation Are you ready to use your data engineering skills to build secure, intelligent platforms that power generative AI and national resilience? This is a hands-on opportunity … to join a high-impact, high-trust organisation working on next-gen data platforms. You'll be part of a collaborative international team, helping internal customers unlock the full potential of their data securely and intelligently. What You'll Be Doing Design, deploy, and maintain resilient data pipelines across on-prem and cloud environments Collaborate with internal … teams to optimise and secure sensitive data-sets Ensure compliance with strict data governance and quality standards Contribute to the technology roadmap with insights into emerging tools and platforms Work across SQL, NoSQL, Python, ETL, and big data ecosystems Support projects involving Generative AI, NLP, and OCR What You'll Bring Proven experience in on-prem More ❯

Where Data Does More. Join the Snowflake team. Senior Cloud Support Engineer - Clients & Connectivity Build the future of the AI Data Cloud. Join the Snowflake team. Snowflake Support is committed to providing high-quality resolutions to help deliver data-driven business insights and results. We are a team of subject matter experts collectively working toward our customers … form partnerships with customers by listening, learning, and building connections. Snowflake's Support team is expanding! We are looking for a Senior Cloud Support Engineer who likes working with data and solving a wide variety of issues utilizing their technical experience having worked on a variety of operating systems, database technologies, big data, data integration, connectors … and networking. As a Senior Cloud Support Engineer, your role is to delight our customers with your passion and knowledge of Snowflake Data Warehouse. Customers will look to you for technical guidance and expert advice with regard to their effective and optimal use of Snowflake. You will be the voice of the customer regarding product feedback and improvements for More ❯

Data Engineer – Leeds – Hybrid - Azure An innovative fintech scale-up revolutionising how financial institutions leverage their data assets. Based in Leeds, they're building next-generation solutions that help banks, investment firms, and financial services companies unlock the true potential of their data to drive smarter investment decisions and enhance customer experiences. The Role They need a … talented Data Engineer to join their rapidly expanding engineering team in Leeds. You'll be architecting robust data systems that power critical financial analytics, working with modern cloud technologies whilst tackling real-world challenges in the fast-paced fintech sector. This is an excellent opportunity for someone ready to make their mark in financial technology within a dynamic … career progression opportunities Brilliant team culture + socials What you'll need: Strong SQL skills - you'll be optimising queries and managing complex financial datasets Python experience, particularly for data processing and ETL workflows Hands-on experience with cloud platforms- Azure Experience designing and maintaining data pipelines using tools like Databricks and PySpark Knowledge of data warehousing More ❯

of innovators. We champion diversity of thought and ideas, we behave like leaders regardless of title, we are committed to achieving ambitious goals, and we love celebrating our wins - big and small. Supported by operating principles of being strategy-led, values-based and disciplined in execution, you'll be inspired, connected, developed and rewarded here. Everything that makes you … functional teams. Cloud Services: Experience with cloud platforms like AWS, GCP, or Azure. DevOps Tools: Familiarity with containerization (Docker) and infrastructure automation tools like Terraform or Ansible. Real-time Data Streaming: Experience with Apache Pulsar or similar systems for real-time messaging and stream processing is a plus. Data Engineering: Experience with Apache Spark, Databricks, or similar big data platforms for processing large datasets, building data pipelines, and machine learning workflows. Workflow Orchestration: Familiarity with tools like Apache Airflow or Temporal for managing workflows and scheduling jobs in distributed systems. Stream Processing: Experience with Apache Flink or other stream processing frameworks is a plus. Desired Skills Asynchronous Programming: Familiarity with asynchronous programming tools like Celery More ❯

per week. Responsibilities As a subject matter expert, you will champion initiatives that enhance performance analytics and add significant value to the function. Your responsibilities will include conducting regular data driven performance reviews with different levels of the P&SM team, identifying root causes of issues, and developing effective action plans. You will also explore and implement alternative ways … thorough analysis and mapping of business processes to identify areas for improvement. Stakeholder Management: Build and maintain strong, influential relationships with leadership teams, finance, and commercial teams, ensuring that data-driven insights directly shape key business decisions. Strategy Execution: Execution of the vision for how data is utilised across Product and Supplier Management. Implement strategies that enhance data … backgrounds. Collaborative team player across a business with fast moving, customer driven markets. Understanding of process and the value of organisational efficiency. Desirable skills and experience Certifications in relevant data and analytics technologies (e.g., AWS Certified Big Data Specialty, Snowflake, Microsoft Certified: Azure Data Engineer Associate) are desirable. Bachelor's or master's degree in computer More ❯

migration, modernisation, and integration. Strong capability in documenting high-level designs, system workflows, and technical specifications. Deep understanding of architectural patterns (e.g., microservices, layered, serverless). Expert knowledge of big data tools (Kafka, Spark, Hadoop) and major cloud platforms (AWS, Azure, GCP) to inform technology recommendations. Proficiency in Java, C#, Python, or JavaScript/TypeScript. Experience with cloud More ❯

Why Lloyds Banking Group We're on an exciting journey and there couldn't be a better time to join us. The investments we're making in our people, data, and technology are leading to innovative projects, fresh possibilities, and countless new ways for our people to work, learn, and thrive. What you'll need Strong experience of solution … Platforms. Strong understanding of building applications through containerised microservices-based architectures, with good understanding of cloud methodologies. Strong understanding of API standards, security and gateway patterns. Strong understanding of data technologies - SQL/NoSQL, Big Data. Good knowledge of key LBG development technologies (e.g. Java, JavaScript, Java Spring Boot, Python). Good knowledge of cloud architecture, cloud platform … as a service, particularly GCP. Good understanding of AI/ML concepts and models including Agentic AI. Good understanding of Data Architecture & Modelling concepts. Appreciation for Architectural Frameworks such as TOGAF, Archimate, Software patterns or similar. Experience of Cloud patterns and associated technologies, preferably GCP, CI/CD (Jenkins, Harness), Containerisation, Orchestration, IAM, VPC, GKE Exposure and familiarity with More ❯

Why Lloyds Banking Group We're on an exciting journey and there couldn't be a better time to join us. The investments we're making in our people, data, and technology are leading to innovative projects, fresh possibilities, and countless new ways for our people to work, learn, and thrive. What you'll need Strong experience of solution … Platforms. Strong understanding of building applications through containerised microservices-based architectures, with good understanding of cloud methodologies. Strong understanding of API standards, security and gateway patterns. Strong understanding of data technologies - SQL/NoSQL, Big Data. Good knowledge of key LBG development technologies (e.g. Java, JavaScript, Java Spring Boot, Python). Good knowledge of cloud architecture, cloud platform … as a service, particularly GCP. Good understanding of AI/ML concepts and models including Agentic AI. Good understanding of Data Architecture & Modelling concepts. Appreciation for Architectural Frameworks such as TOGAF, Archimate, Software patterns or similar. Experience of Cloud patterns and associated technologies, preferably GCP, CI/CD (Jenkins, Harness), Containerisation, Orchestration, IAM, VPC, GKE Exposure and familiarity with More ❯