1 to 25 of 158 Big Data Jobs in the UK excluding London

BIG DATA ENGINEER - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A BIG DATA ENGINEER WITH DV CLEARANCE Permanent job opportunity for a Big Data Engineer Leading National Security & Defence SME Salary up to £80,000 plus clearance bonus London based organisation in an easily accessible location To … apply please call or email WHO WE ARE? We are recruiting multiple Big Data Engineers to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold DV or enhanced DV Security Clearance. WHAT WILL THE BIG DATA ENGINEER BE DOING? You will be joining a leading SME who … is working hard to support National Security projects within UK Govt. Departments in London. As part of a team, you will be responsible for implementing Big Data Solutions in Mission-Critical areas. WE NEED THE BIG DATA ENGINEER TO HAVE.... Current DV clearance - Standard or Enhanced Must have experience with big data tools such More ❯

We are searching for an experienced Lead Data Engineer for an exciting data-driven business with multiple office locations across the UK. The role is offered as a remote position, but you MUST be based in the UK to be considered for the opportunity. In this role you will be involved in determining the future direction and impact … of data engineering within the business. This is an extremely exciting Lead Data Engineering role, a fantastic opportunity for an experienced, innovative and hands-on data professional to help shape our client's products and solutions. Reporting directly to the Head of Data Engineering, you will play a crucial role in driving the team's vision … and objectives to completion. You will be expected to provide technical leadership, own the solution, ensure the reliability of data products, and collaborate closely with your team and other teams to optimise data solutions. This is a fantastic opportunity for highly skilled and motivated Lead Data Engineer with strong expertise in data architecture, ETL pipelines, cloud More ❯

delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. Your role and responsibilities IBM is currently seeking a seasoned Big Data Java Developer to join our Public Sector team for a significant project. The ideal candidate will possess a deep understanding of Big Data technologies, particularly … maintain Java-based applications for processing and analyzing large datasets, utilizing frameworks such as Apache Hadoop, Spark, and Kafka. Collaborate with cross-functional teams to define, design, and ship data-intensive features and services. Optimize existing data processing pipelines for efficiency, scalability, and reliability. Develop and execute unit tests, ensuring the quality and robustness of the code. Implement … development, including version control, continuous integration, and automated testing. Provide technical guidance and mentorship to junior developers. Stay abreast of the latest trends, best practices, and emerging technologies in Big Data and Java development. Contribute to the design and implementation of highly scalable, secure, and resilient data processing systems. Preferred technical and professional experience Bachelor's or More ❯

CONTRACT DATA ENGINEER - eDV CLEARED NEW OUTSIDE IR35 CONTRACT OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ENGINEER WITH eDV CLEARANCE Contract job opportunity for a Data Engineer National Security client Palantir Foundry Outside IR35 Central London based organisation in an easily accessible location To apply please call/or email WHO WE ARE … We are recruiting a contract Data Engineer to work with a National Security SME in central London. Due to the nature of the work, you must hold enhanced DV Clearance. WE NEED THE DATA ENGINEER TO HAVE.... Current enhanced DV Security Clearance Experience with big data tools such as Hadoop, Cloudera or Elasticsearch Experience With Palantir … Scrum environment with tools such as Confluence/Jira Experience in design, development, test and integration of software Willingness to learn new technologies IT WOULD BE NICE FOR THE DATA ENGINEER TO HAVE.... Cloud based architectures Microservice architecture or server-less architecture Messaging/routing technologies such as Apache Nifi/RabbitMQ TO BE CONSIDERED.... Please either apply by More ❯

Job summary If you are really passionate about data, understand the power that data can have and want to use your knowledge in a role that can make a difference, the NHS Business Services Authority (NHSBSA) have the role for you! We are looking for a Data Architect to join our Digital, Data & Technology Directorate. It … perfect opportunity to take the next step in your career whilst supporting the NHS. If you are excellent at problem solving, great at building relationships and have outstanding technical data architecture skills, you have what this role needs! You will join the Data Strategy & Governance team, as part of a newly developed data architecture function. You will … work in partnership with stakeholders, analysing how data is modelled and collected, understanding gaps, and making recommendations for improvements. You will help design, develop, and implement data principles and standards across the organisation. You will need to be enthusiastic, a logical thinker and have a drive to succeed! What do we offer ? 27 days leave (increasing with length More ❯

CONTRACT PYTHON/DATA ENGINEER - DV CLEARED NEW OUTSIDE IR35 CONTRACT OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A PYTHON/DATA ENGINEER WITH DV CLEARANCE Contract job opportunity for a Data Engineer National Security & Defence client Outside IR35 12 month rolling contract Central London based organisation in an easily accessible location To apply please … call/or email WHO WE ARE? We are recruiting a contract Python/Data Engineer to work with a National Security & Defence SME in central London. Due to the nature of the work, you must hold UKSV/MOD or Enhanced DV Clearance. WE NEED THE PYTHON/DATA ENGINEER TO HAVE.... Current DV Security Clearance (Standard … or Enhanced) Experience with big data tools such as Hadoop, Cloudera or Elasticsearch Python/PySpark experience Experience With Palantir Foundry is nice to have Experience working in an Agile Scrum environment with tools such as Confluence/Jira Experience in design, development, test and integration of software Willingness to learn new technologies TO BE CONSIDERED.... Please either More ❯

DATA ARCHITECT - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ARCHITECT WITH ENHANCED DV CLEARANCE Permanent job opportunity for a Data Architect Leading National Security SME Salary up to £100,000 + Bonus London based organisation in an easily accessible location To apply please call or email WHO WE … ARE? We are recruiting multiple a Data Architect to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold enhanced DV Security Clearance. WHAT WILL THE DATA ARCHITECT BE DOING? You will be joining a leading SME who is working hard to support National Security projects within UK Govt. Departments … in London. As part of a team, you will be responsible for designing and implementing Data Solutions in Mission-Critical areas. WE NEED THE DATA ARCHITECT TO HAVE.... Current DV clearance - Enhanced Good at understanding complexity and abstracting that into a form that is consumable for a non-technical audience. Experience of achieving data interoperability between More ❯

Lead Data Engineer (Databricks) - Leeds (Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI/CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead Data Engineer, Team Lead, Technical Lead … Senior Data Engineer, Data Engineer) Our client is a global innovator and world leader with one of the most recognisable names within technology. They are looking for a Lead Data Engineer with significant Databricks experience as well as leadership responsibility to run an exceptional Agile engineering team and provide technical leadership through coaching and mentorship. We are … seeking a Lead Data Engineer capable of leading client delivery, ensuring the highest standards. This will include working with architects, creating automated tests, instilling a culture of continuous improvement and setting standards for the team. You will be responsible for building a greenfield modern data platform using cutting-edge technologies, architecting big data solutions and developing More ❯

BT drives security decision making impacting all levels of the organization. As a large, distributed, multinational IT-based company, BT has a unique view of global cyber threat, including data sets that have never been available to the industry before. We are developing novel and sophisticated ways of analysing this data to ensure we stay ahead in this … exciting and challenging environment. As an experienced data engineer, you will be responsible for developing and maintaining data pipelines, so that this highly skilled team of data scientists, data engineers and developers, continue to generate unique, innovative and impactful intelligence. This role is hybrid (3 days in office) & can be based in either Bristol or Manchester … What you'll be doing Developing and maintaining Data Pipelines for extraction, transformation and loading processes Assembling large, complex data sets that meet user and business requirements Collaborating with data scientists and intelligence analysts, to support and deliver against their requirements Identifying and implementing process improvements to enhance data delivery and scalability Build and maintain collaboration More ❯

firm and across the globe, Deloitte is an environment where you and your career can flourish. The SAP Analytics+ team consists of 5 core capability groups: Strategy and Architecture Data & Platforms Planning, Budgeting and Forecasting Advanced Analytics Performance, Consolidation & Close Connect to your career at Deloitte Deloitte drives progress. Using our vast range of expertise, we help our clients … how and where it mattersmost . Connect to your opportunity There is an opportunity for you to join and help develop our SAP Analytics+ team, specifically focusing on SAP Data & data Platforms, based on best in class solutions, we expect you to be an expert in using one or more of: SAP ECC/S4/HANA SAP … DataSphere SAP Business Warehouse for HANA (SAP BW/4HANA) SAP Business Transformation Platform (BTP) This represents a unique opportunity to develop your career in consulting within an established Big 4 consulting firm. You will have the chance to develop your technical and functional expertise in the Analytics+ tools, as well as in the delivery and implementation of large More ❯

firm and across the globe, Deloitte is an environment where you and your career can flourish. The SAP Analytics+ team consists of 5 core capability groups: Strategy and Architecture Data & Platforms Planning, Budgeting and Forecasting Advanced Analytics Performance, Consolidation & Close Connect to your career at Deloitte Deloitte drives progress. Using our vast range of expertise, we help our clients … how and where it mattersmost . Connect to your opportunity There is an opportunity for you to join and help develop our SAP Analytics+ team, specifically focusing on SAP Data & data Platforms, based on best in class solutions, we expect you to be an expert in using one or more of: SAP ECC/S4/HANA SAP … DataSphere SAP Business Warehouse for HANA (SAP BW/4HANA) SAP Business Transformation Platform (BTP) This represents a unique opportunity to develop your career in consulting within an established Big 4 consulting firm. You will have the chance to develop your technical and functional expertise in the Analytics+ tools, as well as in the delivery and implementation of large More ❯

firm and across the globe, Deloitte is an environment where you and your career can flourish. The SAP Analytics+ team consists of 5 core capability groups: Strategy and Architecture Data & Platforms Planning, Budgeting and Forecasting Advanced Analytics Performance, Consolidation & Close Connect to your career at Deloitte Deloitte drives progress. Using our vast range of expertise, we help our clients … how and where it mattersmost . Connect to your opportunity There is an opportunity for you to join and help develop our SAP Analytics+ team, specifically focusing on SAP Data & data Platforms, based on best in class solutions, we expect you to be an expert in using one or more of: SAP ECC/S4/HANA SAP … DataSphere SAP Business Warehouse for HANA (SAP BW/4HANA) SAP Business Transformation Platform (BTP) This represents a unique opportunity to develop your career in consulting within an established Big 4 consulting firm. You will have the chance to develop your technical and functional expertise in the Analytics+ tools, as well as in the delivery and implementation of large More ❯

Broster Buchanan are partnered global business within the food industry with a turnover of £8Bn+ who are looking for a Fabric Data Engineer to join as they set up an exciting new project team within the group. This would suit an experienced Azure Data Engineer with good Fabric experience looking to join a new, growing team with plenty … of £55k - £65k + 10% bonus is on offer. Responsibilities: Help set up and deliver the future direction of strategy and approach to the management, storage and usage of data Collaborate with their wider technology and business teams to ensure goals and visions are aligned and achieved Help with setting up the data warehousing and lake processes, including … collaborating with their architecture teams to figure out what that will look like At times, guide and mentor the junior data engineers within the team, reviewing their ideas, providing feedback and identifying their knowledge gaps to support their development Design, develop, and manage data pipelines using Fabric Data Factory Leverage Fabric Data Integration for seamless data More ❯

Move to Skip to Content Link Select how often (in days) to receive an alert: Date: 2 Aug 2025 Company: Royal London Group Job Title: Lead Software Engineer (Azure Data) Contract Type: Permanent Working style: Hybrid 50% home/office based Closing date: 15th August 2025 We are seeking a highly skilled and experienced Lead Software Engineer (Azure Data … our applications and will provide a blend of both solid leadership experience and technical expertise. This role is focussed within the Engagement Services platform with a focus on Azure Data and contributes to our purpose of strengthening the mutual choice for our customers, by providing the best technology solutions to our customers. About the role Design, develop, and maintain … ETL/ELT data pipelines using Azure Data Factory (ADF) for automating data ingestion, transformation, and orchestration from diverse data sources. Build scalable data integration processes to bring in data from on-premises , cloud , and external APIs into Azure Data Lake Storage (ADLS). Data Transformation & Modeling : Utilize Azure data Factory More ❯

to Content Link Select how often (in days) to receive an alert: Create Alert Competitive salary UK/Glasgow: hybrid working model (2-3 days on site) At NTT DATA, we know that with the right people on board, anything is possible. The quality, integrity, and commitment of our employees are key factors in our company's growth, market … our clients stay a step ahead of the competition. By hiring the best people and helping them grow both professionally and personally, we ensure a bright future for NTT DATA and for the people who work here. NTT DATA is currently looking for a Data Engineer for our growing team in the UK. Overview: NTT DATA is seeking a highly skilled Data Engineer with over 4+ years of experience to join our team to help a strategic banking client in various data transformation activities. Key Responsibilities: Collaborating with cross-functional teams to understand data requirements, and design efficient, scalable, and reliable ETL processes using Python and Databricks Developing and deploying ETL jobs More ❯

Job Description: We are seeking a highly skilled and visionary Director of Data Platforms and Architecture to lead the design, development, and governance of our enterprise-wide Snacking data platform ecosystem. This individual will be responsible for driving platform strategy, fostering innovation, and ensuring robust data architecture that empower multiple products and capabilities to power business decisions … scalability, and operational excellence. As a strategic leader, the Director of Data Platforms and Architecture will oversee the implementation and optimization of cutting-edge data technologies & solutions, establish best practices in data platforms and governance, and provide technical leadership to multidisciplinary teams. You will work closely with stakeholders across business, IT, and analytics teams to align data architecture with organizational goals, enabling seamless data acquisition and advanced analytics capabilities. What will be your key responsibilities? Strategic Leadership: Develop and drive the long-term vision for enterprise data platforms and architecture, ensuring alignment with organizational goals and priorities. Collaborate with C-level executives and business leaders to identify opportunities for leveraging data as a More ❯

Senior ML & AI Backend Engineer - Big Data, LLMs & MLOps About the Role We're an ambitious, fast-moving tech company developing next-generation solutions at the intersection of advanced Machine Learning, Big Data, and Large Language Models (LLMs). We're looking for a hands-on Senior ML & AI Backend Engineer to design and build the … systems powering ML models and LLMs in production. Design, build, and maintain end-to-end ML pipelines, championing MLOps best practices for deployment, monitoring, and iteration. Develop solutions for big data storage and processing, ensuring data quality, security, and efficiency. Integrate and optimize both classical ML models and LLMs for real-world use cases. Research and experiment … with state-of-the-art algorithms, tools, and frameworks - bringing fresh ideas from prototype to production. Collaborate closely with a cross-functional team of data scientists, engineers, and product stakeholders. Write clean, maintainable, well-tested code and help set engineering best practices. Diagnose and resolve complex technical challenges in big data and ML systems. About You You More ❯

Senior ML & AI Backend Developer You'll lead the design and deployment of scalable backend systems powering ML, big data, and LLM-driven applications. From MLOps pipelines and big data engineering to productionizing classical ML and LLMs, you'll be at the core of AI infrastructure. Key Requirements: Expert in Python, ML/AI frameworks (PyTorch … TensorFlow, Hugging Face) Proven MLOps, big data, and backend/API development experience Deep understanding of NLP and LLMs Proficient with cloud platforms (AWS/GCP/Azure), Airflow, DBT, Docker/Kubernetes Strong collaboration, problem-solving, and coding best practices Nice to have: LLM fine-tuning, streaming data, big data warehousing, open-source contributions. More ❯

a passion to make an impact. Harnessing our innovative technologies and strong partnerships, we aim to make travel easy and rewarding for everyone. Get to Know Our Team The Data department, based in Bangkok, oversees all of Agoda's data-related requirements. Our ultimate goal is to enable and increase the use of data in the company … through creative approaches and the implementation of powerful resources such as operational and analytical databases, queue systems, BI tools, and data science technology. We hire the brightest minds from around the world to take on this challenge and equip them with the knowledge and tools that contribute to their personal growth and success while supporting our company's culture … of diversity and experimentation. The role the Data team plays at Agoda is critical as business users, product managers, engineers, and many others rely on us to empower their decision making. We are equally dedicated to our customers by improving their search experience with faster results and protecting them from any fraudulent activities. Data is interesting only when More ❯

Join our client in embarking on an ambitious data transformation journey using Databricks, guided by best practice data governance and architectural principles. To support this, we are recruiting for talented data engineers. As a major UK energy provider, our client is committed to 100% renewable energy and sustainability, focusing on delivering exceptional customer experiences. It is initially … one day a week being based in their Nottingham office, this is negotiable. It is a full-time role, 37 hours per week. Accountabilities: * Develop and maintain scalable, efficient data pipelines within Databricks, continuously evolving them as requirements and technologies change. * Build and manage an enterprise data model within Databricks. * Integrate new data sources into the platform … using batch and streaming processes, adhering to SLAs. * Create and maintain documentation for data pipelines and associated systems, following security and monitoring protocols. * Ensure data quality and reliability processes are effective, maintaining trust in the data. * Be comfortable with taking ownership of complex data engineering projects and develop appropriate solutions in accordance with business requirements. * Able to More ❯

Join Ten10 as a Software Development Engineer in Test (Data Automation Focus) Job Type: Permanent Location: London (Hybrid working with occasional client travel) Passionate about data and automation? At Ten10, were at the forefront of helping organisations harness the power of data through quality engineering and innovative test solutions. Were looking for a Software Development Engineer in … Test (SDET) with a strong focus on data automation to join our dynamic team. If you're driven by complex data challenges and thrive in high-performance environments where ETL testing has become second nature, this is the role for you. ?? Important: All applicants must be eligible for SC clearance Why Ten10? At Ten10, were one of the … UKs leading independent Quality Engineering, Software Testing, and DevOps consultancies. We empower top-tier organisations to accelerate software delivery while maintaining confidence in qualityespecially in data-driven environments. Heres why youll love working with us: Data-Driven Projects: Collaborate on exciting and complex data pipelines, platforms, and automation solutions across industries including finance, retail, and government. Cutting More ❯

experiences and building platforms that handle the complexity of modern cruising - all while keeping things collaborative and fun. Your Mission: Are you passionate about unlocking the power of customer data? We're looking for a talented Lead Data Engineer to spearhead the design, development, and optimisation of our critical CRM and customer data transformation. You'll play … a pivotal role in building the data foundations for advanced analytics, personalised customer experiences, and effective marketing activation. As a senior member of the team, you will lead data engineers and champion best practices within our data environment. What You'll Do: Design & Build: Architect, build, test, and deploy robust, scalable, and reliable data pipelines, focusing … on ingesting and transforming CRM and customer data from various sources. Lead & Innovate: Take technical ownership of customer data integration solutions within our data platform (AWS/SQL Server). Drive improvements and implement best-in-class data engineering practices. Ensure Quality: Champion data quality and governance for customer datasets. Implement robust monitoring, validation checks More ❯

Data Architect (Customer Data) Hybrid 3 days per week in the office (West London) 2 days remote My client, a global institution based in London, are seeking an experienced Data Architect who has a strong background within the customer data space. The Data Architect will be responsible for the implementation, and management of a customer … data domain within the enterprise data architecture to support organisational goals and objectives. The ideal candidate will utilise expertise with tools such as Salesforce or other Customer Data Platforms to integrate customer-related data within the architectural framework. The ideal candidate must have: Substantial experience as a Data Architect Customer Data experience CRM experience … Salesforce ideally) Proven ability to design and implement domain-specific data architectures and models, including conceptual, logical, and physical designs. Experience with data modelling tools and methodologies Expertise in designing and managing data integration pipelines, ETL processes, and data warehousing solutions. Hands-on experience with modern tools and platforms Solid experience with database management systems (e.g. More ❯

the hunt for builders . No, we've not ventured into construction in our quest to conquer the world, rather a designer and builder of systems for all things data related where we are conquering the Data World. We can offer an interesting insight into projects spanning a variety of sectors, which may include industries such as telecoms … ready to explore our dynamic team where you can truly act as an expert in your field in support of our clients and their challenges in the world of data and technology, read on! The Team We're Intuita - a fast growing consultancy that's making waves in both the consultancy and technology space. With our ambitious goals for … have working across our business, becoming a pivotal part of our journey, to not just meet, but continuously exceed our client expectations! The Role We are seeking a skilled Data Engineer(s) to join our team, ideally initially on a contract basis, however longer term there is potential to discuss longer term opportunities in the shape of a permanent More ❯

We are therefore hiring a Data Director to lead and collaborate with our data functions, encompassing data analytics, data science, data governance, and data engineering. You will deliver our vision using data to provide a market-leading platform service, driving value from data. You will drive a data-first culture, empowering self … service approaches across the business, underpinned by technology, governance, and data science capabilities. The data team will provide insights that drive improved strategic outcomes for our business; using data as the foundation for all we do. The ideal candidate will possess a strong technical grounding, a track record of problem solving, commercial acumen, and experience in a … senior role leading data teams. What we're looking for: Demonstrated leadership in data strategy and execution, with a track record of delivering data initiatives aligned to business goals. Proven track record of leading data-driven transformation, using analytics to unlock measurable business impact, enable data-led decisions, inform product development, and enhance customer insight. More ❯