1 to 25 of 54 Big Data Jobs in the South East

BIG DATA ENGINEER - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A BIG DATA ENGINEER WITH DV CLEARANCE Permanent job opportunity for a Big Data Engineer Leading National Security & Defence SME Salary up to £80,000 plus clearance bonus London based organisation in an easily accessible location To … apply please call or email WHO WE ARE? We are recruiting multiple Big Data Engineers to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold DV or enhanced DV Security Clearance. WHAT WILL THE BIG DATA ENGINEER BE DOING? You will be joining a leading SME who … is working hard to support National Security projects within UK Govt. Departments in London. As part of a team, you will be responsible for implementing Big Data Solutions in Mission-Critical areas. WE NEED THE BIG DATA ENGINEER TO HAVE.... Current DV clearance - Standard or Enhanced Must have experience with big data tools such More ❯

We are searching for an experienced Lead Data Engineer for an exciting data-driven business with multiple office locations across the UK. The role is offered as a remote position, but you MUST be based in the UK to be considered for the opportunity. In this role you will be involved in determining the future direction and impact … of data engineering within the business. This is an extremely exciting Lead Data Engineering role, a fantastic opportunity for an experienced, innovative and hands-on data professional to help shape our client's products and solutions. Reporting directly to the Head of Data Engineering, you will play a crucial role in driving the team's vision … and objectives to completion. You will be expected to provide technical leadership, own the solution, ensure the reliability of data products, and collaborate closely with your team and other teams to optimise data solutions. This is a fantastic opportunity for highly skilled and motivated Lead Data Engineer with strong expertise in data architecture, ETL pipelines, cloud More ❯

CONTRACT DATA ENGINEER - eDV CLEARED NEW OUTSIDE IR35 CONTRACT OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ENGINEER WITH eDV CLEARANCE Contract job opportunity for a Data Engineer National Security client Palantir Foundry Outside IR35 Central London based organisation in an easily accessible location To apply please call/or email WHO WE ARE … We are recruiting a contract Data Engineer to work with a National Security SME in central London. Due to the nature of the work, you must hold enhanced DV Clearance. WE NEED THE DATA ENGINEER TO HAVE.... Current enhanced DV Security Clearance Experience with big data tools such as Hadoop, Cloudera or Elasticsearch Experience With Palantir … Scrum environment with tools such as Confluence/Jira Experience in design, development, test and integration of software Willingness to learn new technologies IT WOULD BE NICE FOR THE DATA ENGINEER TO HAVE.... Cloud based architectures Microservice architecture or server-less architecture Messaging/routing technologies such as Apache Nifi/RabbitMQ TO BE CONSIDERED.... Please either apply by More ❯

CONTRACT PYTHON/DATA ENGINEER - DV CLEARED NEW OUTSIDE IR35 CONTRACT OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A PYTHON/DATA ENGINEER WITH DV CLEARANCE Contract job opportunity for a Data Engineer National Security & Defence client Outside IR35 12 month rolling contract Central London based organisation in an easily accessible location To apply please … call/or email WHO WE ARE? We are recruiting a contract Python/Data Engineer to work with a National Security & Defence SME in central London. Due to the nature of the work, you must hold UKSV/MOD or Enhanced DV Clearance. WE NEED THE PYTHON/DATA ENGINEER TO HAVE.... Current DV Security Clearance (Standard … or Enhanced) Experience with big data tools such as Hadoop, Cloudera or Elasticsearch Python/PySpark experience Experience With Palantir Foundry is nice to have Experience working in an Agile Scrum environment with tools such as Confluence/Jira Experience in design, development, test and integration of software Willingness to learn new technologies TO BE CONSIDERED.... Please either More ❯

DATA ARCHITECT - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ARCHITECT WITH ENHANCED DV CLEARANCE Permanent job opportunity for a Data Architect Leading National Security SME Salary up to £100,000 + Bonus London based organisation in an easily accessible location To apply please call or email WHO WE … ARE? We are recruiting multiple a Data Architect to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold enhanced DV Security Clearance. WHAT WILL THE DATA ARCHITECT BE DOING? You will be joining a leading SME who is working hard to support National Security projects within UK Govt. Departments … in London. As part of a team, you will be responsible for designing and implementing Data Solutions in Mission-Critical areas. WE NEED THE DATA ARCHITECT TO HAVE.... Current DV clearance - Enhanced Good at understanding complexity and abstracting that into a form that is consumable for a non-technical audience. Experience of achieving data interoperability between More ❯

Job Description: We are seeking a highly skilled and visionary Director of Data Platforms and Architecture to lead the design, development, and governance of our enterprise-wide Snacking data platform ecosystem. This individual will be responsible for driving platform strategy, fostering innovation, and ensuring robust data architecture that empower multiple products and capabilities to power business decisions … scalability, and operational excellence. As a strategic leader, the Director of Data Platforms and Architecture will oversee the implementation and optimization of cutting-edge data technologies & solutions, establish best practices in data platforms and governance, and provide technical leadership to multidisciplinary teams. You will work closely with stakeholders across business, IT, and analytics teams to align data architecture with organizational goals, enabling seamless data acquisition and advanced analytics capabilities. What will be your key responsibilities? Strategic Leadership: Develop and drive the long-term vision for enterprise data platforms and architecture, ensuring alignment with organizational goals and priorities. Collaborate with C-level executives and business leaders to identify opportunities for leveraging data as a More ❯

Senior ML & AI Backend Engineer - Big Data, LLMs & MLOps About the Role We're an ambitious, fast-moving tech company developing next-generation solutions at the intersection of advanced Machine Learning, Big Data, and Large Language Models (LLMs). We're looking for a hands-on Senior ML & AI Backend Engineer to design and build the … systems powering ML models and LLMs in production. Design, build, and maintain end-to-end ML pipelines, championing MLOps best practices for deployment, monitoring, and iteration. Develop solutions for big data storage and processing, ensuring data quality, security, and efficiency. Integrate and optimize both classical ML models and LLMs for real-world use cases. Research and experiment … with state-of-the-art algorithms, tools, and frameworks - bringing fresh ideas from prototype to production. Collaborate closely with a cross-functional team of data scientists, engineers, and product stakeholders. Write clean, maintainable, well-tested code and help set engineering best practices. Diagnose and resolve complex technical challenges in big data and ML systems. About You You More ❯

Senior ML & AI Backend Developer You'll lead the design and deployment of scalable backend systems powering ML, big data, and LLM-driven applications. From MLOps pipelines and big data engineering to productionizing classical ML and LLMs, you'll be at the core of AI infrastructure. Key Requirements: Expert in Python, ML/AI frameworks (PyTorch … TensorFlow, Hugging Face) Proven MLOps, big data, and backend/API development experience Deep understanding of NLP and LLMs Proficient with cloud platforms (AWS/GCP/Azure), Airflow, DBT, Docker/Kubernetes Strong collaboration, problem-solving, and coding best practices Nice to have: LLM fine-tuning, streaming data, big data warehousing, open-source contributions. More ❯

Join Ten10 as a Software Development Engineer in Test (Data Automation Focus) Job Type: Permanent Location: London (Hybrid working with occasional client travel) Passionate about data and automation? At Ten10, were at the forefront of helping organisations harness the power of data through quality engineering and innovative test solutions. Were looking for a Software Development Engineer in … Test (SDET) with a strong focus on data automation to join our dynamic team. If you're driven by complex data challenges and thrive in high-performance environments where ETL testing has become second nature, this is the role for you. ?? Important: All applicants must be eligible for SC clearance Why Ten10? At Ten10, were one of the … UKs leading independent Quality Engineering, Software Testing, and DevOps consultancies. We empower top-tier organisations to accelerate software delivery while maintaining confidence in qualityespecially in data-driven environments. Heres why youll love working with us: Data-Driven Projects: Collaborate on exciting and complex data pipelines, platforms, and automation solutions across industries including finance, retail, and government. Cutting More ❯

experiences and building platforms that handle the complexity of modern cruising - all while keeping things collaborative and fun. Your Mission: Are you passionate about unlocking the power of customer data? We're looking for a talented Lead Data Engineer to spearhead the design, development, and optimisation of our critical CRM and customer data transformation. You'll play … a pivotal role in building the data foundations for advanced analytics, personalised customer experiences, and effective marketing activation. As a senior member of the team, you will lead data engineers and champion best practices within our data environment. What You'll Do: Design & Build: Architect, build, test, and deploy robust, scalable, and reliable data pipelines, focusing … on ingesting and transforming CRM and customer data from various sources. Lead & Innovate: Take technical ownership of customer data integration solutions within our data platform (AWS/SQL Server). Drive improvements and implement best-in-class data engineering practices. Ensure Quality: Champion data quality and governance for customer datasets. Implement robust monitoring, validation checks More ❯

Data Architect (Customer Data) Hybrid 3 days per week in the office (West London) 2 days remote My client, a global institution based in London, are seeking an experienced Data Architect who has a strong background within the customer data space. The Data Architect will be responsible for the implementation, and management of a customer … data domain within the enterprise data architecture to support organisational goals and objectives. The ideal candidate will utilise expertise with tools such as Salesforce or other Customer Data Platforms to integrate customer-related data within the architectural framework. The ideal candidate must have: Substantial experience as a Data Architect Customer Data experience CRM experience … Salesforce ideally) Proven ability to design and implement domain-specific data architectures and models, including conceptual, logical, and physical designs. Experience with data modelling tools and methodologies Expertise in designing and managing data integration pipelines, ETL processes, and data warehousing solutions. Hands-on experience with modern tools and platforms Solid experience with database management systems (e.g. More ❯

Join us as a Data Platform Engineer for our client. At Peregrine, were always seeking Specialist Talent that have the ideal mix of skills, experience, and attitude, to place with our vast array of clients. From Business Analysts in large government organisations to Software Developers in the private sector we are always in search of the best talent to … benefits, you will be deployed across our portfolio of clients as a specialist consultant, working on a wide array of complex projects across multiple industries. The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and on-premises … platforms. You will play a key role in ensuring that all data systems comply with industry regulations and security standards while enabling efficient access for analytics and operational teams. A strong command of Apache NiFi is essential for this role. You will be expected to design, implement, and maintain data flows using NiFi, ensuring accurate, efficient, and secure More ❯

The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and on premises platforms. You will play a key role in ensuring that all data systems comply with industry regulations and security standards while enabling efficient access … for analytics and operational teams. A strong command of Apache NiFi is essential for this role. You will be expected to design, implement, and maintain data flows using NiFi, ensuring accurate, efficient, and secure data ingestion, transformation, and delivery. You should be adept at identifying and resolving issues within NiFi flows, managing performance bottlenecks, and implementing robust error … handling strategies. Youll work closely with cross-functional teams including data architects, compliance officers, and cybersecurity specialists to integrate data from various systems such as databases, APIs, and cloud platforms. Your work will directly support batch processing, real-time streaming, and event-driven data pipelines across a variety of use cases. Were looking for candidates with over More ❯

DATA SCIENTIST - eDV CLEARED NEW PERMANENT OPPORTUNITY AVAILABLE FOR A DATA SCIENTIST IN LONDON WITH ENHANCED DV CLEARANCE Permanent opportunity for a Data Scientist Enhanced DV security clearance is required Salary up to £95,000 + Clearance Bonus + Company Bonus Central London based organisation in an accessible location To apply please call/or email WHO … WE ARE? We are recruiting a permanent Data Scientist to work with a leading technology and engineering company that do excellent work in the National Security sector across a range of exciting projects. Due to the nature of our clients, you must hold enhanced DV security clearance. WHAT WILL THE DATA SCIENCE ENGINEER BE DOING? As a Data … you will be working alongside our team on a wide variety of projects with a special focus on innovation and AI. You could be working with all types of data (both structured and unstructured) using a variety of software - so we're open to seeing engineers with different technology backgrounds! THE DATA SCIENCE ENGINEER SHOULD HAVE.... Strong and More ❯

As a Data Governance Analyst , you will support the Data Governance Manager in implementing and maintaining the organisation's data governance framework. Your role will involve ensuring data quality, consistency, and compliance across various data domains. You will work closely with data owners, data stewards, and IT teams to enforce data governance … policies and procedures and support Master Data Management (MDM) initiatives. What you’ll be doing as a Data Governance Analyst Assist in developing and articulating the organisation's data governance vision, strategy and roadmap. Support the activation and enforcement of the data governance program vision. Collaborate with various stakeholders, including IT teams, business units, and data owners. Ensure that master data is accurately represented, consistently defined and easily accessible across the organisation. Provide training and guidance to employees on data governance principles, policies and procedures. Assist in establishing mechanisms for governance oversight, including regular reviews and audits. Ensure compliance with data-related regulations and manage data-related risks. Support the Data More ❯

Data Solutions Architect £110,000 - £120,000 GBP 10% Bonus Hybrid WORKING Location: Central London, Greater London - United Kingdom Type: Permanent Data Solutions Architect - Consulting Location: London (Remote-first) Working Pattern: Full-time, Permanent Salary: £110,000 - £120,000 per annum About the Role We're seeking a Data Solutions Architect to join a dynamic consulting team … delivering cutting-edge, cloud-based data solutions for high-profile clients across diverse industries. This is a remote-first role with occasional travel, offering the opportunity to lead end-to-end delivery of complex data architecture projects in a collaborative, agile environment. What You'll Be Doing Leading cross-functional teams of Data Engineers, Architects, BAs, and … QA Analysts. Designing and delivering scalable data solutions using modern cloud platforms and data technologies. Engaging with stakeholders to shape and own the technical delivery of data architecture projects. Applying best practices in data governance, security, and compliance. What We're Looking For Experience & Leadership Proven track record as a Lead Data Solutions Architect or More ❯

Apply now to be part of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of roles including but not limited … to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will … be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis and investigation. Working with others is key, you could be working with other engineers, developers, data scientists, analysts and even stakeholders to understand their More ❯

About Archive360Archive360 delivers a modern archiving platform that empowers organizations to address complex data governance and compliance challenges while leveraging AI and analytics. By transforming data into a trusted, accurate, and protected strategic asset, we help organizations achieve their business objectives and drive innovation. Position Overview:We are seeking a Pre-Sales Solutions Architect who blends technical expertise … our sales organization, bridging the gap between technical functionality and customer needs. You’ll partner closely with Sales, Product, and Engineering teams to deliver tailored solutions that solve complex data analysisand archiving challenges. Key Responsibilities: Be an expert in big data analytics to excite customers about Archive360. You will become a trusted advisor on multiple issues of … customer needs and business goals. Develop customer relationships and build internal partnerships with account executives and teams. What You Bring: Must have experience with ETL tools such as Azure Data Factory and processes for data extraction, transformation, and loading Must have experience with structured data management and migrations. Must have prior experience with involvement in application retirement More ❯

Data & Analytics Consultant HD-Tech is proud to be partnering with a leading data management and analytics consultancy that specialises in delivering transformative business insights using Microsoft technologies. With over 10 years of industry presence, our client is recognised for helping organisations optimise their use of data to drive smarter decisions and long-term value. As they … continue to scale their professional and managed services offerings, we re now seeking a Data & Analytics Consultant to join their expanding consulting team. About the Company This organisation is deeply committed to helping businesses "predict their future" through better use of data, technology, people, and process . Their services include: Managed Data Services Database and Infrastructure Consultancy … Data Engineering & Analytics Adoption and Change Management Their reputation is built on strong consulting skills, deep expertise in Microsoft Data Services, and a highly collaborative culture. They place a premium on client engagement, commercial awareness, and internal collaboration to drive results. Role Overview As a Consultant, you will play a hands-on role in delivering client-facing analytics More ❯

Data & Analytics Consultant HD-Tech is proud to be partnering with a leading data management and analytics consultancy that specialises in delivering transformative business insights using Microsoft technologies. With over 10 years of industry presence, our client is recognised for helping organisations optimise their use of data to drive smarter decisions and long-term value. As they … continue to scale their professional and managed services offerings, we’re now seeking a Data & Analytics Consultant to join their expanding consulting team. About the Company This organisation is deeply committed to helping businesses "predict their future" through better use of data, technology, people, and process . Their services include: Managed Data Services Database and Infrastructure Consultancy … Data Engineering & Analytics Adoption and Change Management Their reputation is built on strong consulting skills, deep expertise in Microsoft Data Services, and a highly collaborative culture. They place a premium on client engagement, commercial awareness, and internal collaboration to drive results. Role Overview As a Consultant, you will play a hands-on role in delivering client-facing analytics More ❯

Data Solution Architect ££125,000 GBP + benefits package Hybrid WORKING Location: Central London, Greater London - United Kingdom Type: Permanent Data Solution Architect Location: London (Hybrid) Salary: Up to £125,000 + benefits package Contract Type: Permanent We are supporting a leading consulting client in their search for a Data Solution Architect to join a remote-first … data architecture team. This is a senior, delivery-focused role requiring deep technical expertise and end-to-end consulting experience across cloud-based data solutions. Key Responsibilities: Lead cross-functional teams to deliver scalable data solutions across cloud platforms Architect data lakes, lakehouses, and event-driven systems using tools like Databricks, Kafka, and Confluent Apply Data Mesh and Data Fabric principles to modern data architectures Define and implement data product strategies with a product-led mindset Ensure compliance with data governance and security standards (e.g. GDPR, HIPAA) Engage stakeholders and oversee technical delivery across Agile projects Skills & Experience: Proven experience as a Lead Data Solution Architect in consulting environments Expertise More ❯

We are a global media group delivering exceptional content through events, digital, data & insight. From agribusiness, ingredients and food processing, to retail, hospitality & fine dining - we provide the inspiration, insight and connections to power our customers' success. We have offices in Gatwick, Brighton and London, UK; Montpellier, France; Singapore and Chicago, US. In line with the Company's current … offices and to work remotely for the rest of the week. Position Position: Full time - permanent Location: London/Brighton/Crawley/Hybrid We are looking for a Data Scientist to lead Lumina Intelligence's data team, providing an opportunity to shape and grow our data strategy. Lumina Intelligence is a highly ambitious and leading food … drink consultancy providing insights for global markets and enabling its clients to understand their consumers, competitors, and markets in the way that facilitates growth. It provides subscription data products, maintaining the highest quality of data and continuously enhancing the way customers access and apply its insights. As the Data Science Lead, you'll be responsible for overseeing More ❯

We are a global media group delivering exceptional content through events, digital, data & insight. From agribusiness, ingredients and food processing, to retail, hospitality & fine dining - we provide the inspiration, insight and connections to power our customers' success. We have offices in Gatwick, Brighton and London, UK; Montpellier, France; Singapore and Chicago, US. In line with the Company's current … offices and to work remotely for the rest of the week. Position Position: Full time - permanent Location: London/Brighton/Crawley/Hybrid We are looking for a Data Scientist to lead Lumina Intelligence's data team, providing an opportunity to shape and grow our data strategy. Lumina Intelligence is a highly ambitious and leading food … drink consultancy providing insights for global markets and enabling its clients to understand their consumers, competitors, and markets in the way that facilitates growth. It provides subscription data products, maintaining the highest quality of data and continuously enhancing the way customers access and apply its insights. As the Data Science Lead, you'll be responsible for overseeing More ❯

This is an exciting opportunity for overall responsibility for the design, build, and maintenance of the Snowflake and Azure enterprise data platform. You will manage platform engineering, quality and governance delivery teams, delivering both projects and BAU activities, aligning to CIO ways of working and co-ordinating delivery plans with end-to-end outcomes across CIO. Next to delivery … growth of the company. As a strategic leader the role holder will be expected to work beyond technology to influence decisions and outcomes for the greater good. Job Details Data Platform Operations : Managing production ETL/ELT pipelines and data orchestration frameworks. Ensuring data platform security, compliance, and access controls. Implementing and governing data quality, lineage … observability, and metadata management. Ensuring the sustainability and scalability of our data infrastructure and that it enables the company to achieve its business objectives Data Platform Optimization: Ensuring that the team is working efficiently and effectively, bringing an agile mindset to adapting to changing circumstances while working within the organisational constraints of budget, resource and quality. Work closely More ❯

Are you ready to lead the future of global genomics data sharing? The European Nucleotide Archive (ENA), a cornerstone of the international genomics community, is searching for a leader to guide its evolution in an era of unprecedented genomics driven scientific discovery. This is a unique opportunity to shape the way genomic information is preserved, shared, and leveraged to … address the most pressing challenges, from understanding biodiversity, supporting global pathogen data sharing, and advancing model organism genomics driven research. The European Nucleotide Archive (ENA) provides essential foundational data services to the world and underpins many major global data resources. As the Team Leader for ENA and BioSamples, you will oversee one of the world's largest … other global databases as part of the International Nucleotide Sequence Database Collaboration (INSDC); together, INSDC databases work to capture, preserve and make available to all the globally comprehensive sequence data set. ENA also interacts and supports many key databases and resources at and beyond EMBL-EBI. ENA makes over 60 petabytes of sequencing data available for download, including More ❯