1 to 25 of 37 Permanent Big Data Jobs in the South East

We are searching for an experienced Lead Data Engineer for an exciting data-driven business with multiple office locations across the UK. The role is offered as a remote position, but you MUST be based in the UK to be considered for the opportunity. In this role you will be involved in determining the future direction and impact … of data engineering within the business. This is an extremely exciting Lead Data Engineering role, a fantastic opportunity for an experienced, innovative and hands-on data professional to help shape our client's products and solutions. Reporting directly to the Head of Data Engineering, you will play a crucial role in driving the team's vision … and objectives to completion. You will be expected to provide technical leadership, own the solution, ensure the reliability of data products, and collaborate closely with your team and other teams to optimise data solutions. This is a fantastic opportunity for highly skilled and motivated Lead Data Engineer with strong expertise in data architecture, ETL pipelines, cloud More ❯

Job Description: We are seeking a highly skilled and visionary Director of Data Platforms and Architecture to lead the design, development, and governance of our enterprise-wide Snacking data platform ecosystem. This individual will be responsible for driving platform strategy, fostering innovation, and ensuring robust data architecture that empower multiple products and capabilities to power business decisions … scalability, and operational excellence. As a strategic leader, the Director of Data Platforms and Architecture will oversee the implementation and optimization of cutting-edge data technologies & solutions, establish best practices in data platforms and governance, and provide technical leadership to multidisciplinary teams. You will work closely with stakeholders across business, IT, and analytics teams to align data architecture with organizational goals, enabling seamless data acquisition and advanced analytics capabilities. What will be your key responsibilities? Strategic Leadership: Develop and drive the long-term vision for enterprise data platforms and architecture, ensuring alignment with organizational goals and priorities. Collaborate with C-level executives and business leaders to identify opportunities for leveraging data as a More ❯

We are looking to hire a additional 2 Data Engineers to join the Satalia Data Engineering Team. We are investing massively in developing next-generation AI tools for multimodal datasets and a wide range of applications. We are building large scale, enterprise grade solutions and serving these innovations to our clients and WPP agency partners. As a member … roadmap. Your contributions will directly shape cutting-edge AI products and services that make a tangible impact for FTSE 100 clients. What you’ll be doing: Collaborate closely with data scientists, architects, and other stakeholders to understand and implement business requirements. Provide data engineering support for AI model development and deployment, ensuring data scientists have access to … the data they need in the format they need it. Implement and optimize data transformations and ETL/ELT processes, using appropriate data engineering tools. Work with a variety of databases and data warehousing solutions to store and retrieve data efficiently. Implement monitoring, troubleshooting, and maintenance procedures for data pipelines to ensure the high More ❯

Join us as a Data Platform Engineer for our client. At Peregrine, were always seeking Specialist Talent that have the ideal mix of skills, experience, and attitude, to place with our vast array of clients. From Business Analysts in large government organisations to Software Developers in the private sector we are always in search of the best talent to … benefits, you will be deployed across our portfolio of clients as a specialist consultant, working on a wide array of complex projects across multiple industries. The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and on-premises … platforms. You will play a key role in ensuring that all data systems comply with industry regulations and security standards while enabling efficient access for analytics and operational teams. A strong command of Apache NiFi is essential for this role. You will be expected to design, implement, and maintain data flows using NiFi, ensuring accurate, efficient, and secure More ❯

The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and on premises platforms. You will play a key role in ensuring that all data systems comply with industry regulations and security standards while enabling efficient access … for analytics and operational teams. A strong command of Apache NiFi is essential for this role. You will be expected to design, implement, and maintain data flows using NiFi, ensuring accurate, efficient, and secure data ingestion, transformation, and delivery. You should be adept at identifying and resolving issues within NiFi flows, managing performance bottlenecks, and implementing robust error … handling strategies. Youll work closely with cross-functional teams including data architects, compliance officers, and cybersecurity specialists to integrate data from various systems such as databases, APIs, and cloud platforms. Your work will directly support batch processing, real-time streaming, and event-driven data pipelines across a variety of use cases. Were looking for candidates with over More ❯

Position Summary The Database Administrator is part of the Data and AI practice. This team is made up of experts dedicated to Data centric offers (Data platform, Data Analytics, IoT, Big Data, Data compliance) who support our customers in their IT and Data transformations. We help customers choose the right tools and … at any Claranet UK office - most people choose a combination of the two. We’ve worked hard to create a remote-friendly culture and believe you can have a big impact no matter where you live. Working in the Data Practice we can offer an environment where you will be surrounded by like-minded, highly technical people. Due … Security Reporting On-Call for fourth-line support 24/7 rota. Automation of all support activities including backups, patching, and script deployments. Accompany customers towards Cloud technologies, PaaS data platforms and other cloud-native Data Services. Ensure the storage, processing, and quality of customer data You will build new customer environments, working as part of a More ❯

Data Solutions Architect £110,000 - £120,000 GBP 10% Bonus Hybrid WORKING Location: Central London, Greater London - United Kingdom Type: Permanent Data Solutions Architect - Consulting Location: London (Remote-first) Working Pattern: Full-time, Permanent Salary: £110,000 - £120,000 per annum About the Role We're seeking a Data Solutions Architect to join a dynamic consulting team … delivering cutting-edge, cloud-based data solutions for high-profile clients across diverse industries. This is a remote-first role with occasional travel, offering the opportunity to lead end-to-end delivery of complex data architecture projects in a collaborative, agile environment. What You'll Be Doing Leading cross-functional teams of Data Engineers, Architects, BAs, and … QA Analysts. Designing and delivering scalable data solutions using modern cloud platforms and data technologies. Engaging with stakeholders to shape and own the technical delivery of data architecture projects. Applying best practices in data governance, security, and compliance. What We're Looking For Experience & Leadership Proven track record as a Lead Data Solutions Architect or More ❯

Apply now to be part of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of roles including but not limited … to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will … be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis and investigation. Working with others is key, you could be working with other engineers, developers, data scientists, analysts and even stakeholders to understand their More ❯

Python Data Engineer Location: Farnborough (Hybrid) Employment Type: Full-Time, Permanent Salary: c£50,000We are recruiting on behalf of a leading organisation based in Farnborough, currently seeking a highly skilled Python Data Engineer to join their growing data team. This is a fantastic opportunity to work with cutting-edge technologies and play a key role in … the design, development, and optimisation of scalable data solutions. The Role As a Python Data Engineer, you will be instrumental in building robust data pipelines and maintaining cloud-based databases to support a range of business functions. Working closely with analysts and data scientists, you'll help solve complex data challenges and contribute to the … company's data-driven strategy. Key Responsibilities Design and implement efficient, scalable data pipelines using Python and SQL Server Develop, test, and deploy ETL workflows and data processing solutions using Docker containers on Azure Collaborate with data stakeholders to resolve data-related challenges Optimise existing pipelines and databases for performance and reliability Troubleshoot and maintain More ❯

About Archive360Archive360 delivers a modern archiving platform that empowers organizations to address complex data governance and compliance challenges while leveraging AI and analytics. By transforming data into a trusted, accurate, and protected strategic asset, we help organizations achieve their business objectives and drive innovation. Position Overview:We are seeking a Pre-Sales Solutions Architect who blends technical expertise … our sales organization, bridging the gap between technical functionality and customer needs. You’ll partner closely with Sales, Product, and Engineering teams to deliver tailored solutions that solve complex data analysisand archiving challenges. Key Responsibilities: Be an expert in big data analytics to excite customers about Archive360. You will become a trusted advisor on multiple issues of … customer needs and business goals. Develop customer relationships and build internal partnerships with account executives and teams. What You Bring: Must have experience with ETL tools such as Azure Data Factory and processes for data extraction, transformation, and loading Must have experience with structured data management and migrations. Must have prior experience with involvement in application retirement More ❯

Data & Analytics Consultant HD-Tech is proud to be partnering with a leading data management and analytics consultancy that specialises in delivering transformative business insights using Microsoft technologies. With over 10 years of industry presence, our client is recognised for helping organisations optimise their use of data to drive smarter decisions and long-term value. As they … continue to scale their professional and managed services offerings, we’re now seeking a Data & Analytics Consultant to join their expanding consulting team. About the Company This organisation is deeply committed to helping businesses "predict their future" through better use of data, technology, people, and process . Their services include: Managed Data Services Database and Infrastructure Consultancy … Data Engineering & Analytics Adoption and Change Management Their reputation is built on strong consulting skills, deep expertise in Microsoft Data Services, and a highly collaborative culture. They place a premium on client engagement, commercial awareness, and internal collaboration to drive results. Role Overview As a Consultant, you will play a hands-on role in delivering client-facing analytics More ❯

Data Solution Architect ££125,000 GBP + benefits package Hybrid WORKING Location: Central London, Greater London - United Kingdom Type: Permanent Data Solution Architect Location: London (Hybrid) Salary: Up to £125,000 + benefits package Contract Type: Permanent We are supporting a leading consulting client in their search for a Data Solution Architect to join a remote-first … data architecture team. This is a senior, delivery-focused role requiring deep technical expertise and end-to-end consulting experience across cloud-based data solutions. Key Responsibilities: Lead cross-functional teams to deliver scalable data solutions across cloud platforms Architect data lakes, lakehouses, and event-driven systems using tools like Databricks, Kafka, and Confluent Apply Data Mesh and Data Fabric principles to modern data architectures Define and implement data product strategies with a product-led mindset Ensure compliance with data governance and security standards (e.g. GDPR, HIPAA) Engage stakeholders and oversee technical delivery across Agile projects Skills & Experience: Proven experience as a Lead Data Solution Architect in consulting environments Expertise More ❯

We are a global media group delivering exceptional content through events, digital, data & insight. From agribusiness, ingredients and food processing, to retail, hospitality & fine dining - we provide the inspiration, insight and connections to power our customers' success. We have offices in Gatwick, Brighton and London, UK; Montpellier, France; Singapore and Chicago, US. In line with the Company's current … offices and to work remotely for the rest of the week. Position Position: Full time - permanent Location: London/Brighton/Crawley/Hybrid We are looking for a Data Scientist to lead Lumina Intelligence's data team, providing an opportunity to shape and grow our data strategy. Lumina Intelligence is a highly ambitious and leading food … drink consultancy providing insights for global markets and enabling its clients to understand their consumers, competitors, and markets in the way that facilitates growth. It provides subscription data products, maintaining the highest quality of data and continuously enhancing the way customers access and apply its insights. As the Data Science Lead, you'll be responsible for overseeing More ❯

We are a global media group delivering exceptional content through events, digital, data & insight. From agribusiness, ingredients and food processing, to retail, hospitality & fine dining - we provide the inspiration, insight and connections to power our customers' success. We have offices in Gatwick, Brighton and London, UK; Montpellier, France; Singapore and Chicago, US. In line with the Company's current … offices and to work remotely for the rest of the week. Position Position: Full time - permanent Location: London/Brighton/Crawley/Hybrid We are looking for a Data Scientist to lead Lumina Intelligence's data team, providing an opportunity to shape and grow our data strategy. Lumina Intelligence is a highly ambitious and leading food … drink consultancy providing insights for global markets and enabling its clients to understand their consumers, competitors, and markets in the way that facilitates growth. It provides subscription data products, maintaining the highest quality of data and continuously enhancing the way customers access and apply its insights. As the Data Science Lead, you'll be responsible for overseeing More ❯

At Hastings Direct, storing your data securely is very important to us. Please see our Data Protection Statement and Job Application Terms & Conditions here for details on how your information will be stored. Head of Data Platform Engineering page is loaded Head of Data Platform Engineering Apply locations Bexhill time type Full time posted on Posted … days left to apply) job requisition id This is an exciting opportunity for overall responsibility for the design, build, and maintenance of the Snowflake and Azure enterprise data platform. You will manage platform engineering, quality and governance delivery teams, delivering both projects and BAU activities, aligning to CIO ways of working and co-ordinating delivery plans with end-to … growth of the company. As a strategic leader the role holder will be expected to work beyond technology to influence decisions and outcomes for the greater good. Job Details Data Platform Operations : Managing production ETL/ELT pipelines and data orchestration frameworks. Ensuring data platform security, compliance, and access controls. Implementing and governing data quality, lineage More ❯

This is an exciting opportunity for overall responsibility for the design, build, and maintenance of the Snowflake and Azure enterprise data platform. You will manage platform engineering, quality and governance delivery teams, delivering both projects and BAU activities, aligning to CIO ways of working and co-ordinating delivery plans with end-to-end outcomes across CIO. Next to delivery … growth of the company. As a strategic leader the role holder will be expected to work beyond technology to influence decisions and outcomes for the greater good. Job Details Data Platform Operations : Managing production ETL/ELT pipelines and data orchestration frameworks. Ensuring data platform security, compliance, and access controls. Implementing and governing data quality, lineage … observability, and metadata management. Ensuring the sustainability and scalability of our data infrastructure and that it enables the company to achieve its business objectives Data Platform Optimization: Ensuring that the team is working efficiently and effectively, bringing an agile mindset to adapting to changing circumstances while working within the organisational constraints of budget, resource and quality. Work closely More ❯

Are you ready to lead the future of global genomics data sharing? The European Nucleotide Archive (ENA), a cornerstone of the international genomics community, is searching for a leader to guide its evolution in an era of unprecedented genomics driven scientific discovery. This is a unique opportunity to shape the way genomic information is preserved, shared, and leveraged to … address the most pressing challenges, from understanding biodiversity, supporting global pathogen data sharing, and advancing model organism genomics driven research. The European Nucleotide Archive (ENA) provides essential foundational data services to the world and underpins many major global data resources. As the Team Leader for ENA and BioSamples, you will oversee one of the world's largest … other global databases as part of the International Nucleotide Sequence Database Collaboration (INSDC); together, INSDC databases work to capture, preserve and make available to all the globally comprehensive sequence data set. ENA also interacts and supports many key databases and resources at and beyond EMBL-EBI. ENA makes over 60 petabytes of sequencing data available for download, including More ❯

in a customer-oriented manner on a variety of projects in the areas of Agile Software Development, Artificial Intelligence, and DevOps & Cloud. In addition, we work on topics in Big Data and IoT. We mostly use Java and TypeScript, but also other programming languages, such as Python or C#. Our clients include large corporations as well as medium … in a customer-oriented manner on a variety of projects in the areas of Agile Software Development, Artificial Intelligence, and DevOps & Cloud. In addition, we work on topics in Big Data and IoT. We mostly use Java and TypeScript, but also other programming languages, such as Python or C#. Our clients include large corporations as well as medium More ❯

Working Join us and you'll have an opportunity to make an impact and be part of an organisation committed to driving sustainable outcomes. At OS, we use location data and intelligence to help customers build more resilient societies, preserve the environment, foster healthier, happier spaces that people want to live in, and support the delivery of improved public … looking for people to join them. Its mission is to work across the business to provide customer centric design and technology services. This role is based within the Core Data Services Platform Team, part of Data Derivation. This is an Agile scrum team comprised of 3 sub-teams, each with a focus on different types of spatial data … test related topics, tools, and techniques - be a part of it! About the role Implement automated tests using our existing test frameworks, and extend these frameworks as necessary Validate data quality using big data testing tools Analyse data transformations in order to establish the best way to test key business requirements Contribute testing acumen into agile More ❯

Contract Data Engineer Financial Services 6+ Months Competitive Day Rate My client, a global consultancy, is looking for an experienced Data Engineer to join on a contract basis to support major digital transformation projects with Tier 1 banks. You'll help design and build scalable, cloud-based data solutions using Databricks , Python , Spark , and Kafka -working on … initiatives and enhancing high-traffic financial applications. Key Skills & Experience: Strong hands-on experience with Databricks , Delta Lake , Spark Structured Streaming , and Unity Catalog Advanced Python/PySpark and big data pipeline development Familiar with event streaming tools ( Kafka , Azure Event Hubs ) Solid understanding of SQL , data modelling , and lakehouse architecture Experience deploying via CI/CD … tools (e.g., Azure DevOps, GitHub Actions) Nice to Have: Knowledge of Scala/Java Understanding of GDPR and handling sensitive data This is a contract role (UK-based) offering the chance to work on high-impact projects shaping the future of finance with some onsite presence required. More ❯

s team based in central London. The successful Quantitative Analyst will join a small but very talented team and will be expected to interpret, filter, and analyse very large data sets whilst working closely with other analysts and developers. The successful Quantitative Analyst will be a forward-thinking individual who is more than comfortable working to both their own … following: Python, C#, C++, Java Mathematical Modelling Mathematical skills, particularly a keen understanding of probabilities and statistics Analytic mindset Strong communication skills Accuracy and attention to detail Experience in data science (big data, deep learning, machine learning) is beneficial Specific sports trading knowledge is beneficial but not essential If you feel you have the skills and experience More ❯

Data Engineer (SC cleared) Start: ASAP Duration: 12 months Location: Mostly Remote - must have access to London or Bristol Pay: negotiable, INSIDE IR35 Responsibilities: - Design, implement robust ETL/ELT data pipelines using Apache Airflow - Build ingestion processes from internal systems and APIs, using Kafka, Spark, AWS - Develop and maintain data lakes and warehouses (AWS S3, Redshift … Ensuring governance using automated testing tools - Collaborate with DevOps to manage CI/CD pipelines for data deployments and ensure version control of DAGs - Apply best practice in security and compliance Required Tech Skills: - Python and SQL for processing - Apache Airflow, writing Airflow DAGs and configuring airflow jobs - AWS cloud platform and services like S3, Redshift - Familiarity with big data processing using Apache Spark - Knowledge of modelling, schema design and partitioning strategies - Understanding batch Vs streaming data paradigms - Docker or Kubernetes (containerization More ❯

management Skills and Experience AI/ML Expertise: Strong understanding of LLMs, NLP, and AI-driven recommendations. Technical Leadership: Experience in AI product scalability, DevOps, and cloud architecture. Backend & Data Skills: Proficiency in Python, Node.js, PostgreSQL, MongoDB, API security. AI Model Deployment: MLOps, scaling, data engineering, and AI ethics awareness. Strategic Mindset: Ability to align technology with business … objectives and cost efficiency. Security & Compliance Knowledge: GDPR, API authentication, and observability best practices. Big data processing: Understanding data lakes, warehouses, and tools like Spark, Kafka, and Airflow. ETL Pipelines: Ability to evaluate data ingestion, transformation, and cleaning processes. DevOps & CI/CD: Hands-on knowledge of Jenkins, GitHub Actions, Terraform, and CloudFormation. What's in More ❯

We are looking for a Data Governance Analyst , to help shape how we manage, protect, and activate data across the enterprise. What You'll Do Champion our data governance framework-ensuring consistency, quality, and compliance Collaborate across IT, business units, and data owners to embed MDM best practices Guide teams in applying data governance principles … and policies Support audits, oversight mechanisms, and regulatory alignment Help lead governance council meetings and drive strategic decision-making What You'll Bring Strong grounding in data governance and MDM Experience with tools like Azure Purview Big data cloud familiarity (e.g., Azure, Synapse, Databricks) Excellent stakeholder collaboration and analytical problem-solving skills Agile, iterative project delivery expertise More ❯

We are looking for a Data Governance Analyst , to help shape how we manage, protect, and activate data across the enterprise. What You'll Do Champion our data governance framework-ensuring consistency, quality, and compliance Collaborate across IT, business units, and data owners to embed MDM best practices Guide teams in applying data governance principles … and policies Support audits, oversight mechanisms, and regulatory alignment Help lead governance council meetings and drive strategic decision-making What You'll Bring Strong grounding in data governance and MDM Experience with tools like Azure Purview Big data cloud familiarity (e.g., Azure, Synapse, Databricks) Excellent stakeholder collaboration and analytical problem-solving skills Agile, iterative project delivery expertise More ❯