26 to 50 of 139 Data Lake Jobs in the South East

Senior Engineering Manager - Data Platform 1 Day a Week Onsite - London We are seeking a customer-centric Senior Engineering Manager - Data Platform to lead the teams responsible for building and evolving our core data infrastructure. In this role, you will oversee the development of our foundational data platform - encompassing experimentation frameworks, event … ingestion pipelines, data lakes, governance frameworks, data observability, and real-time analytics capabilities. You will collaborate closely with data scientists, machine learning engineers, backend engineers, and product leaders to ensure our data systems are scalable, secure, observable, and foster innovation across the organization. Key Responsibilities Partner with cross-functional stakeholders in Product … Data, and Engineering to align strategic goals with platform capabilities. Lead and mentor 1-2 engineering squads focused on experimentation, analytics event logging, batch and real-time data infrastructure, observability, and governance. Define and drive the technical roadmap for a modern data platform, enabling reliable, scalable, and efficient analytics and machine learning workflows. Promote More ❯

Senior Engineering Manager – Data Platform Tech Stack Knowledge - Databricks, Kafka, AWS 1 Day a Week Onsite - London We are seeking a customer-centric Senior Engineering Manager – Data Platform to lead the teams responsible for building and evolving our core data infrastructure. In this role, you will oversee the development of our foundational data platform — encompassing experimentation frameworks, event ingestion pipelines, data lakes, governance frameworks, data observability, and real-time analytics capabilities. You will collaborate closely with data scientists, machine learning engineers, backend engineers, and product leaders to ensure our data systems are scalable, secure, observable, and foster innovation across the organization. Key Responsibilities … Partner with cross-functional stakeholders in Product, Data, and Engineering to align strategic goals with platform capabilities. Lead and mentor 1–2 engineering squads focused on experimentation, analytics event logging, batch and real-time data infrastructure, observability, and governance. Define and drive the technical roadmap for a modern data platform, enabling reliable, scalable, and More ❯

Job Description: The Food & Nutrition Data Architect will be a key driver in transforming the Food & Nutrition (F&N) business segment. Working closely with partners, you will be responsible for data solution design, including Analytics, Visualization, Dashboards, and Operations. You will bring thought leadership in your domain and collaborate with cross-functional teams to implement innovative … data solutions that enhance customer experience, drive revenue, and maintain a competitive edge in the digital marketplace. Moving towards One Enterprise Data Platform for Food is a strategic Mars Food & Nutrition goal. We aim to harness data and insights to solve critical business problems and simplify the global data and analytics user … experience, unlocking growth and operational excellence. What are we looking for? Hands-on experience designing scalable, greenfield data platforms in cloud environments using Azure D&A stack, Databricks, and Azure Open AI. Proficiency in coding (Python, PL/SQL, Shell Script), relational and non-relational databases, ETL tools (e.g., Informatica), and scalable data platforms. Knowledge of More ❯

Social network you want to login/join with: Data and AI - Senior Consultants/Senior Managers, slough col-narrow-left Client: Wavestone Location: slough, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 31.05.2025 Expiry Date: 15.07.2025 col-wide Job Description: Company Description Wavestone is a leading global transformation … For more information, visit www.wavestone.com and become part of our journey to shape a positive and impactful future. Job Description Becoming part of the UK team in our Data & AI Service Line will present new opportunities for you to make a positive impact as we embark on securing major projects with our top international clients. This will mean … working with our FTSE100 clients and beyond on a wide range of advisory projects, bringing deep business and technology expertise to help address Data and AI opportunities and challenges across their organisations. Wavestone has a significant and growing capability in Data & AI that is in high demand from our clients. Our clients trust us to tailor More ❯

Contract Data Solution Architect (Azure Data Stack, Snowflake) Up to £600 per day outside IR35 Initial 6 months leading to a 12-month engagement Hybrid (1 day/week in Brighton) Start Date: ASAP We’re currently seeking an experienced Contract Data Solution Architect (Azure Data Stack, Snowflake) for a global consultancy … to work on a large transformation programme with a famous client in Brighton. As a Data Solution Architect, you’ll be responsible for designing and documenting enterprise-standard data solutions that align with modern architectural practices. You’ll work across software, network layers, and play a critical role in ensuring high-quality, repeatable processes and low … Technologies: Snowflake – hands-on expertise in data modelling and best practices Microsoft Azure Data Stack , including: Azure Data Factory Azure Data Lake Storage Azure SQL Azure ML Power BI Experience automating CI/CD pipelines across Snowflake, Power BI, and the Azure stack Knowledge of Data Science, Analytics, and More ❯

Job Overview We are looking for a skilled Database Designer/Senior Data Engineer to join our data engineering team. This role involves the development and maintenance of data solutions in the cloud environment. The ideal candidate will have a strong background in data processing and a solid understanding of cloud data services. Requirements Key Responsibilities Design and implement modern data platforms in cloud such as AWS or Azure. Develop data pipelines and data streaming processes. Ensure data solutions are scalable, reliable, and efficient. Collaborate with data analysts and other stakeholders to meet data requirements. Optimize data … services. Proficiency in SQL, Python, or Scala. Experience with AWS RDS, AWS Glue, AWS Kinesis, AWS S3, Redis and/or Azure SQL Database, Azure Data Lake Storage, Azure Data Factory. Knowledge of data modelling, ETL processes, and data warehousing principles. Preferred Skills Strong problem-solving and analytical skills. Experience More ❯

Data Engineer/Scientist Department: Consultancy Employment Type: Full Time Location: United Kingdom/Hybrid Description As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business problems for high-profile UK public sector organisations. Your expertise … will enable organisations to maximise the value of their data assets through robust data infrastructure and sophisticated analysis, playing a key role in nationally critical projects that make a real difference to people's everyday lives. Locations: London, Guildford, Bristol, M4 corridor Hybrid working Roles and Responsibilities Actica recognises that data engineering, analytics, and … data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables analytics and data science work, while our data scientists and analysts focus on deriving insights and developing models. At Actica, we're at the forefront of the UK government's More ❯

officially designated Posts. Our UK-based staff work in King Charles Street, London, Abercrombie House in East Kilbride and in Milton Keynes. These roles contribute to FCDOs Data Strategy to improve insights to the business by provisioning it with reliable and trustworthy data sources and improving theirdeliveryin a secure manner in compliance with Data regulations. The team is primarily Azure focused but other Cloud technologies such as Oracle andAmazon Web Services (AWS) are usedin FCDO. The successful candidates will build complex data pipelines (both Extract Transform and Load ETL and Extract Load and Transform ELT ) in the Azure cloud platforms. You will work with structured and unstructured data, data lakes, data warehouses to service operational and analytical business needs. The successful candidates will: Work collaboratively with Enterprise Data Colleagues to develop pipelines and data product that aligns with data architecture and engineering best practice. Develop data assets and products that assist Power Business Intelligence (BI) colleagues to More ❯

The Data Engineer at AllPoints Fibre will join our Data and Analytics team. Reporting to the Director of Data and Analytics, you will play a pivotal role in our data transformation. AllPoints Fibre is on a transformative journey to become the most recommended way to connect in the UK telecoms market. At … the core of this initiative is the strategic use of data, which will enable us to deliver exceptional customer service while minimising operational costs through automation. We are striving for a rich data environment that will not only facilitate operational efficiencies but also drive significant commercial and strategic insights via advanced analytics. This role would suit … and analysis. Key tasks and attributes: Delivering complex ideas to both technical and non-technical stakeholders Collaboration in a transient team environment Adaptability to frequently changing priorities Working with DataLake/Lakehouse/Warehouse paradigms and associated data models. Expert knowledge of the Microsoft Fabric Analytics Platform (Azure SQL, Synapse, PowerBI) Use of Python for data More ❯

change through advanced digital solutions and we are looking to onboard an experienced Solution Architect. We are looking for a highly skilled and experienced Solution Architect focused on Data & AI to join our dynamic team. In this role, you will lead the design and delivery of data-driven solutions and AI-powered systems, specifically tailored to … meet the needs of public and private sector clients. RESPONSIBILITIES Design and develop scalable, secure, and resilient data architectures on AWS, Azure, and GCP. Govern enterprise-wide data models, pipelines, and AI frameworks for ingestion, storage, and processing. Build real-time and batch data solutions using Spark, Kinesis, and Pub/Sub. Develop machine … learning pipelines, MLOps best practices, and automated model deployment. Architect cloud-based data lakes, warehouses, and AI-driven analytics platforms. Champion compliance to data governance, privacy, and security standards (GDPR, ISO 27001, NIST). Provide technical executive-level availability and aid to renewal in AI, ML, and scalable cloud data platforms. Define ETL/ More ❯

Caring about our people, customers and quality of work differentiates us. We always support our people and customers to achieve shared, agreed goals. Role Description As a Principle Data Architect, you will work collaboratively across all aspects of project delivery and client engagement, from pre-sales and project scope definition, to project delivery and hypercare. You will lead … the conversation with HSO's customers and define the vision for better use of data across their organisation. You will own the technical design and manage the delivery of data & analytics solutions to HSO's customers. You will be highly experienced in Microsoft Azure, and have a working knowledge of other technology platforms. You will also … transform and load Experience in data modelling Exposure and experience of Azure data and analytics products and services (SQL and NOSQL databases, data lake, data factory, synapse, data bricks, PowerBI, Fabric, MDM, Purview, Profisee.) Experience of working at a senior level with technology stakeholders Experience working with data More ❯

Social network you want to login/join with: As an Information Asset Register Lead, you will need to collaborate with the Head of Data Management and the Data Governance Manager to ensure data quality, compliance, and accessibility. In addition, you will play a pivotal role in educating other team members on the utilisation … of the Information Asset Register and in shaping the evolution of data governance strategies and policies. What you’ll be doing as a Data Asset Register Lead Creating and maintaining a comprehensive catalogue of all data sources within the organisation using Azure Purview. Classify data based on its information type, sensitivity, quality … adapting to change, and continuous improvement in data governance practices. Desirable experience includes: Experience in the water industry or other utilities. Familiarity with Azure Data Lake, Lakehouse architecture or Master Data Management (MDM). Ability to write SQL queries and understanding of data warehousing concepts. What’s in it for you More ❯

Social network you want to login/join with: At Person Centred Software, we’re transforming the care sector through innovative, data-driven digital solutions. We’re looking for a Lead Data Scientist with a passion for ethical AI, healthcare impact, and scalable technology. In this role, you’ll lead the design and deployment of predictive … models, benchmarking tools, and data pipelines that directly improve outcomes in social care. You’ll work at the intersection of advanced analytics and compassionate innovation, shaping the future of care intelligence across the UK and beyond. What You’ll Do: Design and implement benchmarking methodologies using data from hundreds of care homes across clinical and operational … metrics. Build scalable data science workflows using Azure Data Factory, Synapse Analytics, Databricks, and other Microsoft Azure services. Lead end-to-end development of predictive models (e.g., fall prediction, infection prevention) using Azure Machine Learning. Collaborate with developers and product managers to embed ML outputs into dashboards and APIs via Power BI and Azure tools. Ensure More ❯

with enterprise data warehouse/BI projects Proficiency in Data Analysis Expressions (DAX) Extensive SQL experience Experience with Data Verse Data Lake Experience Main Responsibilities: Developing, maintaining, and supporting custom analytics and reporting solutions within Dynamics 365 F&O. Collaborating with teams to identify reporting needs, design dashboards, and generate insights. … SQL. Procurement of resources in Azure Portal for data storage and analytics. Utilizing Azure Synapse Serverless for scalable data analytics. Experience with Data Lake, Lake House, and Delta Lake technologies. Managing and integrating data using Data Verse. Creating reports with Power BI and Paginated Report Builder. Supporting … data consolidation and migration projects. Location: London & Remote Eligibility to work in the country is required. Catch Resource Management provides ERP resources including Dynamics 365, JD Edwards, and NetSuite, supporting full project lifecycle implementation and support. If qualified, please apply. Note that due to high response levels, only closely matched candidates will be contacted immediately. To explore similar More ❯

Provide architectural guidance on security, compliance, and governance in cloud solutions. Collaborate with stakeholders to create digital roadmaps for long-term cloud transformation. Design conceptual, logical, and physical data architectures that support business and analytics needs. Implement data cataloging and data governance frameworks to enhance data discovery, lineage tracking, and compliance. Define … data modeling standards, ensuring alignment with business intelligence, AI/ML, and analytics strategies. Develop data security frameworks, including encryption, access control, and data masking. Support data migration and transitioning strategies, ensuring minimal disruption to business operations. Optimize data storage and retrieval mechanisms across cloud-based databases, preferably Azure CosmosDB … GCP). Enterprise Architecture: Proven ability to design and implement end-to-end cloud solutions, including multi-cloud and hybrid models. Strong knowledge of conceptual, logical, and physical data modeling. Experience in data cataloging, data lineage, and governance frameworks. Hands-on experience with cloud-based databases, data lakes, and data More ❯

Social network you want to login/join with: Our client a London based Technology and Data Engineering leader have an opportunity in a high growth AI Lab for an ‘AI Engineering Researcher' A UK based 'Enterprise' Artificial Intelligence organisation, focussing on helping accelerate their clients journey towards becoming 'AI-Optimal' - starting with significantly enhancing its abilities in … expanding research team of exceptional PhD computer scientists, software engineers, mathematicians & physicists, to use a unique multi-disciplinary approach to solving enterprise-AI problems. Principal Activities of role: Data Pipeline Development: • Design, develop, and maintain ETL processes to efficiently ingest data from various sources into data warehouses or data lakes. • Data Integration and Management: Integrate data from disparate sources, ensuring data quality, consistency, and security across systems. Implement data governance practices and manage metadata. • System Architecture: Design robust, scalable, and high-performance data architectures using cloud-based platforms (e.g., AWS, Google Cloud, Azure). • Performance Optimization: Monitor, troubleshoot, and optimize data More ❯

Data/Data Specialisation). Extensive experience in Data Engineering, in both Cloud & On-Prem, Big Data and Data Lake environments. Expert knowledge in data technologies, data transformation tools, data governance techniques. Strong analytical and problem-solving abilities. Good understanding of Quality and … or Azure hands-on experience. ETL Tools such as Azure Data Fabric (ADF) and Databricks or similar ones. Data Lakes: Azure Data, Delta Lake, Data Lake or Databricks Lakehouse. Certifications: AWS, Azure, or Cloudera certifications are a plus. The role comes with an extensive benefits package including a good pension … Engineer, Spark, Java, Python, PySpark, Scala, Big Data, AWS, Azure, On-Prem, Cloud, ETL, Azure Data Fabric, ADF, Databricks, Azure Data, Delta Lake, Data Lake. Please note that due to a high level of applications, we can only respond to applicants whose skills and qualifications are suitable for this position. More ❯

login/join with: Duration: contract to run until 31/12/2025 Rate: up to £644 p/d Umbrellainside IR35 We are seeking an experienced Data Modeller with proven expertise in the London Market insurance sector. The successful candidate will play a key role in designing and validating data models that support enterprise … data initiatives. This includes working closely with data engineers, architects, and business stakeholders to ensure data structures are scalable, accurate, and aligned with business needs. Key Skills/requirements Design and maintain conceptual, logical, and physical data models to support reporting, analytics, and operational systems. Collaborate with data engineers and … to explain complex data concepts to non-technical stakeholders. Preferred Skills: Experience with insurance platforms such as Guidewire, Duck Creek, or legacy PAS systems. Knowledge of Delta Lake, Apache Spark, and data pipeline orchestration tools. Exposure to Agile delivery methodologies and tools like JIRA, Confluence, or Azure DevOps. Understanding of regulatory data requirements More ❯

Senior Test Automation Engineer - Data Salary: £53,460 - £69,500 Join Our Team as a Senior Data Test Automation Engineer at Hawk-Eye Innovations Are you passionate about cutting-edge technology, sports, and driving quality? At Hawk-Eye Innovations, we revolutionise sports through innovative solutions, from computer vision to video replay systems. Our technology shapes officiating … data insights, broadcasting, and entertainment across global sports. Join our agile, cross-functional teams to enhance testing practices across cloud-native microservices and data platforms. You'll develop scalable test automation frameworks with a focus on data validation using tools like Pandas, and lead strategies for testing data lakes. Collaborate closely with … strategies for AWS data lakes (e.g., S3, Glue, Athena) with a focus on schema evolution, data quality rules, and performance benchmarks, prioritizing data lake testing over traditional SQL approaches. Automate data tests within CI/CD workflows to enable continuous build, validation, and deployment. Create tools for synthetic data More ❯

come. If you want to be part of a diverse team where opportunities flow and fresh ideas are welcomed, #JustAddWater. We currently have an opportunity for an Azure Data Architect to join our team based in Exeter. This is a Permanent Full-time position with a salary of £70,000 per annum plus excellent benefits. About the role … decision-making. What you’ll be doing: Design and implement data solutions on Azure, using services like Azure SQL Database, Data Factory, Data Lake Store, Data Lake Analytics, Stream Analytics, Azure Storage, Cosmos DB, and more. Make informed decisions on the strategic direction and roadmap for cloud platform use and … Architect or similar role. Deep understanding of database structure principles. Experience with Azure data technologies such as Azure SQL, Data Factory, Data Lake, Cosmos DB, PowerBI, and SQL. BSc in Computer Science, IT, or a relevant field. Ideally based in Exeter, or out of our Bristol or Redhill office. What's in More ❯

Snowflake Data Engineer Milton Keynes (Hybrid) 3 Month Contract £400/day (Outside IR35) Snowflake Data Engineer needed with experience of data migration projects. 3 Month Rolling Contract based in Milton Keynes (Hybrid remote). A chance to work with an established global IT, Digital and Network Services Consultancy for an end client in … a 'hybrid' basis with 2-3 days/week working remotely from home (WFH). Outside IR35. Start ASAP in Feb 2025. Key experience + tasks will include: Data Engineer with strong experience of designing + implementing Snowflake data solutions environments. Designing business processes + implementing cloud-based enterprise data warehouse solutions architecture … using Snowflake. Data Migration of legacy systems to new Snowflake environment including: cloud data warehouse, cloud data platform set-up, data lake/data platform design, integrating new features, customizations + interfaces. Creating High-level and Low-level design documents (HLD, LLD) and functionality analysis for COTS solution. Deep More ❯

Join a Leading Growth business on its transformative journey to become the UK's most recommended businesses in their industry Lead Data Engineer Salary: £70-90k Location: Reading – Hybrid Benefits: Competitive Role Overview: As Lead Data Engineer , you will be part of the Corporate Data team, reporting directly to the Senior Leadership team. … You will lead a small team of data engineers, overseeing the design, build, and maintenance of the infrastructure and systems that collect, store, and process corporate data for reporting and analysis. Key Responsibilities: • Lead and manage a team of data engineers. • Design, build, and maintain data infrastructure and systems. • Ensure effective use … collaborative environment and adapts to changing priorities with ease. • Excellent communication and presentation skills, capable of conveying complex ideas to both technical and non-technical stakeholders. • Deep understanding of DataLake, Lakehouse, and Warehouse paradigms. • Extensive experience in developing and maintaining data pipelines for ELT/ETL from various data sources, including databases, APIs, text files, and More ❯

EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Key Responsibilities Lead the technical delivery of complex data engineering projects, ensuring solutions are scalable, secure, and aligned with our delivery framework, and client goals. Design and build high-quality data pipelines and integration workflows, setting … throughout the development lifecycle. Collaborate with multidisciplinary teams, including a wide range of other roles, to shape solutions that meet both technical and business requirements. Mentor and support data engineering teams, fostering a culture of continuous improvement, knowledge sharing, and technical excellence. Support testing activities by ensuring pipelines are testable, observable, and reliable; work with QA and analysts … sense of ownership and accountability. Technologies, Methodologies and Frameworks: Direct delivery experience using cloud-native data services, specifically in Microsoft Azure, Fabric, Dataverse, Synapse, Data Lake, Purview. Deep expertise in data engineering tools and practices, including Python, SQL, and modern ETL/ELT frameworks (e.g., Azure Data Factory, Talend, dbt). More ❯

EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Key Responsibilities Lead the technical delivery of complex data engineering projects, ensuring solutions are scalable, secure, and aligned with our delivery framework, and client goals. Design and build high-quality data pipelines and integration workflows, setting … throughout the development lifecycle. Collaborate with multidisciplinary teams, including a wide range of other roles, to shape solutions that meet both technical and business requirements. Mentor and support data engineering teams, fostering a culture of continuous improvement, knowledge sharing, and technical excellence. Support testing activities by ensuring pipelines are testable, observable, and reliable; work with QA and analysts … sense of ownership and accountability. Technologies, Methodologies and Frameworks: Direct delivery experience using cloud-native data services, specifically in Microsoft Azure, Fabric, Dataverse, Synapse, Data Lake, Purview. Deep expertise in data engineering tools and practices, including Python, SQL, and modern ETL/ELT frameworks (e.g., Azure Data Factory, Talend, dbt). More ❯

EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Key Responsibilities Lead the technical delivery of complex data engineering projects, ensuring solutions are scalable, secure, and aligned with our delivery framework, and client goals. Design and build high-quality data pipelines and integration workflows, setting … throughout the development lifecycle. Collaborate with multidisciplinary teams, including a wide range of other roles, to shape solutions that meet both technical and business requirements. Mentor and support data engineering teams, fostering a culture of continuous improvement, knowledge sharing, and technical excellence. Support testing activities by ensuring pipelines are testable, observable, and reliable; work with QA and analysts … sense of ownership and accountability. Technologies, Methodologies and Frameworks: Direct delivery experience using cloud-native data services, specifically in Microsoft Azure, Fabric, Dataverse, Synapse, Data Lake, Purview. Deep expertise in data engineering tools and practices, including Python, SQL, and modern ETL/ELT frameworks (e.g., Azure Data Factory, Talend, dbt). More ❯