26 to 50 of 92 Data Lake Jobs in the South East

Data Engineer, Azure London/Hybrid £competitive + bonus + excellent benefits Azure, Fabric, Python Data Engineer with extensive cloud experience is sought by thriving financial services organisation in the City of London. As part of the central data platform team, you will be responsible for developing the Data Engineering standards to … be followed by federated data teams across the business. Within these standards our client is looking to create a Data Engineering development environment that has the flexibility to ensure engineers work as efficiently as possible while operating within the security constraints outlined by the business. Responsibilities Work with Product Owners to establish product requirements. Design and … engineering tools on a variety of complex products. Python Semantic Models Azure Data Factory Azure Synapse SQL Server ETL/ELT Database Design Data Warehousing Datalake/Lakehouse For a full consultation on this exciting new opportunity, get in touch with Arc IT today More ❯

Data Architect- £100,000 - Hybrid We're looking for a Data Architect to take a leading role in designing and evolving the backbone of our data ecosystem. This is a strategic, high-impact role where your expertise will define how we model, store, and use data across the business. You'll shape … the technical direction of our data landscape-developing scalable, secure, and future-ready systems that enable insight, innovation, and growth. What You'll Do Design and implement scalable data architectures, models, and integration frameworks. Lead the definition of the "As-Is" and "To-Be" data platform vision, ensuring alignment with business goals. Oversee the … end-to-end data lifecycle-from modelling and ingestion to governance, storage, and delivery. Ensure compliance with GDPR and data protection standards. Collaborate with engineering, delivery, and business teams to translate strategic objectives into technical solutions. Provide technical leadership and guidance across data initiatives, influencing best practice and architectural standards. Safeguard the integrity, availability More ❯

Role 🧠 A fast-growing UK tech group is looking for a hands-on AI Infrastructure Engineer to design and build the systems connecting core platforms (CRM, data lake, business tools) into a unified, AI-ready architecture. This is a greenfield build role — you’ll wire together SaaS tools, automate data flows, and shape the internal … days onsite, hands-on role, fast-paced environment What You’ll Do 🔧 Design and implement end-to-end data pipelines linking core platforms (CRM → data lake → AI systems) Architect schemas and transformation layers optimized for analytics, automation, and AI workflows (RAG/internal copilots) Build Python and API integrations , using low-code/no-code … streamline operations and M&A integration processes Monitor, ensure reliability, and scale integrations and pipelines Document and modularize infrastructure for future AI engineers ✅ Must-Haves: Python & SQL experience Data engineering skills : pipeline design, data modeling, schema development Experience with API integrations, webhooks , and low/no-code automation tools (Zapier, Make, Matillion) Comfortable in AWS or More ❯

Role 🧠 A fast-growing UK tech group is looking for a hands-on AI Infrastructure Engineer to design and build the systems connecting core platforms (CRM, data lake, business tools) into a unified, AI-ready architecture. This is a greenfield build role — you’ll wire together SaaS tools, automate data flows, and shape the internal … days onsite, hands-on role, fast-paced environment What You’ll Do 🔧 Design and implement end-to-end data pipelines linking core platforms (CRM → data lake → AI systems) Architect schemas and transformation layers optimized for analytics, automation, and AI workflows (RAG/internal copilots) Build Python and API integrations , using low-code/no-code … streamline operations and M&A integration processes Monitor, ensure reliability, and scale integrations and pipelines Document and modularize infrastructure for future AI engineers ✅ Must-Haves: Python & SQL experience Data engineering skills : pipeline design, data modeling, schema development Experience with API integrations, webhooks , and low/no-code automation tools (Zapier, Make, Matillion) Comfortable in AWS or More ❯

Role 🧠 A fast-growing UK tech group is looking for a hands-on AI Infrastructure Engineer to design and build the systems connecting core platforms (CRM, data lake, business tools) into a unified, AI-ready architecture. This is a greenfield build role — you’ll wire together SaaS tools, automate data flows, and shape the internal … days onsite, hands-on role, fast-paced environment What You’ll Do 🔧 Design and implement end-to-end data pipelines linking core platforms (CRM → data lake → AI systems) Architect schemas and transformation layers optimized for analytics, automation, and AI workflows (RAG/internal copilots) Build Python and API integrations , using low-code/no-code … streamline operations and M&A integration processes Monitor, ensure reliability, and scale integrations and pipelines Document and modularize infrastructure for future AI engineers ✅ Must-Haves: Python & SQL experience Data engineering skills : pipeline design, data modeling, schema development Experience with API integrations, webhooks , and low/no-code automation tools (Zapier, Make, Matillion) Comfortable in AWS or More ❯

Mid-Level Azure Data Engineer - Investment Management - London/Hybrid We're partnered with a small but forward-thinking Investment Management company in London that's continuing to evolve its data capabilities. They're now looking for a Mid-Level Azure Data Engineer to join a team of five engineers and analysts who are … driving the build and optimisation of a modern Azure-based data platform. This is a great opportunity for someone who enjoys working end-to-end across the data lifecycle and wants to have real influence in a close-knit, collaborative environment. You'll be working with the latest Azure technologies to help the business make smarter … environment that values collaboration, learning, and innovation What we're looking for Hands-on experience with the Azure Data Engineering stack (ADF, Databricks, Synapse, Data Lake) Strong skills in SQL and Python (PySpark experience is a bonus) Experience building and optimising ETL/ELT pipelines A background in Financial Services is a plus, but not More ❯

Principal Data Architect - Hybrid - London - No Sponsorship Available About the Role We are seeking an experienced and visionary Principal Data Architect to join a leading consultancy in the financial services sector. This strategic role involves leading complex, high-profile data initiatives that drive innovation and transformation for major financial institutions. The Company Our client … Known for fostering an entrepreneurial culture and championing diversity, they empower their teams to deliver impactful solutions in a collaborative and inclusive environment. Key Responsibilities Lead large-scale data architecture projects, providing strategic direction and expert guidance. Partner with senior technology leaders to develop and implement modern data strategies. Design and deliver innovative solutions for data … architecture, strategy, and implementation. Strong expertise in cloud technologies (AWS, Azure, GCP) with relevant certifications highly desirable. In-depth knowledge of data modeling, data lake design, and metadata management tools. Proven ability to design secure, scalable, and cost-effective data solutions in cloud ecosystems. Experience in the financial services sector, with a More ❯

Senior Data Engineer Rate: up to £450/day Outside IR35 Contract Length: 6 Months (with likely extension) Location: Hybrid - 1 day per week onsite in Central London Working hours: 9am - 5pm - Monday - Friday An established international organisation is seeking a Senior Data Engineer to join their growing Data & Middleware function, driving innovation and … excellence across complex data ecosystems. This is a fantastic opportunity to shape the future of a large-scale data transformation programme, working on high-impact projects that enable data-driven decision-making. Responsibilities for the Senior Data Engineer: Design, build, and maintain scalable data pipelines and architectures, ensuring reliability, performance … efficiency, scalability, and cost optimisation Essential Skills for the Senior Data Engineer: Proficient with Databricks and Apache Spark, including performance tuning and advanced concepts such as Delta Lake and streaming Strong programming skills in Python with experience in software engineering principles, version control, unit testing and CI/CD pipelines Advanced knowledge of SQL and data More ❯

prejudice, racism, sexism, harassment, bullying and any other form of marginalisation in our workplaces. Role Summary The Azure Stack BI Developer will play a key role in managing data integrations between our business and our parent company, ensuring the accuracy, reliability, and high quality of data outputs. This role involves designing and developing ETL solutions, maintaining … our data architecture, and supporting critical business processes. The ideal candidate will have a strong technical background, as well as excellent communication skills to engage with both technical and non-technical stakeholders. Role Responsibilities Support and manage integrations between our company and the parent company, ensuring smooth data exchanges and process flows. Design and develop ETL … solutions that are robust, scalable, and efficient, focusing on accuracy and data consistency. Maintain and optimize existing data architecture, ensuring data integrity and performance are maintained to the highest standards. Validate and quality-check all outputs before delivering data to stakeholders, ensuring high levels of accuracy and reliability. Collaborate with both internal More ❯

prejudice, racism, sexism, harassment, bullying and any other form of marginalisation in our workplaces. Role Summary The Azure Stack BI Developer will play a key role in managing data integrations between our business and our parent company, ensuring the accuracy, reliability, and high quality of data outputs. This role involves designing and developing ETL solutions, maintaining … our data architecture, and supporting critical business processes. The ideal candidate will have a strong technical background, as well as excellent communication skills to engage with both technical and non-technical stakeholders. Role Responsibilities Support and manage integrations between our company and the parent company, ensuring smooth data exchanges and process flows. Design and develop ETL … solutions that are robust, scalable, and efficient, focusing on accuracy and data consistency. Maintain and optimize existing data architecture, ensuring data integrity and performance are maintained to the highest standards. Validate and quality-check all outputs before delivering data to stakeholders, ensuring high levels of accuracy and reliability. Collaborate with both internal More ❯

Senior Platform Engineer £500-£600 per day Outside IR35 6-months Join one of the UK's leading online retailers as they evolve their next-generation data platform. This is an opportunity to shape the backbone of a modern data ecosystem, empowering analysts, ML engineers, and data scientists to deliver smarter, faster insights at … scale. The Role You'll play a key role in designing and engineering platform services that treat data as a core product. This means building scalable, secure, and observable systems that help teams confidently leverage data across the business. You'll work closely with a wide range of technical and non-technical partners to deliver resilient … Nice to Have Experience rolling out data governance and observability frameworks, including lineage tracking, SLAs, and data quality monitoring. Familiarity with modern data lake table formats such as Delta Lake, Iceberg, or Hudi. Background in stream processing (Kafka, Flink, or similar ecosystems). Exposure to containerisation and orchestration technologies such as Docker More ❯

Business Product Owner, Data Analytics, Azure, Data Engineering, AI, ML, Azure, Mainly Remote Product Owner (Technical and Business) required to join a global Professional Services business based in Central London. However, this is practically a remote role, but when travel is required (to London, Europe and the States on occasions. We need someone who has worked … SIGNIFICANT products for large enterprise businesses. If you have come from the Big 4 on the Professional Services circuit, even better! The platform primarily serves two key personas: Data and Intelligence Delivery specialists, who manage data ingestion, transformation, and orchestration processes, and Assurance professionals, who use the analysers to enhance audit quality and client service. This … DATA HEAVY Product Owners who have managed complex, Global products. Read on for more details... Experience required: Technical proficiency: Familiarity with Azure services (e.g., Data Lake, Synapse, Fabric) and Databricks for data engineering, analytics, performance optimisation, and governance. Experience with implementing and optimising scalable cloud infrastructure is highly valued. Backlog management: Demonstrated expertise More ❯

Your Company: NET Recruit is assisting a distribution company in their search for an Apprentice Data Engineer based in the Kent area. Established over 40 years ago, this company has grown to become a leader in sourcing, producing, and distributing fresh produce to some of the UK’s top retailers. Known for its focus on quality, integrity, and … that its ongoing success depends on its people.As part of its ongoing investment in technology and digital innovation, the business is looking for an enthusiastic and motivated Apprentice Data Engineer to join its IT team, working five days per week. This position represents an exceptional opportunity for an individual with a passion for data, analytics, and … are actively encouraged. Your Role and Responsibilities While in this position your duties may include but are not limited to: Support the design, development, and maintenance of scalable data pipelines using tools such as Apache Airflow, dbt, or Azure Data Factory. Learn how to ingest, transform, and load data from a variety of sources More ❯

Platform Engineer - Data, Azure, AI, IaC, Terraform £Market Rate (Inside IR35) London/Hybrid 6 months We are currently working with a client who urgently require a Platform Engineer with strong knowledge of Data to play a pivotal role in designing and engineering a robust, scalable Data Platform, with a strong focus on Azure … Engineer, within large, complex organisations Focus on Azure-based Data Platforms Strong hands-on experience with Azure Data Factory (ADF), Azure AI, Data Lake, Cognitive Services and OpenAI Proven ability to deploy Azure services and Infrastructure as Code (IaC) Deep knowledge of Terraform, automation and Infrastructure as Code (IaC) Strong working knowledge of … communication skills and stakeholder engagement Nice to have: Immediate availability Background in Infrastructure to understanding concepts such as Networking, Firewalls and Security Previous experience of deploying Virtual Machines, Data Lakes, Data vaults Some exposure to GCP and it's AI capabilities Scripting knowledge of Powershell/Bash/Python Awareness of operational challenges If you're More ❯

Senior Business Analyst – Enterprise Data Transformation Location: London (Hybrid) | Type: 6-Month FTC | Salary: Market Related VIQU has partnered with a leading global organisation to recruit a Senior Business Analyst to support the delivery phase of a major multi-year Data Transformation Programme. The business is entering a crucial stage focused on delivering a new enterprise … data platform, making this an excellent opportunity to contribute to a large-scale initiative driving innovation and data-led decision-making across global operations. Key Responsibilities Lead business analysis for complex, global data transformation and technology programmes. Gather, document, and validate business, data, and functional requirements across multiple regions. Work closely with … finance and other business functions to understand data needs, processes, and integration points. Map, analyse, and streamline data workflows to improve quality, governance, and accessibility. Collaborate with technical teams to support data migration, integration, and reporting initiatives. Manage backlogs, change requests, and dependencies using structured governance frameworks. Support programme planning, reporting, and risk management More ❯

Lead Data Engineer (Azure Stack) £95k + 10% bonus Hybrid – 1 day a week Central London I’m helping a growing fintech find their next Lead Data Engineer, they are looking for someone who loves building modern data platforms in Azure and wants to make a genuine impact. This role offers the best of … help drive a modern, data-driven culture all within a collaborative environment that values innovation and ownership. Tech you’ll be working with: Azure Data Lake Azure Synapse Databricks Data Factory Python, SQL, PySpark Terraform, GitHub Actions, CI/CD pipelines You’ll thrive here if you: Have strong experience building and leading … Azure-based data platforms Enjoy mentoring and guiding other engineers Love designing scalable, automated data pipelines Bring a hands-on approach and enjoy problem-solving Want to shape data strategy in a growing fintech If you’re an experienced Azure Data Engineer who enjoys leading without losing your hands-on edge, then More ❯

Lead Data Engineer (Azure Stack) £95k + 10% bonus Hybrid – 1 day a week Central London I’m helping a growing fintech find their next Lead Data Engineer, they are looking for someone who loves building modern data platforms in Azure and wants to make a genuine impact. This role offers the best of … help drive a modern, data-driven culture all within a collaborative environment that values innovation and ownership. Tech you’ll be working with: Azure Data Lake Azure Synapse Databricks Data Factory Python, SQL, PySpark Terraform, GitHub Actions, CI/CD pipelines You’ll thrive here if you: Have strong experience building and leading … Azure-based data platforms Enjoy mentoring and guiding other engineers Love designing scalable, automated data pipelines Bring a hands-on approach and enjoy problem-solving Want to shape data strategy in a growing fintech If you’re an experienced Azure Data Engineer who enjoys leading without losing your hands-on edge, then More ❯

Lead Data Engineer (Azure Stack) £95k + 10% bonus Hybrid – 1 day a week Central London I’m helping a growing fintech find their next Lead Data Engineer, they are looking for someone who loves building modern data platforms in Azure and wants to make a genuine impact. This role offers the best of … help drive a modern, data-driven culture all within a collaborative environment that values innovation and ownership. Tech you’ll be working with: Azure Data Lake Azure Synapse Databricks Data Factory Python, SQL, PySpark Terraform, GitHub Actions, CI/CD pipelines You’ll thrive here if you: Have strong experience building and leading … Azure-based data platforms Enjoy mentoring and guiding other engineers Love designing scalable, automated data pipelines Bring a hands-on approach and enjoy problem-solving Want to shape data strategy in a growing fintech If you’re an experienced Azure Data Engineer who enjoys leading without losing your hands-on edge, then More ❯

Senior Data Engineer (GCP BigQuery Python SQL) London/WFH to £85k Are you a tech savvy Data Engineer with Google Cloud expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on Data Engineer role. … As a Senior Data Engineer you will design and build end-to-end real-time data pipelines using GCP services such as BigQuery, Dataflow and Dataproc, collaborating closely with clients to define business requirements, architect fit-for-purpose data solutions and support the migration of legacy on-premise systems to cloud-native architectures. You … ll collaborate directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the development of robust, well tested and fault tolerant data engineering solutions. Location/WFH: There's a hybrid work from home model with two days a week in the London, City office (or at client site in London). About you More ❯

Senior Data Engineer (GCP BigQuery Python SQL) London/WFH to £85k Are you a tech savvy Data Engineer with Google Cloud expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on Data Engineer role. … As a Senior Data Engineer you will design and build end-to-end real-time data pipelines using GCP services such as BigQuery, Dataflow and Dataproc, collaborating closely with clients to define business requirements, architect fit-for-purpose data solutions and support the migration of legacy on-premise systems to cloud-native architectures. You … ll collaborate directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the development of robust, well tested and fault tolerant data engineering solutions. Location/WFH: There's a hybrid work from home model with two days a week in the London, City office (or at client site in London). About you More ❯

Designing, developing, and maintaining high-performance, scalable, and secure backend services and APIs using technologies such as Python and NodeJS. Collaborating with science teams, full stack engineers, and data engineers to understand data requirements and integrate user needs into backend services. Building and maintaining RESTful APIs to surface data in the platform, ensuring it … is findable and accessible in line with FAIR principles. Developing APIs that support future interoperability and federation for pathogen diagnostics, epidemiology monitoring, and research. Working with data engineers to build pipelines and processes that store and transform platform data for easy consumption. Implementing and managing data storage solutions including data lakes, data … as object storage, Oracle Autonomous Database, and PostgreSQL. Supporting innovation efforts by exploring new technologies such as vector databases to enable search and AI use cases. Using big data technologies like Kafka, Iceberg, and Parquet, along with managed databases including PostgreSQL and Oracle vector databases. Operating, monitoring, and maintaining Oracle Cloud infrastructure to ensure backend services are highly More ❯

/Engineer Location: 3 Days p/w Central London Rate: £450 Outside IR35 Duration: 6 Months + Extensions This role is responsible for migrating and developing modern data and analytics solutions using Microsoft Fabric and Azure technologies. The position supports enterprise-wide BI initiatives, delivering data models, pipelines, dashboards and reporting assets that enable data-driven decision-making. Key Responsibilities Lead and implement data migration into Microsoft Fabric for analytics and reporting use cases Design and build data models from multiple sources to generate actionable insights Maintain and optimise data warehouse platforms; identify and resolve issues Develop data pipelines using Fabric Pipelines, Azure Data … Lakehouse and Warehouse environments Implement CI/CD processes using Azure DevOps for secure, reliable deployment Technical Skills: Strong expertise in: Power BI and paginated reporting SQL and data architecture Dimensional modelling (star schema, snowflake, denormalised structures, SCD handling) DAX, Visual Studio and data transformation logic Azure Fabric, Azure Data Factory, Synapse, Data More ❯

/Engineer Location: 3 Days p/w Central London Rate: £450 Outside IR35 Duration: 6 Months + Extensions This role is responsible for migrating and developing modern data and analytics solutions using Microsoft Fabric and Azure technologies. The position supports enterprise-wide BI initiatives, delivering data models, pipelines, dashboards and reporting assets that enable data-driven decision-making. Key Responsibilities Lead and implement data migration into Microsoft Fabric for analytics and reporting use cases Design and build data models from multiple sources to generate actionable insights Maintain and optimise data warehouse platforms; identify and resolve issues Develop data pipelines using Fabric Pipelines, Azure Data … Lakehouse and Warehouse environments Implement CI/CD processes using Azure DevOps for secure, reliable deployment Technical Skills: Strong expertise in: Power BI and paginated reporting SQL and data architecture Dimensional modelling (star schema, snowflake, denormalised structures, SCD handling) DAX, Visual Studio and data transformation logic Azure Fabric, Azure Data Factory, Synapse, Data More ❯

/Engineer Location: 3 Days p/w Central London Rate: £450 Outside IR35 Duration: 6 Months + Extensions This role is responsible for migrating and developing modern data and analytics solutions using Microsoft Fabric and Azure technologies. The position supports enterprise-wide BI initiatives, delivering data models, pipelines, dashboards and reporting assets that enable data-driven decision-making. Key Responsibilities Lead and implement data migration into Microsoft Fabric for analytics and reporting use cases Design and build data models from multiple sources to generate actionable insights Maintain and optimise data warehouse platforms; identify and resolve issues Develop data pipelines using Fabric Pipelines, Azure Data … Lakehouse and Warehouse environments Implement CI/CD processes using Azure DevOps for secure, reliable deployment Technical Skills: Strong expertise in: Power BI and paginated reporting SQL and data architecture Dimensional modelling (star schema, snowflake, denormalised structures, SCD handling) DAX, Visual Studio and data transformation logic Azure Fabric, Azure Data Factory, Synapse, Data More ❯

/Engineer Location: 3 Days p/w Central London Rate: £450 Outside IR35 Duration: 6 Months + Extensions This role is responsible for migrating and developing modern data and analytics solutions using Microsoft Fabric and Azure technologies. The position supports enterprise-wide BI initiatives, delivering data models, pipelines, dashboards and reporting assets that enable data-driven decision-making. Key Responsibilities Lead and implement data migration into Microsoft Fabric for analytics and reporting use cases Design and build data models from multiple sources to generate actionable insights Maintain and optimise data warehouse platforms; identify and resolve issues Develop data pipelines using Fabric Pipelines, Azure Data … Lakehouse and Warehouse environments Implement CI/CD processes using Azure DevOps for secure, reliable deployment Technical Skills: Strong expertise in: Power BI and paginated reporting SQL and data architecture Dimensional modelling (star schema, snowflake, denormalised structures, SCD handling) DAX, Visual Studio and data transformation logic Azure Fabric, Azure Data Factory, Synapse, Data More ❯