19 of 19 Data Lake Jobs in Central London

Main purpose of job: Responsible for facilitating the implementation of the data strategy, under the strategic direction of the Data Steering Group, through iterative technical delivery of a modern data platform solution that provides the business with the following: Improved data quality and consistency, More readily and reliably accessible MI, Enhanced data … contributing towards the design and building of a modern Data platform solution to handle large and complex data sets. Key tasks: Design Data Lake and Data Warehouse solutions Design Data Models using Data Vault and Dimensional modelling methods Implement automated, reusable and efficient batch data pipelines and streaming data pipelines Work closely with Governance and Quality teams to ensure metadata, catalogue, lineage and known solutions to data issues are optimised Work closely with other data specialists and technicians in the organisation, such as Actuarial and Finance, to help with their data presentation requirements and help More ❯

Main purpose of job: Responsible for facilitating the implementation of the data strategy, under the strategic direction of the Data Steering Group, through iterative technical delivery of a modern data platform solution that provides the business with the following: Improved data quality and consistency, More readily and reliably accessible MI, Enhanced data … contributing towards the design and building of a modern Data platform solution to handle large and complex data sets. Key tasks: Design Data Lake and Data Warehouse solutions Design Data Models using Data Vault and Dimensional modelling methods Implement automated, reusable and efficient batch data pipelines and streaming data pipelines Work closely with Governance and Quality teams to ensure metadata, catalogue, lineage and known solutions to data issues are optimised Work closely with other data specialists and technicians in the organisation, such as Actuarial and Finance, to help with their data presentation requirements and help More ❯

Data Architect (Azure solutions) Opportunity: Permanent Position Office Location: Central London (King’s Cross Station) Hybrid Model: 2 days per week in the office Industry: The Global Trading firm Role Summary: Lead enterprise data strategy and architecture. Own and manage an Enterprise data management - Azure-native data platform architecture, governance frameworks, and … drive AI/ML adoption across the business. The ideal candidate is an extensive hands-on architect with high-regulated data architect lifecycle experience covering data lakes, data warehouses, from concept to deployment and consumption. Must have hands-on HLD and LLD experience developing data modelling and core Azure native data … covering Data modelling (Conceptual, logical, and physical) A zure Expertise: Deep hands-on experience developing core Azure native data solutions: Synapse Analytics, Data Lake Gen2, Data Factory Databricks, CosmosDB, Microsoft Fabric Azure Purview for data governance Integration: Experience with MDM platforms (Profisee, Semarchy, CluedIn) To be considered, please ensure More ❯

Data Engineer (one day a week in the central London office) Sports Analytics This role is a unique opportunity for a Data Engineer to combine technical challenges with creativity in a collaborative, high-standard work environment. By joining this team, youll not only be part of a creative and open work culture focused on innovation and … it an ideal setting for those passionate about leveraging cutting-edge technology to make meaningful contributions in the world of sports analytics. Key responsibilities for the role of Data Engineer include: Design, construct, install, test, and maintain highly scalable data management systems. Ensure systems meet requirements and industry practices for data quality and integrity. … workflows with Composer or Vertex Pipelines. Data Architecture & Modelling: Ability to translate diverse business requirements into scalable data models and architect a data lake/lakehouse environment on GCP. Engineering Best Practices: Proficiency with Git, CI/CD for data systems, and robust testing methodologies. Highly desirable skills include: Domain Experience More ❯

Aker Systems was founded in 2017 by a team of experienced technology professionals who recognised an opportunity to provide highly secure enterprise data platforms to large organisations. Aker builds and operates ground-breaking, ultra-secure, high performance, cloud-based data infrastructure for the enterprise. Our proprietary technology solutions drive performance and reduce costs while helping our … clients to improve the management and sharing of data across their organisations. In 2022, Aker Systems was proud to win the Scale up Business of the Year award by the British Business Excellence Awards. In 2020 Aker Systems was recognised as a One to Watch on the Sunday Times Tech Track and was also recognised at the Thames … and cloud-native solutions. Data Platforms designing modern data platforms with appropriate architecture coving Data Mesh, Data Fabric, Data Lake etc. Data/Analytics - solving enterprise data and analytics problems using technology Cloud - hands-on Public Cloud experience in either AWS/Azure/Google More ❯

evolving Lloyds managing agent thats leading the way across multiple lines, including Property, Casualty, and Specialty. As part of a major transformation, theyre building a modern, business-driven data platform from the ground up and theyre looking for a Senior Data Engineer to help shape it. About the Business This Lloyds managing agent is authorised and … regulated by the PRA and FCA, managing a high-performing syndicate. They are known for underwriting excellence and are investing heavily in data and technology to support their long-term growth. Why this role? You'll play a key role in delivering a robust, scalable data platform that unlocks better MI, improves data quality … This is a genuinely exciting opportunity to influence the data direction of a Lloyds business, not just maintain it. Key responsibilities: Design and build Data Lake and Data Warehouse solutions Create scalable, automated batch and streaming data pipelines Optimise metadata, catalogue, lineage, and data quality processes Support business teams More ❯

Job Title: Data Engineer – Azure Location: City of London (Hybrid) Employment Type: Permanent, Full-Time Overview: We are currently hiring a Data Engineer to join a growing Data & Analytics team within a dynamic and forward-thinking organisation. This is a fantastic opportunity for a professional with a solid foundation in data engineering … who is looking to deepen their expertise in the Microsoft Azure ecosystem and work with emerging technologies like Microsoft Fabric. Key Responsibilities: Design, build, and maintain scalable data pipelines using Azure services Develop data models and perform ETL/ELT operations Collaborate with analysts, architects, and stakeholders to understand data requirements Implement and maintain … a Data Engineering or similar role Strong hands-on experience with Microsoft Azure services, including: Azure Data Factory Azure Synapse Analytics Azure Data Lake Storage Azure SQL Database Proficient in SQL and one programming language (Python or Scala) Good understanding of data modelling, data warehousing, and ETL/ELT More ❯

Job Title: Data Engineer – Azure Location: City of London (Hybrid) Employment Type: Permanent, Full-Time Overview: We are currently hiring a Data Engineer to join a growing Data & Analytics team within a dynamic and forward-thinking organisation. This is a fantastic opportunity for a professional with a solid foundation in data engineering … who is looking to deepen their expertise in the Microsoft Azure ecosystem and work with emerging technologies like Microsoft Fabric. Key Responsibilities: Design, build, and maintain scalable data pipelines using Azure services Develop data models and perform ETL/ELT operations Collaborate with analysts, architects, and stakeholders to understand data requirements Implement and maintain … a Data Engineering or similar role Strong hands-on experience with Microsoft Azure services, including: Azure Data Factory Azure Synapse Analytics Azure Data Lake Storage Azure SQL Database Proficient in SQL and one programming language (Python or Scala) Good understanding of data modelling, data warehousing, and ETL/ELT More ❯

remote Benefits: Healthcare and great holidays The Role As a Machine Learning Operations Engineer, you will be instrumental in designing, deploying, and maintaining machine learning systems that drive data-driven decision-making in the pensions and financial services sector. Using Azure's cloud ecosystem, you will build scalable ML workflows that support actuarial modelling, risk prediction, and client … regression, ensemble methods, survival models) to improve predictions and automate core processes. 2. MLOps & Model Lifecycle Management * Own the end-to-end ML lifecycle using Azure ML pipelines, Data Factory (ADF), and ML tracking tools. * Implement CI/CD pipelines with Azure DevOps, ensuring robust version control, testing, and seamless deployment. * Monitor production ML systems for performance, data … performance over time. 3. Data Engineering & Preprocessing * Develop and maintain scalable ETL/ELT data pipelines using Azure Data Factory, Data Lake, and SQL. * Prepare and preprocess large datasets to ensure data quality and readiness for ML modelling and analytics workflows. 4. Software Engineering & Collaboration * Write clean, maintainable, and More ❯

Data Solution Architect £100,000 - 125,000 GBP Hybrid WORKING Location: Central London, Greater London - United Kingdom Type: Permanent Role: Data Solution Architect Salary: £100,000 - £125,000 DOE Additional Package: 10% Bonus, Extensive Benefits Package Location: London (Hybrid) Are you a Data Solution Architect ready to shape enterprise-scale solutions in a cloud … first world? Join a high-performing architecture team that thrives on complex problem-solving, innovation, and delivering business-critical data platforms for globally recognised organisations. You'll be leading multi-disciplinary squads that include Data Engineers, BAs, and QA professionals - all within an agile, collaborative environment that values learning, diversity, and growth. This is a fantastic … opportunity for a Data Solution Architect who enjoys owning the technical vision, influencing stakeholder decisions, and setting architectural direction across a wide range of cloud-native data projects. If you're looking to make a tangible impact, take ownership of delivery, and work with cutting-edge tools and frameworks - this could be your ideal next move. More ❯

We are a Global Recruitment specialist that provides support to the clients across EMEA, APAC, US and Canada. We have an excellent job opportunity for you. Role Title: Data Engineer Location: London (Hybrid) Duration: Until 31/12/2025 Rate: £358 per day Inside IR35 (Umbrella) Role Description: To build and maintain the systems that collect, store … process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. Accountabilities: Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data. Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures. Skillset Required: Experience in Python, PySpark and SQL Experience with AWS is a plus Strong proficiency in Core Java, including Collections, Concurrency, and Memory Management. Proficient in version control systems such as Git, GitLab, or More ❯

We are a Global Recruitment specialist that provides support to the clients across EMEA, APAC, US and Canada. We have an excellent job opportunity for you. Role Title: Data Engineer Location: London (Hybrid) Duration: Until 31/12/2025 Rate: £358 per day Inside IR35 (Umbrella) Role Description: To build and maintain the systems that collect, store … process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. Accountabilities: Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data. Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures. Skillset Required: Experience in Python, PySpark and SQL Experience with AWS is a plus Strong proficiency in Core Java, including Collections, Concurrency, and Memory Management. Proficient in version control systems such as Git, GitLab, or More ❯

Lead AWS Data Engineer/Architect - Databricks - London I'm working with a globally renowned financial services client that are looking for a seasons Data professional. My client are seen as leaders and pioneers within their relative field but also, a very well known house hold name. They have operations in near enough every country and … best companies to work for along side many other outstanding accolades. This is a hands on technical role. The successful applicant will be building and maintaining AWS Data pipelines and infrastructure. This is while working with cross functional teams to design best in Class data solutions across the business. As a business, they are very mature … within their data services however, there is always room for improvements so we're looking for an expert to not look to be involved in new processes but equally, help to reverse engineer the existing platform to increase efficiency and performance. This is a salaried position paying up to £130k as a base salary. It's hybrid working More ❯

CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Summary: We are seeking a highly skilled and experienced AWS Lead Data Engineer, who will build, and lead the development of scalable data pipelines and platforms on AWS. The ideal candidate will have deep expertise in PySpark, Glue, Athena … Lead the design and implementation of scalable, secure, and high-performance data pipelines using PySpark and AWS Glue. • Architect and manage data lakes using AWS Lake Formation, ensuring proper access control and data governance. • Develop and optimize data models (dimensional and normalized) to support analytics and reporting. • Collaborate with analysts and … or Master’s degree in Computer Science, Engineering, or related field. • 10+ years of experience in data engineering. • Strong hands-on experience with AWS services: S3, Glue, Lake Formation, Athena, Redshift, Lambda, IAM, CloudWatch. • Proficiency in PySpark, Python, DBT, Airflow, Docker and SQL. • Deep understanding of data modeling techniques and best practices. • Experience with CI More ❯

CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Summary: We are seeking a highly skilled and experienced AWS Lead Data Engineer, who will build, and lead the development of scalable data pipelines and platforms on AWS. The ideal candidate will have deep expertise in PySpark, Glue, Athena … Lead the design and implementation of scalable, secure, and high-performance data pipelines using PySpark and AWS Glue. • Architect and manage data lakes using AWS Lake Formation, ensuring proper access control and data governance. • Develop and optimize data models (dimensional and normalized) to support analytics and reporting. • Collaborate with analysts and … or Master’s degree in Computer Science, Engineering, or related field. • 10+ years of experience in data engineering. • Strong hands-on experience with AWS services: S3, Glue, Lake Formation, Athena, Redshift, Lambda, IAM, CloudWatch. • Proficiency in PySpark, Python, DBT, Airflow, Docker and SQL. • Deep understanding of data modeling techniques and best practices. • Experience with CI More ❯

Senior Data Engineer is required to join a forward-thinking data team within a thriving city-based insurance group. This role will see you playing a critical role in delivering reliable, scalable and business-focused data solutions. With a strong focus on Microsoft technologies and cloud-based tools, you’ll work directly with key … drive performance and decision-making through data. The ideal candidate here will have a strong background in MI or reporting—experience within insurance is essential. Key Responsibilities Deliver data solutions and changes that support evolving business requirements. Build and maintain robust, scalable data pipelines using SQL and ETL best practices. Collaborate with stakeholders to analyse, define … and implement solutions to complex data challenges. Proactively assess the impact of changes on the broader data model and ensure integrity is maintained. Work alongside the MI/reporting team to ensure data is accurately reflected in dashboards and reporting tools. Consult with business analysts, system owners and architects to align technical delivery with More ❯

SQL, ETL, Azure Senior Data Engineer is required to join a forward-thinking data team within a thriving city-based insurance group. This role will see you playing a critical role in delivering reliable, scalable and business-focused data solutions. With a strong focus on Microsoft technologies and cloud-based tools, you’ll work … through data. The ideal candidate here will have a strong background in insurance MI or reporting—experience within an MGA or insurance carrier is essential. Key Responsibilities Deliver data solutions and changes that support evolving business requirements. Build and maintain robust, scalable data pipelines using SQL and ETL best practices. Collaborate with stakeholders to analyse, define … and implement solutions to complex data challenges. Proactively assess the impact of changes on the broader data model and ensure integrity is maintained. Work alongside the MI/reporting team to ensure data is accurately reflected in dashboards and reporting tools. Consult with business analysts, system owners and architects to align technical delivery with More ❯

point-to-site and site-to-site for high secure VPN connectivity from end user’s device and Sizewell C various offices and sites. Configuration of Data Lake storage, ensuring security hardening. Compliance of backup and restoration. Integration of IAAS, PAAS and SAAS application with Microsoft Entra ID (AAD) for secure access through SAML SSO. Maintain the More ❯

point-to-site and site-to-site for high secure VPN connectivity from end user’s device and Sizewell C various offices and sites. Configuration of Data Lake storage, ensuring security hardening. Compliance of backup and restoration. Integration of IAAS, PAAS and SAAS application with Microsoft Entra ID (AAD) for secure access through SAML SSO. Maintain the More ❯