1 to 25 of 60 Data Lake Jobs in Central London

Head of Data – Data Architecture, Data Strategy/Governance, Data Science/Analysis/Engineering; frameworks, data operating model (TOM), compliance, risk, automation; management information (MI) reporting, PowerBI, SQL, ADF, Azure Data Warehousing/Data Lakes. Permanent, London/Hybrid (3/2) c.£150k (Negotiable … +Bonus +Benefits Global organisation seeks Head of Data to lead strategy around data architecture, data governance, platform enhancement and MI reporting development across all systems which support business decisions and improve operations. Working in a senior level capacity, initially within an individual contributors role (initially) the Head of Data will undertake a … number of strategic and tactical duties including: Developing data initiatives in line with wider business strategy Engage with senior business leaders and technology management to design a Target Data Operating Model Develop the firms AI/NLP strategy, roadmap and capability utilising emerging data science approaches where applicable Optimise existing technology to support/ More ❯

Enterprise Data Architect/Senior Solution Data Architect/Head of Data Architecture Data is responsible for shaping, governing, and enabling data-centric solution design across the clients global technology landscape. The role ensures that all data and analytics solutions align to enterprise architecture principles, support the North … and governed data. Working across programmes such as UNIFY (SAP S/4HANA), Integrated Supply Chain (Blue Yonder), and Sales Excellence (Salesforce CGC), the role bridges business strategy, data architecture, and solution delivery to ensure a unified enterprise data fabric and analytics capability. Key Accountability's Solution Leadership Lead end-to-end data solution … of data modelling, data integration, metadata management, and data governance. Experience with modern data platforms such as Azure Data Lake, Databricks, Power BI, and SAP BTP. Solid grasp of enterprise integration patterns (APIs, streaming, ETL/ELT, event-driven architectures). Ability to translate complex data concepts More ❯

support EQ's transition into a stronger, more profitable, product-led business, driven by real insights and the needs of its customers. We are looking for a skilled Data Engineer to join our Data team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines … cloud-based data pipelines and architectures Strong expertise in Microsoft Fabric and Databricks, including data pipeline development, data warehousing, and data lake management Proficiency in Python, SQL, Scala, or Java Experience with data processing frameworks such as Apache Spark, Apache Beam, or Azure Data Factory Strong understanding … Azure and or AWS Strong collaboration and communication skills, with the ability to work effectively with cross-functional teams Desirable: Experience with Azure Synapse Analytics, Azure Data Lake Storage, or other Azure data services Experience with agile development methodologies and version control systems such as Git Certification in Microsoft Azure, Databricks, or other relevant technologies More ❯

Role – Technology Lead Technology – Snowflake, SQL Server, PostgreSQL, Data Warehousing, Data Lake, Medallion, Data Vault, Data Fabric, Semantic modelling Location – UK Business Unit – DNAINS Compensation – Competitive (including bonus) Job Description We are seeking an experienced Data Modeler who can analyse and understand the existing customer data and … analytics models on SQL Server, and design efficient data models for Snowflake. This individual will work closely with multiple Business Analysts to gather requirements and translate them into optimized data structures, ensuring scalability and compliance with industry standards. A strong understanding of Insurance domain concepts—including Specialized Insurance, London Market, and Regulatory Data—is … essential for success in this role. Your role In the role of a Data Modelling Lead, you will be responsible for leading the design and transformation of enterprise data models to support scalable, high-performance analytics and reporting solutions. You will analyse existing data models built on SQL Server and guide the development of More ❯

Location - London, Bristol or Manchester (1 day a month onsite) Duration - 6 months Rate - £550 - £600pd (inside ir35) As a Data Engineer in the Cyber and Domains Protection Team you will: Work within an Agile team to support the development of dashboards and build automated reports to meet the needs of technical and non-technical users Work with … the data analyst and user researcher to update relevant data models to allow business intelligence data to meet the organisation's specific needs Develop business intelligence reports that can be automated, reused and shared with users directly Implement data flows to connect operational systems, data for analytics and business intelligence … like PostgreSQL, MySQL, or similar Cloud data ecosystem (AWS) : hands-on experience with core AWS data services. Key services include: S3 for data lake storage AWS Glue for ETL and data cataloging Amazon Redshift or Athena for data warehousing and analytics Lambda for event-driven data processing. More ❯

Principal Data Architect (MDM) - Inside IR35 Contract Hybrid/Remote Working Day Rate up to £500 p/d with some flexibility We are seeking an experienced Data Architect to lead the design, implementation, and governance of enterprise data solutions. This role will emphasize operational data use cases — designing data … day-to-day business operations, core applications, and real-time services — while also ensuring robust analytical and reporting capabilities. The ideal candidate will have to be a senior data leader with proven experience in engaging senior data/business/IT stakeholders, strong background in enterprise architecture, data strategy, and cloud technologies, with the … ability to align both operational and analytical data initiatives with business objectives. Key responsibilities Define and implement enterprise data architecture, ensuring alignment with both operational and analytical business needs. Lead domain-driven data modeling efforts across conceptual, logical, and physical layers to ensure data designs reflect business domains and processes. Define and More ❯

supporting platform for front-office developers (quants and strategists) in a unique hands-on opportunity within a focused, high-impact team. You’ll be at the forefront of data and cloud-native engineering, working with modern technologies across AWS, On-premise kubernetes, Python, and data pipelines, while engaging directly with key internal platforms and front-office … problems, staying current with trends like AI Engineering, and want to make a difference in a globally respected financial institution, this role is for you. The successful AWS Data Engineer candidate will have the chance to make a significant impact in designing the platform and working on cutting-edge technologies like Databricks and Snowflake in the heart of … overview of many different sectors. What We’re Looking For 5 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best practices for data More ❯

strategists). This is a unique opportunity to remain hands-on in engineering while also leading a focused, high-impact team. You’ll be at the forefront of data and cloud-native engineering, working with modern technologies across AWS, On-premise kubernetes, Python, and data pipelines, while engaging directly with key internal platforms and front-office … staying current with trends like AI Engineering, and want to make a difference in a globally respected financial institution, this role is for you. The successful Senior AWS Data Engineer candidate will have the chance to make a significant impact in designing the platform and working on cutting-edge technologies like Databricks and Snowflake in the heart of … overview of many different sectors. What We’re Looking For 10 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best practices for data More ❯

in the digital lifecycle and helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited opportunities digital offers. Our reputation … standards. Key Responsibilities Architect and design end-to-end Azure data platforms , including ingestion, storage, transformation, analytics, and visualization layers. Build solutions leveraging Azure Data Lake, Synapse Analytics, Data Factory, Databricks, Event Hubs, Stream Analytics, Power BI , and related services. Translate complex business requirements into scalable, cost-efficient, and maintainable Azure data … Solution Architect or Data Platform Architect with a primary focus on Azure . Hands-on expertise with Azure Data Factory, Synapse Analytics, Data Lake Storage (Gen2), Databricks, Power BI, Event Hubs, and Functions . Strong background in data modeling, data warehousing, and real-time/batch data More ❯

wants technical leadership, architectural influence, and the chance to shape a modern cloud-based data platform built on Azure Data Factory, Synapse, Data Lake, and Microsoft Fabric. The Role As Senior Data Engineer, you will: Lead the design, build, and optimisation of Azure Data Factory (ADF) ETL pipelines . … performance-optimised SQL workloads. Own and enhance Power BI datasets, semantic models, and reporting standards (major focus). Shape cloud data architecture across Azure Data Lake and Synapse environments. Play a key role in the organisations transition to Microsoft Fabric . Implement robust data quality, validation, and monitoring frameworks . Work closely with … pipelines, automation, optimisation). Strong Azure Synapse experience: warehousing, SQL pools, query tuning, stored procedures. Deep proficiency in SQL development and optimisation. Solid understanding of Azure Data Lake and cloud storage layers. Proven track record delivering Azure-based data engineering solutions. Strong communication and stakeholder engagement. Demonstrated mentoring or technical leadership experience. Desirable: Exposure to More ❯

Senior Databricks Data Engineer 2-3 days on-site - central London up to £75k + 20% Bonus + Excellent Benefits Our client is a leading global Retail/FMCG brand undergoing an exciting period of rapid growth and transformation. With significant investment in data and technology, they are building a world-class data platform … platforms, Lakehouse architecture, and data engineering frameworks. Required Qualifications 6+ years of experience in data engineering 3+ years of hands-on experience with Databricks, Delta Lake, and Spark (PySpark preferred). Proven track record implementing Medallion Architecture (Bronze, Silver, Gold layers) in production environments. Strong knowledge of data modeling, ETL/ELT design … and data lakehouse concepts. Proficiency in Python, SQL, and Spark optimization techniques. Experience working with cloud data platforms such as Azure Data Lake, AWS S3, or GCP BigQuery. Strong understanding of data quality frameworks, testing, and CI/CD pipelines for data workflows. Excellent communication skills and ability to More ❯

An opportunity has arisen for a Senior Data Engineer to join a well-established biotech company using large-scale genetic data and AI to predict disease risk and advance precision healthcare. As a Senior Data Engineer , you will be responsible for developing, automating, and optimising scalable data pipelines using modern cloud technologies. … with hybrid/remote working options offering a salary of £500 - £650 per day (Inside IR35) and benefits. You Will Be Responsible For: Designing and implementing cloud-based data architectures using Azure services. Building robust and scalable data pipelines to support complex, high-volume processing. Deploying and managing containerised workloads through Kubernetes, Helm, and Docker. Automating … Code tools (Terraform, Ansible). Hands-on experience with PostgreSQL and familiarity with lakehouse technologies (e.g. Apache Parquet, Delta Tables). Exposure to Spark, Databricks, and data lake/lakehouse environments. Understanding of Agile development methods, CI/CD pipelines, GitHub, and automated testing. Practical experience monitoring live services using tools such as Grafana, Prometheus, or New More ❯

An opportunity has arisen for a Senior Data Engineer to join a well-established biotech company using large-scale genetic data and AI to predict disease risk and advance precision healthcare. As a Senior Data Engineer , you will be responsible for developing, automating, and optimising scalable data pipelines using modern cloud technologies. … with hybrid/remote working options offering a salary of £500 - £650 per day (Inside IR35) and benefits. You Will Be Responsible For: Designing and implementing cloud-based data architectures using Azure services. Building robust and scalable data pipelines to support complex, high-volume processing. Deploying and managing containerised workloads through Kubernetes, Helm, and Docker. Automating … Code tools (Terraform, Ansible). Hands-on experience with PostgreSQL and familiarity with lakehouse technologies (e.g. Apache Parquet, Delta Tables). Exposure to Spark, Databricks, and data lake/lakehouse environments. Understanding of Agile development methods, CI/CD pipelines, GitHub, and automated testing. Practical experience monitoring live services using tools such as Grafana, Prometheus, or New More ❯

Senior Data Engineer Job Type : Permanent Location: Hub Location (London/Reading/Birmingham/Glasgow/Leeds) Salary: £60,000 - £70,0000 Consultant: Mags Rendle Excellent career opportunity! The Organisation TDRC are excited to be once again working with one of the UK’s leading Wealth Management firms. Through their robust infrastructure, cutting edge technology, and exceptional … datasets and semantic models, ensuring best practice in DAX, performance tuning, and report design. Lead the development of data architecture and standards across Azure Data Lake and Synapse environments. Contribute to the migration to Microsoft Fabric, shaping platform architecture and integration patterns. Implement and maintain data validation, monitoring, and quality frameworks. Work collaboratively … tuning. Power BI: Advanced experience managing enterprise models, datasets, and governance processes. SQL: Expert-level proficiency in query design, optimisation, and data transformation. Azure Data Lake: Deep understanding of data structures, storage layers, and integration for analytics. Microsoft Fabric (Emerging): Contribute to the organisation’s transition and adoption strategy. Git/Azure DevOps More ❯

Data Engineer – Python | SQL | Azure | Microsoft Fabric Location: London Salary: £90,000 + benefits Financial Services Are you a skilled Data Engineer with strong coding expertise and a passion for building scalable data solutions? We’re looking for a talented professional to join our team and play a key role in designing, developing, and … optimising modern data platforms on Azure Cloud — with a focus on an exciting Microsoft Fabric implementation. What you’ll do Design and build robust data pipelines and ETL processes using Python and SQL. Contribute … to the rollout and optimisation of Microsoft Fabric, shaping the next-generation data platform. Work across Azure services (Data Factory, Synapse, Databricks, Data Lake, Functions) to deliver secure and scalable data solutions. Optimise data workflows for performance, reliability, and cost efficiency. Collaborate with analysts, data scientists, and More ❯

Senior Data Architect - London - Hybrid - £100,000 - £110,000 My client is an agile, data-driven company who are continuing to expand their thriving data team. They are looking to hire a senior data architect with expert data modelling and technical experience across the full Azure data stack … Flexible working hours 26 days annual leave, plus bank holidays Private medical insurance Company pension scheme And many more Key Responsibilities Design and implement scalable database solutions and data models that enable efficient data storage, integration, and retrieval. Review and optimise database implementation processes to ensure compliance with GDPR and wider data governance standards. … Develop conceptual and logical data models, diagrams, and flowcharts to support solution design. Ensure all systems are aligned with established data architecture principles and best practices. Maintain a comprehensive understanding of the data platform landscape, ensuring risks are identified, documented, and managed. Deliver high-quality, consistent, and well-documented outputs across all phases of More ❯

Data Engineer Job Type : Permanent Location: Hub Location (London/Reading/Birmingham/Leeds/Glasgow) Hours of work: Full time (35 hours) with 3 days per week in the office Salary: £50,000 - £55,0000 Consultant: Mags Rendle Excellent career opportunity! The Organisation TDRC are excited to be once again working with one of the UK … are delivering an excellent and reliable service to their continuously expanding client base. They are providing the utmost level of quality and security in everything they do. The Data Engineer will play a key role in developing and maintaining Power BI reports and dashboards to support the business’s operational MI, while contributing to broader data … maintaining ETL pipelines. Azure Synapse Analytics: Working knowledge of data modelling, views, and performance tuning. SQL: Proficient in writing, optimising, and troubleshooting queries. Azure Data Lake: Understanding of data storage and structure for analytics use cases. Git/Azure DevOps: Familiar with version control and Agile delivery workflows. Microsoft Fabric (Desirable): Awareness or More ❯

About the Opportunity This is a unique opportunity for a Data Engineer to work at the intersection of cutting-edge technology and elite sports performance. You’ll join a collaborative, high-standard engineering team with a culture built around creativity, innovation, and excellence. In this role, you’ll play a key part in designing and developing scalable data … football world—including performance insights for some of the most well-known footballers in the industry . This is the perfect environment for those passionate about leveraging advanced data engineering to drive real-world results in sports analytics. Key Responsibilities Architect, design, build, test, and maintain scalable and high-performance data pipelines Ensure all systems adhere … predictive insights Collaborate with data scientists to enable end-to-end data workflows Own the architecture and maintenance of a GCP-based data lake/lakehouse environment Your Background 4+ years of industry experience in Data Engineering roles Advanced-level Python for data applications and high proficiency in SQL More ❯

Role – Sr. Technology Architect Technology – Data Modelling, ERWIN Modelling, Azure Architect, PySpark Location – UK(London) Job Description Data Architect should have key understanding of building Data Models, Experience in Data Architecting and Engineering space on Spark, Pyspark, ADF, Azure Synapse and Data Lake. Your role In the role of a … building. You will have the opportunity to shape value-adding solutions that enable our clients to meet the changing needs of the global landscape. Responsibilities Define the overall data architecture strategy aligned with business transformation goals · Design scalable, secure, and integrated data models/assets · Define and build Data Modelling and architecture Framework. · Ensure … Experience on ERWIN Modelling. • Hands on experience in ADF, Azure Databricks, Azure Synapse, Spark, PySpark, Python/Scala, SQL. • Hands on Experience in Designing and building Data Lake from Multiple Source systems/Data Providers. • Experience on Data Modelling, architecture, implementation & Testing. • Experienced in designing & implementation of End-to-End Data More ❯

Role – Sr. Technology Architect Technology – Data Modelling, ERWIN Modelling, Azure Architect, PySpark Location – UK(London) Job Description Data Architect should have key understanding of building Data Models, Experience in Data Architecting and Engineering space on Spark, Pyspark, ADF, Azure Synapse and Data Lake. Your role In the role of a … You will have the opportunity to shape value-adding solutions that enable our clients to meet the changing needs of the global landscape. Responsibilities . Define the overall data architecture strategy aligned with business transformation goals Design scalable, secure, and integrated data models/assets Define and build Data Modelling and architecture Framework. Ensure … Modelling. 7+ years of hands-on experience in ADF, Azure Databricks, Azure Synapse, Spark, PySpark, Python/Scala, SQL. Hands on Experience in Designing and building Data Lake from Multiple Source systems/Data Providers. Experience on Data Modelling, architecture, implementation & Testing. Experienced in designing & implementation of End-to-End Data More ❯

Microsoft Fabric Consultant Location: London/Hybrid Job Type: Salary: £65,000 to £75,000 + 10% Bonus, Pension, 25 days holiday, health + other benefits Microsoft Fabric | Data Modelling | Azure | Power BI Overview: A leading Data & Analytics consultancy is seeking a Microsoft Fabric Consultant to join their growing team. This is a hands-on role … focused on designing and delivering enterprise-grade solutions using Microsoft Fabric technologies. You’ll work closely with clients and internal teams to build scalable data pipelines, semantic models, and visualizations that support advanced analytics and business intelligence. This is an opportunity for you to own the new fabric division which will be focusing on clients who are going … Microsoft Fabric (Data Factory, Lakehouse, Power BI) Strong proficiency in SQL, DAX, and Power Query (M) Experience with Azure Data Services (Synapse, Data Lake, Azure SQL) Solid understanding of data modelling, ETL processes, and BI architecture Familiarity with CI/CD pipelines, DevOps, and version control (Git) Excellent communication and stakeholder More ❯

Aker Systems was founded in 2017 by a team of experienced technology professionals who recognised an opportunity to provide highly secure enterprise data platforms to large organisations. Aker builds and operates ground-breaking, ultra-secure, high performance, cloud-based data infrastructure for the enterprise. Our proprietary technology solutions drive performance and reduce costs while helping our … clients to improve the management and sharing of data across their organisations. In 2022, Aker Systems was proud to win the Scale up Business of the Year award by the British Business Excellence Awards. In 2020 Aker Systems was recognised as a One to Watch on the Sunday Times Tech Track and was also recognised at the Thames … and cloud-native solutions. Data Platforms designing modern data platforms with appropriate architecture coving Data Mesh, Data Fabric, Data Lake etc. Data/Analytics - solving enterprise data and analytics problems using technology Cloud - hands-on Public Cloud experience in either AWS/Azure/Google More ❯

Remote Data Architect sought by a well-established company in their industry; our client is seeking an adept professional to spearhead strategic leadership and technical expertise within their data solutions landscape, focussed on cloud data platforms, but including IoT analytics, data integration, and migration projects. This unique opportunity is offered on a … remote-first basis, but with an open invitation to their headquarters any time. Role Responsibilities: The Data Architect will be pivotal in shaping the approach to designing and developing data solutions using cloud technologies such as AWS and Azure. This position involves: - Leading the design and implementation of innovative cloud data platforms. - Setting standards … business intelligence roles. - Proficiency in ETL and data pipeline design, with a technology-agnostic approach. - A solid understanding of data warehouse and data lake principles. - Expert SQL skills and demonstrable data modelling capabilities. About the Company: Our client is a well-established organisation in their field, known for innovation and excellence. More ❯

Data Architect – London, Hybrid Role Overview: Pinnova Talent is proud to partner with a leading financial services organisation to recruit a forward-thinking Data Architect. This is a strategic role focused on shaping enterprise-wide data architecture, with a strong emphasis on governance, compliance, and cloud-native transformation. You’ll lead the design and … implementation of scalable data frameworks across structured and unstructured content, enabling smarter decision-making, regulatory alignment, and digital innovation. The ideal candidate combines technical depth with strong stakeholder engagement and a passion for building future-ready data ecosystems. Key Responsibilities: Strategy & Architecture - Develop and implement enterprise-wide data governance frameworks, including ownership models, metadata … strategy, and lifecycle policies Define retention, access, and usage standards across data domains Translate business needs into scalable data architecture across data lakes, warehouses, and content platforms Governance & Leadership Establish and chair a cross-functional Data Governance Council Collaborate with data owners, stewards, and custodians to embed governance across departments More ❯

Admin Location: Stratford, UK Job Type: Contract Work Mode: Hybrid (3 days onsite a week) Cloudera Admin: Design and automate the deployment of Cloudera CDP components (Data Lake, Data Hubs, Data Services) using Terraform. Build and maintain CI/CD pipelines using GitHub Actions for infrastructure and data pipeline automation Collaborate … with data engineering teams to integrate CDP with existing Big Data workflows. Write and maintain automation scripts using Shell and Python. Manage infrastructure and configuration using YAML and JSON. Configuring and tuning Cloudera services for performance and security. Ensure secure, scalable, and cost-effective deployments on cloud platforms (AWS, Azure, or GCP). An understanding of … in the cluster. Employ security using an authentication and authorization system such as Kerberos. Knowledge of changes required for migrating to Cloudera cloud version CDP Knowledge of Cloudera data services (CDW, CDE, CDF, CAI) Design Native Cloud Application Architectures and optimize applications for AWS Network connectivity, Direct Connect, VPN, VPC, Security group, NACL, Route 53 Must have in More ❯