1 to 25 of 65 Data Lake Jobs in London

pipelines and data integration workflows using Microsoft Azure services such as Data Factory, Synapse Analytics, Data Lake, Databricks, and related technologies. Implement and support Microsoft Fabric solutions, including dataflows, data warehouses, and real-time analytics features. Develop and maintain … EXPECTATIONS IN THE ROLE Strong hands-on experience with Microsoft Azure data services (Data Factory, Synapse Analytics, Data Lake, Databricks). Direct experience delivering solutions using Microsoft Fabric. Advanced SQL skills and experience with data modelling, transformation, and integration. Familiarity with ...

Role – Data Modelling Lead Technology – Snowflake, SQL Server, PostgreSQL, Data Warehousing, Data Lake, Medallion, Data Vault, Data Fabric, Semantic modelling Location – London, UK Job Description We are seeking an experienced Data Modeler who can analyze and understand … existing customer data and analytics models on SQL Server, and design efficient data models for Snowflake. This individual will work closely with multiple Business Analysts to gather requirements and translate them into optimized data structures, ensuring scalability and compliance with industry standards. A strong ...

IMMEDIATE JOINERS !! Junior Big Data Developer (Python & SQL Focus) We're looking for an enthusiastic and detail-oriented Junior Big Data Developer to join our data engineering team. This role is ideal for an early-career professional with foundational knowledge in data … distributed computing framework like Apache Spark (using PySpark). Familiarity with cloud data services (AWS S3/Redshift, Azure Data Lake/Synapse, or Google BigQuery/Cloud Storage). Exposure to workflow orchestration tools (Apache Airflow, Prefect, or Dagster). Bachelor's degree ...

analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect and deploy scalable data lake solutions using Azure Data Lake Storage . Implement governance and security measures across the platform. Leverage Terraform or similar IaC tools … Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations and CI/CD pipelines for Databricks deployments. Monitoring & Operations Implement monitoring solutions using Azure ...

analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect and deploy scalable data lake solutions using Azure Data Lake Storage. Implement governance and security measures across the platform. Leverage Terraform or similar IaC tools … Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations and CI/CD pipelines for Databricks deployments. Monitoring & Operations Implement monitoring solutions using Azure ...

Data Engineer Manager Hybrid - London with 2/3 days WFH Circ £85,000 - £95,000 + Attractive Bonus & Benefits Hands On Data Engineer Manager required for this exciting newly created position with a prestigious and rapidly expanding business in West London. It would suit someone … with official management experience, or potentially a Lead/Senior Engineer looking to take on more managerial responsibility. The Data Engineer Manager will play a pivotal role at the heart of our client's data & analytics operation. Having implemented a new MS Fabric based Data ...

Data Engineer £Up to £75,000 GBP Hybrid WORKING Location: London, Central London, Greater London - United Kingdom Type: Permanent Join a highly regarded digital, data, and technology consultancy recognised for delivering large-scale, high-impact data platforms across public sector, defence, and commercial environments. … Java, or Scala) Extensive experience with cloud platforms such as AWS, Azure, or GCP Experience with data warehousing and data lake architectures Proven ETL/ELT pipeline development experience Strong SQL and familiarity with NoSQL databases Experience with distributed computing frameworks (Spark, Kinesis, or similar ...

/ELT pipelines using Azure Databricks, PySpark, and Delta Lake. Build and optimise data lakehouse architectures on Azure Data Lake Storage ( ADLS ) . Develop high-performance data solutions using Azure Synapse, Azure Data Factory, and Databricks workflows Implement best practices … Required Skills & Experience 3+ years' experience as a Data Engineer working in Azure environments. Strong hands-on experience with Databricks (PySpark, Delta Lake, cluster optimisation, job scheduling). Solid knowledge of Azure cloud services including: Azure Data Lake Storage Azure Data Factory ...

Services AI Data Solution Principal (Services Technical PreSales), based London Job Summary: The Services AI Data Solutions Principal is a customer-facing, technical presales leader responsible for driving Dell Technologies' AI and Data Services revenue across a wide portfolio of enterprise customers and industries. … This role requires strong technical expertise in AI and associated Data engineering and Data management disciplines, strong consultative selling skills, executive-level communications, and business development acumen. The candidate will jointly lead and influence customers from initial opportunity discovery through proposal development and deal closure while ...

Services AI Data Solution Principal (Services Technical PreSales), based London Job Summary: The Services AI Data Solutions Principal is a customer-facing, technical presales leader responsible for driving Dell Technologies’ AI and Data Services revenue across a wide portfolio of enterprise customers and industries. … This role requires strong technical expertise in AI and associated Data engineering and Data management disciplines, strong consultative selling skills, executive-level communications, and business development acumen. The candidate will jointly lead and influence customers from initial opportunity discovery through proposal development and deal closure while ...

Services AI Data Solution Principal (Services Technical PreSales), based London Job Summary: The Services AI Data Solutions Principal is a customer-facing, technical presales leader responsible for driving Dell Technologies' AI and Data Services revenue across a wide portfolio of enterprise customers and industries. … This role requires strong technical expertise in AI and associated Data engineering and Data management disciplines, strong consultative selling skills, executive-level communications, and business development acumen. The candidate will jointly lead and influence customers from initial opportunity discovery through proposal development and deal closure while ...

Services AI Data Solution Principal (Services Technical PreSales), based London Job Summary: The Services AI Data Solutions Principal is a customer-facing, technical presales leader responsible for driving Dell Technologies' AI and Data Services revenue across a wide portfolio of enterprise customers and industries. … This role requires strong technical expertise in AI and associated Data engineering and Data management disciplines, strong consultative selling skills, executive-level communications, and business development acumen. The candidate will jointly lead and influence customers from initial opportunity discovery through proposal development and deal closure while ...

Senior Data Engineer Rate - up to £450/day Outside IR35 Location - 2 days a week onsite in Central London Duration - 6 Months + Likely Extension We are working with a well-established consultancy supporting a high-impact data transformation programme for an end client based … Synapse Analytics. Optimise ETL/ELT processes to improve performance, reliability and efficiency. Integrate multiple data sources including Azure Data Lake (Gen2), SQL-based systems and APIs. Collaborate with Data Architects, Analysts, and stakeholders to define data models and ensure best ...

Details Role/Job Title: MLOps Tech Lead Work Location: London, UK Office Requirement (Hybrid): 2 days per week Key Responsibilities (High-Level) Data Pipeline Development: Lead the technical direction of projects and ensure the use of Sainsbury's best practices to the best quality. Data Integration: Lead and provide expertise on Integrate data from various sources, ensuring data consistency, integrity, and quality across the entire data lifecycle. Infrastructure Management: Provide guidance for the junior & Mid Data Engineers on the best practices when building and managing ...

Data Engineer – Modern Data & AI Platforms London (Hybrid 2 days) | Contract/Permanent | 🌍 Global Consulting Environment Build the data foundations behind AI, automation, and real-world impact. We’re hiring a Data Engineer to join a fast-growing digital and data … operating across energy, manufacturing, chemicals, infrastructure, automotive, and commodities. This is a hands-on engineering role where you’ll design and run the data systems that power analytics, automation, and AI-driven solutions — working alongside consultants, analysts, and data scientists in a true delivery-focused environment. ...

About The Role Team – Data Engineering Working Pattern - Hybrid – 2 days per week in the Vitality Bournemouth or London Office. Full time, 37.5 hours per week. We are happy to discuss flexible working! Top 3 skills needed for this role: Designing and delivering scalable data pipelines … with SQL Deploying and maintaining machine learning models as APIs in production environments What this role is all about: Join us as a Data Engineer and help build the data foundations that power machine learning and analytics across Vitality. You’ll work with rich datasets ...

doing: Design, build, and optimise scalable data pipelines and architecture Work hands-on with SQL, PySpark, Databricks, Azure, and Data Lake to deliver high-performance solutions Translate business needs into technical requirements and data-driven solutions Ensure best practice in data … Engineer or Senior Data Engineer with some team leadership responsibilities Strong technical expertise with PySpark, Databricks, Azure, and Data Lake Deep understanding of data architecture and ETL processes in cloud environments The ability to balance coding and technical delivery with people management ...

Data Architect - Fully Remote role Data Architect sought by a well-established Data & Analytics consultancy. Our client is seeking a cloud professional to spearhead strategic leadership and technical expertise within their data solutions landscape, focussed on cloud data platforms … data pipeline design, with a technology-agnostic approach. A solid understanding of data warehouse and data lake principles. Expert SQL skills and demonstrable data modelling capabilities. About the Company: Our client is a well-established organisation in their field, known ...

About the Opportunity This is a unique opportunity for a Data Engineer to work at the intersection of cutting-edge technology and elite sports performance. You’ll join a collaborative, high-standard engineering team with a culture built around creativity, innovation, and excellence. In this role … scientists to enable end-to-end data workflows Own the architecture and maintenance of a GCP-based data lake/lakehouse environment Your Background 4+ years of industry experience in Data Engineering roles Advanced-level Python for data applications ...

pension + private health + 25 h Career Progression: Next step £50k £60k + package) Closing Date: 21 January Are you a Data Analyst or Data Coordinator with experience in Asset Information, BIM, or infrastructure environments with strong stakeholder management skills? Do you have a strong … grounding in data quality and data management principles, and enjoy working with a wide range of stakeholders to improve the quality of information being delivered? We re looking for an Asset Information Analyst to join the Asset Information Team on the High Speed Two (HS2) programme ...

About the role We are looking for an experienced Data Product Solution Architect to drive the architecture, design, and delivery of scalable, secure, and high-performing data products. This role acts as a strategic bridge between data engineering, analytics, product management, and business stakeholders … define and implement data product solutions that are technically sound and aligned with business goals. The ideal candidate is both technically hands-on and strategically minded, capable of translating complex data requirements into scalable product architectures and enabling the delivery of data products that ...

England. Through resolving disputes effectively and promoting positive change across the social housing sector, we improve residents’ lives and landlords’ services. Digital, Data & Technology at The Housing Ombudsman Service is on an exciting journey, laying the foundations for a digital transformation that will enhance how we deliver fairness … secure, efficient, and scalable access to information. Reporting to the ICT Solutions Manager, you will lead the creation of a centralised data lake to optimise Power BI enquiries and design a SharePoint file management structure that aligns with organisational needs. You will work closely with colleagues ...

Title: Senior Systems Developer DETAILS We are seeking a highly skilled Senior Systems Developer with extensive experience in data architecture, system design, and enterprise-level application development. The successful candidate will be responsible for constructing scalable systems, designing robust data models, and guiding the technical direction … backend and data-driven solutions across the organisation. DUTIES & RESPONSIBILITIES · Design, develop, and maintain sophisticated backend systems, APIs, and services. · Lead architectural decisions to ensure systems are scalable, secure, and high-performing. · Implement best practices for software engineering, and cloud-native development. · Collaborate with cross-functional teams (Data ...

Role Overview We are looking for a Finance-specialised Data Business Analyst to support FP&A transformation and finance data projects. This role combines financial reporting understanding with strong business analysis skills to deliver accurate, insightful data solutions across the Finance/… deliverables. Act as the liaison between finance teams, data engineers, and technology teams. Conduct GAP analysis between current state Data Lake & desired future state Coordinate UAT & ensure compliance with FP&A controls. Manage expectations and provide regular updates on progress and risks. Support creation ...

Lead Data Engineer - Hybrid - London - Azure - Databricks - £85k + Bonus I'm working with a global powerhouse that's been setting the standard for excellence for over 60 years. With more than 1,000 projects delivered worldwide and a combined value exceeding $150 billion, they've earned … Work With Lead the architecture, design, and delivery of Azure Data Services solutions (Data Factory, Data Lake, Azure SQL) Provide technical leadership in Agile delivery teams, mentoring engineers and influencing architectural decisions Design and implement scalable Azure-based data solutions ...