15 of 15 Data Lake Jobs in Central London

analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect and deploy scalable data lake solutions using Azure Data Lake Storage . Implement governance and security measures across the platform. Leverage Terraform or similar IaC tools … Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations and CI/CD pipelines for Databricks deployments. Monitoring & Operations Implement monitoring solutions using Azure ...

Data Engineer - London - Databricks - Azure - 75k + bonus + benefits Tech Stack: Azure | Databricks | Power BI | Python Are you ready to shape the future of data? We're looking for a Data Engineer to join a team that thrives on innovation and cutting-edge … your chance to make an impact. What You'll Work With Azure Data Services: Data Factory, Data Lake, SQL Databricks: Spark, Delta Lake Power BI: Advanced dashboards ETL & Data Modelling: T-SQL, metadata-driven pipelines DevOps: CI/CD Bonus ...

Aker Systems was founded in 2017 by a team of experienced technology professionals who recognised an opportunity to provide highly secure enterprise data platforms to large organisations. Aker builds and operates ground-breaking, ultra-secure, high performance, cloud-based data infrastructure for the enterprise. Our proprietary … Platforms designing modern data platforms with appropriate architecture coving Data Mesh, Data Fabric, Data Lake etc. Data/Analytics - solving enterprise data and analytics problems using technology Cloud - hands-on Public Cloud experience in either ...

Data Engineer | Hybrid | London | Databricks | Azure | 85k I'm working with a global powerhouse that's been setting the standard for excellence for over 60 years. With more than 1,000 projects delivered worldwide and a combined value exceeding $150 billion, they've earned a reputation … forefront of the data engineering field. You'll Work With Azure Data Services: Data Factory, Data Lake, SQL Databricks: Spark, Delta Lake Power BI: Advanced dashboards and analytics ETL & Data Modelling: T-SQL, metadata-driven pipelines Design ...

regulated environment Job Summary: We are searching for an Enterprise Architect on behalf of a progressive financial services firm. You will lead their data-driven technology evolution and architect the future state of their cloud infrastructure, with Data architecture as the cornerstone of their digital ecosystem.This … while solving complex data integration, quality, and lineage challenges. Deep knowledge of Microsoft data technologies - including Azure Data Lake, Synapse Analytics, Fabric, and Power BI. This role is perfect for a strategic thinker who can bridge business objectives with technical execution, translating data ...

Technology Product Owner, AI Data Analytics, Microsoft Stack, Azure, Data Engineering, ML, Azure, Remote with Travel Technology Product Owner required to join a global Professional Services business based in Central London. However, this is practically a remote role, but when travel is required (to London, Europe … Development FIRST mentality. You must have been a Developer before moving into Product Ownership Technical proficiency:Familiarity with Azure services (e.g., Data Lake, Synapse, Fabric) and Databricks for data engineering, analytics, performance optimisation, and governance. Experience with implementing and optimising scalable cloud infrastructure is highly ...

build, and maintain scalable data pipelines using Databricks Notebooks, Jobs, and Workflows for both batch and streaming data. Optimise Spark and Delta Lake performance through efficient cluster configuration, adaptive query execution, and caching strategies. Conduct performance testing and cluster tuning to ensure cost-efficient, high-performing workloads. … governance best practices. Develop PySpark applications for ETL, data transformation, and analytics, following modular and reusable design principles. Create and manage Delta Lake tables with ACID compliance, schema evolution, and time travel for versioned data management. Integrate Databricks solutions with Azure services such as Azure ...

Data Engineering Consultant - £50,000 - Hybrid As a Data Engineer, you will work within an agile team to deliver high-value data solutions for clients. You'll be hands-on across the full lifecycle, using and developing your technical and project skills to create …/ELT pipelines using Azure Synapse, Data Factory, Databricks, or Fabric, with SQL and Python. Strong understanding of data lake and lakehouse architectures. Experience working with large, complex datasets from diverse sources. Strong SQL and Python capabilities, including stored procedures, notebooks, and query optimisation. Familiarity ...

Data Engineering team lead - £70,000 - Hybrid Overview We're looking for a Lead Technical Consultant to guide a team of Technical Consultants, oversee delivery of high-quality data solutions, and collaborate across the business to ensure successful project outcomes. This role combines leadership, resource management … Innovation Support technical delivery when needed, including designing scalable Azure/Microsoft data solutions. Drive innovation through cloud migrations, data lake implementations, and robust ETL/ELT pipeline development. Skills & Experience You'll thrive in this role if you have: Leadership Proven ability to build ...

mining, and visualization to extract insights. Design and implement Big Data solutions using Hadoop, Spark, PySpark, and Data Lake architectures. Develop and deploy ML models (supervised, unsupervised, tree-based, ensemble methods). Implement deep learning architectures (CNN, RNN, LSTM) using TensorFlow, PyTorch … Analytical Tools: EDA, Data Mining, Visualization (Plotly, Matplotlib, Seaborn) Statistical & Multivariate Analysis Big Data: Hadoop, MapReduce, HDFS, DataBricks, Spark, PySpark DataLake Architecture, AWS Redshift, Kinesis, EMR Machine Learning Supervised Models: Nave Bayes, Logistic Regression, SVM, Linear Regression, KNN, Tree-Based Models: Decision Trees, Random Forest, Gradient ...

Audit Technology Product Owner, Data Analytics, Azure, Data Engineering, AI, ML, Azure, Mainly Remote Audit Technology Product Owner (Technology and Business) required to join a global Professional Services business based in Central London. However, this is practically a remote role, but when travel is required … Owners who have managed complex, Global products. Read on for more details Experience required: Technical proficiency:Familiarity with Azure services (e.g., Data Lake, Synapse, Fabric) and Databricks for data engineering, analytics, performance optimisation, and governance. Experience with implementing and optimising scalable cloud infrastructure is highly ...

Senior Data Engineering Consultant - £60,000 - Hybrid Key Responsibilities Lead, mentor, and develop a team of Technical Consultants. Manage resource planning, scheduling, and overall delivery workflows. Collaborate with Pre-sales, Commercial, and Project Management teams to scope … deliver projects. Contribute to technical delivery, designing scalable data solutions in Azure/Microsoft environments. Support cloud migrations, data lake builds, and ETL/ELT pipeline development. Ensure delivery follows best practices and internal standards. Skills & Experience Strong leadership and relationship-building skills. Experience guiding ...

Head of Data Engineering - Azure & Databricks - Remote - Up to £100,000 A forward-thinking and nationally recognised organisation, known for its commitment to innovation and data-driven decision-making, is seeking a Head of Data Engineering to lead its growing data function. … Proven experience in leading data engineering teams. Strong expertise in Azure Data Services (e.g., Data Factory, Synapse, Azure Datalake) and Databricks. Comfortable balancing strategic leadership with occasional hands-on technical work. Excellent stakeholder management and communication skills. Benefits: Competitive salary up to £100,000. ...

Data Engineering Team Lead - Remote - Databricks - Azure - 80k Join a Leading Microsoft Consultancy Driving Data Innovation I'm working with a well-established Microsoft Partner with an incredible project pipeline, rapid growth, and a reputation for delivering Tech for Good. They're working on cutting-edge … projects using emerging technologies like Microsoft Fabric and Azure Databricks. We're looking for a Data engineering team lead who combines hands-on technical expertise with leadership skills to mentor a talented team and deliver exceptional solutions for our clients. What You'll Do Lead and mentor ...

searching for one of our key clients a Senior Data Platform Engineer to support and optimise large scale data ecosystems across PostgreSQL, Snowflake and Greenplum. This is a high-impact role within a modern digital environment, ideal for someone who thrives on complex data challenges and enterprise-grade engineering. Youll be responsible for designing scalable data models, optimising performance across multiple database technologies, and enabling seamless data ingestion pipelines. Expect to work in a cloud-driven setting with Azure, modern tooling, and critical data platforms that ...