1 to 25 of 39 Permanent Data Lake Jobs in London

more Chinese jobs please follow us on WeChat: teamchinapf AND pfteamchina Ref: 23377 The Skills You'll Need: Mandarin and English fluent, solid data management experiences within banking. Your New Salary: Competitive + Bonus + Benefits Fully office based Permanent Office based: London Start: ASAP Reports to: Head … report automation and process management tools Should be able to read and write SQL Should understand the architecture and concept of data lake and data warehouse related knowledge and design Must be proactive and analytical to evaluate and solve problems independently Must be able ...

IMMEDIATE JOINERS !! 💻 Junior Big Data Developer (Python & SQL Focus) 📊 We're looking for an enthusiastic and detail-oriented Junior Big Data Developer to join our data engineering team. This role is ideal for an early-career professional with foundational knowledge in data … distributed computing framework like Apache Spark (using PySpark). Familiarity with cloud data services ( AWS S3/Redshift, Azure Data Lake/Synapse, or Google BigQuery/Cloud Storage ). Exposure to workflow orchestration tools ( Apache Airflow, Prefect, or Dagster ). Bachelor's degree ...

data products, working closely with architecture where required. Implement and maintain data pipelines and ETL workflows in Databricks (PySpark, Delta Lake). Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform) in line with established … communicate clearly with technical and non-technical stakeholders. Data Engineer (New Technology/Microsoft) Strong experience with Databricks (Spark, PySpark, Delta Lake, and Unity Catalog advantageous). Proficiency in Azure data services (Azure Data Factory, Data Lake, Azure Functions advantageous ...

data products, working closely with architecture where required. Implement and maintain data pipelines and ETL workflows in Databricks (PySpark, Delta Lake). Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform) in line with established … communicate clearly with technical and non-technical stakeholders. Data Engineer (New Technology/Microsoft) Strong experience with Databricks (Spark, PySpark, Delta Lake, and Unity Catalog advantageous). Proficiency in Azure data services (Azure Data Factory, Data Lake, Azure Functions advantageous ...

This is a rare opportunity to apply serious data engineering in a domain where latency, correctness, and reliability carry direct commercial weight. * Requirements * 6+ years data engineering in production environments; Python expertise - idiomatic, well-tested, production-grade code, not notebook scripts * ETL/ELT pipeline design … retry, and exactly-once semantics * Azure data platform - Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake Storage; infrastructure as code for data workloads (Terraform or Bicep) * Databricks - Delta Lake, Unity Catalog, job cluster vs interactive cluster trade ...

client is an international bank seeking a Data Management Officer to join its London-based IT function, supporting critical data governance and data security initiatives across the business. This is a hands-on role operating at the intersection of data, regulation … technology, working closely with Finance, Compliance, and broader business teams to embed robust data management practices across the organisation. Key Responsibilities * Support the implementation of group-wide data governance frameworks and standards * Assist in building and enhancing data quality frameworks, monitoring, and reporting mechanisms ...

Associate Director, Master Data Management Solution Architect, Engineering, AI & Data, Technology & Transformation Basic information Location London Business Line Job Type Permanent/FTC Date published 10-Dec-2025 Connect to your Industry Do you want to be at the heart of some of the biggest … reference data management, and stewardship workflows Strong proficiency with cloud-native data services (Azure Purview/ADF, AWS Glue/Lake Formation, GCP DataPlex) and modern integration technologies (APIs, streaming, ETL/ELT). Solid understanding of data governance, data lineage ...

critical functions. Responsibilities: Design, build and deploy scalable, secure data solutions using Azure Databricks, Data Factory and Data Lake Storage. Develop and optimise advanced data pipelines with Python, SQL, Spark/PySpark and Delta Lake. Champion strong data quality … business teams to align engineering solutions with organisational needs. Minimum Criteria Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory. Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed processing. ...

Provide architectural guidance across: Data ingestion (Kafka, APIs, SFTP) Data processing (PySpark, EMR, Glue) Storage (S3 and data lake patterns) Collaborate with DevOps, Data Engineers, and Testers to ensure cohesive delivery. Promote engineering best practices, including CI/CD, infrastructure … time). Proficiency in Infrastructure as Code (Terraform). Experience with GitHub-based workflows and CI/CD pipelines. Experience with data lake and lakehouse architectures. Strong understanding of: Data ingestion patterns Data transformation and curation layers Data access and productisation ...

Office.Full time hours. We are happy to discuss flexible working! Top 3 skills needed for this role: Expert in building scalable, high-quality data pipelines Hands-on experience with cloud data platforms The ability to optimise, automate, and deliver reliable data solutions independently What … this role is all about: Join us as a Data Engineer and become a driving force behind high-impact, high-performance data solutions. Youll take ownership of designing and supercharging data pipelines that keep our business moving, bringing fresh thinking and technical flair ...

full of opportunities to turn today’s challenges into tomorrow’s solutions. Job Description Becoming part of the UK team in our Data & AI Service Line will present new opportunities for you to make a positive impact as we embark on securing major projects with our top international … working with our FTSE100 clients and beyond on a wide range of advisory projects, bringing deep business and technology expertise to help address Data and AI opportunities and challenges across their organisations. Wavestone has a significant and growing capability in Data & AI that is in high ...

Full time hours. We are happy to discuss flexible working! Top 3 skills needed for this role: Expert in building scalable, high-quality data pipelines Hands-on experience with cloud data platforms The ability to optimise, automate, and deliver reliable data solutions independently What … this role is all about: Join us as a Data Engineer and become a driving force behind high-impact, high-performance data solutions. You’ll take ownership of designing and supercharging data pipelines that keep our business moving, bringing fresh thinking and technical flair ...

Power BI dashboards and data models built on Charge Detail Record (CDR) data from the company's data lake Create new reports and visuals to track operational KPIs such as revenue per charger, utilisation rates, and site performance Work with the Microsoft Fabric … systems AAT qualification, part-qualified ACCA/CIMA, or relevant degree Experience working with API-sourced data or data lake environments What you'll get in return Hybrid working The opportunity to shape a growing finance function in a fast-scaling business Exposure to both ...

Join the Chief Data & Analytics Office at JPMorganChase and help accelerate our data and analytics journey. You will lead complex, multi-functional technology projects that impact clients, employees, and stakeholders firmwide. Bring your technical fluency and analytical reasoning to drive innovative solutions, manage resources, and foster … data platforms such as Databricks and Snowflake. Strong knowledge of AWS data analytics services, including Redshift, EMR, Glue, Athena, Kinesis, Lake Formation, MSK, and S3 data lake patterns. Preferred Qualifications, Capabilities, and Skills Experience navigating complex data governance, security ...

Overview: We are working with a leading UK-based wealth and investment management firm seeking a skilled Data Engineer to support the build and evolution of their modern data platform. This role will focus on developing scalable data pipelines and contributing to a cloud … performance best practices are followed Required Skills & Experience: Strong experience with Azure data platform (e.g., Data Factory, Data Lake, Synapse) Hands-on expertise with Databricks (PySpark or Spark) Solid SQL development skills Experience working with Kafka for streaming data pipelines Good ...

code agentic workflow platform — while simultaneously owning the data and model foundations that power them: the Sidetrade Data Lake, our ML model portfolio, and our LLM fine-tuning strategy. About Sidetrade: Sidetrade is an AI company, listed on Euronext Growth, on a mission to revolutionize … compose intelligent O2C workflows using agentic AI — without writing a line of code. Own the product strategy for the Sidetrade Data Lake — defining how data assets are structured, enriched, governed, and surfaced across all O2C domains, driving continuous improvement across Gold, Silver, and Bronze data ...

engineers to deliver robust and reusable data products Manage data lakes and warehouses using formats such as Delta Lake and Parquet Implement best practices for data governance, performance, and security Continuously evaluate and adopt new technologies to evolve the organisation's data … junior engineers and contribute to team capability building Technical Stack Core: Azure Data Factory Azure Synapse Analytics Azure Data Lake Storage Gen2 SQL Server Databricks Enhancements: Python (PySpark, Pandas) CI/CD (Azure DevOps) Infrastructure as Code (Terraform, Bicep) REST APIs GitHub Actions Desirable: Microsoft ...

This role is responsible for designing, building, and operating robust cloud-based data platforms that support large-scale analytics and reporting. You will work across the full data lifecycle, partnering closely with technical and non-technical stakeholders to deliver reliable, secure, and scalable data … structured and unstructured data, ensuring high standards of data quality and integrity Design and implement cloud-based data lake and data warehousing architectures Create and maintain analytical data marts using dimensional modelling techniques (e.g. star and snowflake schemas) Work ...

Aker Systems was founded in 2017 by a team of experienced technology professionals who recognised an opportunity to provide highly secure enterprise data platforms to large organisations. Aker builds and operates ground-breaking, ultra-secure, high performance, cloud-based data infrastructure for the enterprise. Our proprietary … Platforms designing modern data platforms with appropriate architecture coving Data Mesh, Data Fabric, Data Lake etc. Data/Analytics - solving enterprise data and analytics problems using technology Cloud - hands-on Public Cloud experience in either ...

Title: Data Engineer – Azure Data Platform Location : London (Hybrid) Our client is hiring a Data Engineer to help build and scale enterprise-grade data solutions on the Microsoft Azure platform. This role involves delivering reliable, high-performance data pipelines that … optimization of data workflows Requirements: Experience in data engineering and pipeline development Strong expertise in Azure (Synapse, Data Lake) Proficiency in Python, PySpark, and T-SQL Knowledge of data warehousing, CDC, and incremental processing Familiarity with modern data architectures ...

Method are excited to partner with a prestigious London-based Wealth Manager looking to hire a Data Engineer to join their talented team as they enjoy a sustained period of growth. This business are renowned for their outstanding reputation in the space, strong career development opportunities, and access … need to succeed? Must-have Solid Data Engineering background across architectures such as Data Warehouse, Data Lake, or Data Lakehouse Strong SQL/T-SQL skills and hands-on experience with a cloud data platform (Databricks or Snowflake) Experience ...

Description Apply (by clicking the relevant button) after checking through all the related job information below. Job Title: Data Engineer – Azure Data Platform Location : London (Hybrid) Our client is hiring a Data Engineer to help build and scale enterprise-grade data solutions … optimization of data workflows Requirements: Experience in data engineering and pipeline development Strong expertise in Azure (Synapse, Data Lake) Proficiency xehkeey in Python, PySpark, and T-SQL Knowledge of data warehousing, CDC, and incremental processing Familiarity with modern data ...

evolve, offering continuous opportunities for development, influence, and leadership* Serve as the primary contact for architectural aspects of IT projects* Integrate business process, data, application, technical, and information security dimensions into cohesive IT solutions* Ensure solution architectures are documented using standard templates and tooling complying with Shell … architecture (event hub, event bus, Kafka), ELK* Intermediate to advanced exposure to Azure Active Directory, Azure Data Factory, Azure Data Lake, Azure Storage, Azure Kubernetes Service, CosmosDB, Azure SQL* Integration experience with Confluent/Kafka, API Management, Logic Apps* Practical agile experience in both start ...

other Azure services). Strong Power BI capability (reporting + modelling) and ability to connect engineering outputs to analytics consumption. Understanding of Direct Lake semantic modelling design considerations (model creation, table choices, and enforcing access rules). Proven experience with ingestion and transformation patterns (ETL/ELT concepts), data … Experience across adjacent Microsoft services often paired with Fabric (e.g., Azure Synapse Analytics, Azure Data Factory, Azure Databricks, Azure Data Lake). Familiarity with Microsoft Purview and broader governance practices. Dynamics 365 CE and FO integration and analytics. Exposure to AI/ML enablement ...

JR110**The Role**We are seeking a dynamic and adaptable hands-on leader in architecture (cloud and solution) and engineering (digital and data) to champion best practices, develop solutions and support our technology evolution. This role is crucial for enabling the business and delivering a differentiated client … Proven ability to design and build Data Lakehouses using Microsoft technologies (Data Factory, Data Bricks, Data Lake, PowerBI).* Proficiency in software engineering languages such as Python, Java, C#, JavaScript, and TypeScript.* Deep knowledge of data engineering languages ...