51 to 75 of 201 Data Lake Jobs in London

OneLake Developing data models and analytics solutions Power BI development ETL/ELT SQL and SQL Server Azure Data Lake Internal and third-party API integrations Azure DevOps and Git CI/CD and production deployments Supporting existing Synapse solutions during the transition The client … experience across several of the following: SQL Data modelling ETL/ELT development Azure data platforms Azure Data Lake API integrations Git/source control Azure DevOps CI/CD Developing, deploying and supporting production solutions Azure Synapse would be useful but isnt ...

About the role As a Data Engineer at Tecknuovo, you will design, build and maintain reliable data solutions that enable our customers to make better use of their data. Working as part of multidisciplinary delivery teams, you will turn complex requirements into scalable data … solutions using Databricks or Snowflake, alongside AWS and/or Azure cloud platforms. You will have experience delivering new data lake patterns or helping to transform existing data lake environments, with a strong understanding of how to build scalable, secure and maintainable ...

global community. Our employees dedicate their time to helping our clients transform their business, from strategy through implementation and business transformation. As a Data Solutions Architect , you will lead the strategy, architecture and delivery of enterprise-scale data and analytics solutions for our clients. Working across … data architecture, software engineering, cloud platforms, analytics engineering and client advisory, you will translate business priorities into secure, scalable, well-governed and cost-effective solutions. You will partner with executive stakeholders, business leaders and technical teams to define data roadmaps and target-state architectures, evaluate technology ...

years of experience as a Product Manager/Owner of a data product, managing data & analytics solutions (Data Lake/DWH/Cloud Service).Experience in the iGaming or iLottery industry is highly beneficial.Proficiency in data modeling, infrastructure, and analytics.Experience working … pipelines, ELT workflows, and contemporary cloud data architectures.Experience with current cloud data platforms such as Snowflake, Azure Data Lake, Azure SQL, dbt, Airflow, or similar tools.Ability to understand and work with SQL queries and data models.Knowledge of data governance ...

Responsibilities Data Lakehouse Architecture: Design and optimize a high-performance lakehouse pattern utilizing Microsoft Fabric OneLake and Azure Data Lake Storage Gen2 (ADLS Gen2). Data Zone Management: Maintain architectural segregation between raw storage (immutability, landing) and curated data zones (cleansed … Fabric Lakehouse). Big Data Processing: Deep technical expertise with Apache Spark/Azure Databricks for distributed compute, memory optimization, and Delta Lake formats. Data Engineering Languages: Advanced proficiency in SQL (T-SQL, SparkSQL) and Python (PySpark). Security & Compliance: Direct experience implementing security controls ...

seeking a Principal Data Engineer who can work across the full stack of Anaplan’s data platform, setting the technical direction for how we ingest, transform, store, serve, and govern data at scale. You will build highly performant, robust data pipelines that … orchestration tools (e.g., Apache Airflow, Dagster). Hands-on expertise with cloud data warehouses (e.g., Snowflake, BigQuery, Redshift) and data lake architectures (e.g., Databricks, Delta Lake, Apache Iceberg). Advanced SQL skills and proficiency in Python. Strong background in modern software development practices (testing ...

businesses are the backbone of the economy, and we’re here to help them win. We’ve built a platform that uses clever data to get them the funding they need in minutes, not weeks. At Funding Circle, we have the restless energy of a fintech start … everyone and prioritise work within the engineering team. Experience of working with data platforms (data warehouse/data lake) and understanding the core elements that make up these platforms. Experience of working with Data Scientists, Analysts and/or BI teams ...

Powering Progress strategy on the journey to net-zero emissions. Achieving this ambition requires uniting Shell’s strategic and technical expertise across data, strategy, architecture, and innovation. This integration is essential to drive the transformative shifts needed in IT. As part of this journey, we are seeking … architecture (event hub, event bus, Kafka), ELK* Intermediate to advanced exposure to Azure Active Directory, Azure Data Factory, Azure Data Lake, Azure Storage, Azure Kubernetes Service, CosmosDB, Azure SQL* Integration experience with Confluent/Kafka, API Management, Logic AppsCI/CD & DevOps:* Brings substantial experience ...

Title Technical Data Project Manager – Data Platform Modernization Department Technology/Data Platforms Location London, UK Role Summary A Technical Data Project Manager … lead delivery of data platform modernization initiatives within a global banking environment. The role focuses on execution across data lake, data fabric, and DevOps‐enabled delivery models, working closely with engineering, architecture, and business stakeholders. Key Responsibilities Lead end‐to‐end delivery ...

tools for software development? If yes, come join Paloma’s 14-person team of software engineers and product experts as our first Data Engineer! As we are a rapidly scaling organisation, you will have multiple opportunities to develop. With demonstrated success in the role, you can progress … Working alongside product and clinical teams to translate business questions into data models and metrics Familiarity with data lake concepts and architecture, organising raw, cleansed, and curated data layers (bronze/silver/gold or equivalent), and working with large volumes ...

Responsibilities Data Lakehouse Architecture: Design and optimize a high-performance lakehouse pattern utilizing Microsoft Fabric OneLake and Azure Data Lake Storage Gen2 (ADLS Gen2). Data Zone Management: Maintain architectural segregation between raw storage (immutability, landing) and curated data zones (cleansed … Fabric Lakehouse). Big Data Processing: Deep technical expertise with Apache Spark/Azure Databricks for distributed compute, memory optimization, and Delta Lake formats. Data Engineering Languages: Advanced proficiency in SQL (T-SQL, SparkSQL) and Python (PySpark). Security & Compliance: Direct experience implementing security controls ...

company where people truly BELIEVE in what they are doing! We’re committed to bringing passion and customer focus to the business. Senior Data Engineer West London Onsite 2-3 days per week Fractal is a strategic AI partner to Fortune 500 companies with a vision to power … Watch’ by Gartner. Please visit Fractal | Intelligence for Imagination for more information about Fractal We are seeking a skilled and detail-oriented Senior Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. You will be responsible for transforming raw data into ...

Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data‐lead, by equipping them with robust data platforms. You'll also join a data team on its mission … data knowledge and skills out of silos and embedded into delivery teams. You'll also help implement efficient data pipelines & storage. Key responsibilities Define, shape and perfect data strategies in central and local government. Help public sector teams understand the value of their data ...

agility of a local business with the resources of a global enterprise, specialising in Azure to simplify how businesses modernise their IT, data, and analytics. Our strapline "modernisation, simplified..." highlights our mission to make cloud journeys straightforward and effective. Role Overview As a Data Architect … ingestion, transformation, storage, modelling, and reporting Experience with Azure services such as Data Factory, Databricks, Synapse Analytics, Fabric, or Data Lake Storage Strong understanding of data modelling concepts, including logical, physical, dimensional, and analytical models Ability to design practical, maintainable data ...

Drive the future of analytics and data intelligence by designing architectures that turn raw data into actionable insights at scale. As a Senior Analytics Solutions Architect, you’ll partner with customers to architect end-to-end analytics platforms from data lakes and lakehouses … teams, and elevating the broader analytics community through thought leadership, workshops, and reference architectures. Key job responsibilities Architect analytics solutions — design data lake, lakehouse, warehouse, and streaming architectures using AWS analytics services (Redshift, Athena, EMR, Glue, Kinesis, QuickSight, OpenSearch). Lead analytics modernisation — guide customers migrating from ...

Description About Rayo Rayo, part of UBDS Group, helps organisations solve complex technology challenges across cloud, data, AI and digital transformation. We work with clients operating in complex, secure and highly regulated environments, with a significant focus on the public sector and defence. We’re looking … experienced Senior Data Engineer with strong AWS expertise to design, build and deliver scalable, secure and resilient data solutions for our clients. This is a hands-on senior engineering role, combining deep data engineering expertise with technical ownership, client engagement and the ability ...

patterns. 7+ years strong hands-on experience with Azure-based data platforms, including Azure Data Factory, Databricks, data lake architectures, SQL, and dimensional data modeling, with the ability to build practical end-to-end solution designs. Proven ability to own solution … data, or AI architecture. Core Technology Stack Data platform : Azure Data Factory, Databricks, Azure data lake, SQL, dimensional modeling, ETL/ELT, orchestration. AI platform : Azure OpenAI, Azure AI Foundry, Azure AI Search, Copilot Studio, Semantic Kernel, Prompt Flow. Analytics : Power ...

Data Engineer - Azure, Databricks, Python, C#, SQL, ETL - Data Platform - Financial Services Must have: Azure/Databricks, end-to-end data pipelines, Python/C#, strong SQL Our client, a global investment and corporate bank, requires a Data Engineer to help build … Building data pipelines, ETL and integrations on Azure with Databricks Developing data models and architecture (lakehouse, data lake, data fabric) Integrating data from databases, APIs and message bus platforms Owning data quality, performance tuning and governance Owning ...

Join the Chief Data & Analytics Office at JPMorganChase and help accelerate our data and analytics journey. You will lead complex, multi-functional technology projects that impact clients, employees, and stakeholders firmwide. Bring your technical fluency and analytical reasoning to drive innovative solutions, manage resources, and foster … data platforms such as Databricks and Snowflake. Strong knowledge of AWS data analytics services, including Redshift, EMR, Glue, Athena, Kinesis, Lake Formation, MSK, and S3 data lake patterns. Preferred Qualifications, Capabilities, and Skills: Experience navigating complex data governance, security ...

Lead Data Engineer Department: Technology Employment Type: Permanent Location: Any UK Office Hub (Bristol/London/Manchester/Swansea) Compensation: £80,000 - £96,000/year Description As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping … public sector organisations become truly data-lead by equipping them with robust data platforms. You'll also join a data team on its mission to get data knowledge and skills out of silos and embedded into delivery teams. Combining cloud engineering knowledge ...

migration of existing data processes to the new Data Analytics Cloud Platform, building knowledge of Data Lake, Databricks, Unity Catalog and related cloud services.Develop, maintain and optimise Databricks notebooks, SQL processes, data pipelines and transformation logic, ensuring solutions are scalable, performant … with experience transforming, modelling and optimising large and sophisticated datasets.Experience working with modern cloud data platforms such as Databricks, Data Lake, and related Azure services. Python experience is beneficial.Experience of automating processes, improving efficiency and implementing scalable analytics solutions.Experience owning and supporting enterprise reporting environments ...

Senior Data Architect – Wealth & Asset Management Location: London (Hybrid) | Practice Area: Data & Analytics | Type: Permanent Design the blueprint. Architect the future of Wealth & Asset Management. Empower data transformation through modern, AI-enabled ways of working. The Role Capco is seeking a Senior Data … appropriate controls. Bonus Points For Data or cloud architecture certifications, such as AWS, Azure, GCP or Databricks. Experience in data lake design and large-scale data migrations. Familiarity with graph computing, semantic data modelling, or AI-enabled approaches to data ...

migration of existing data processes to the new Data Analytics Cloud Platform, building knowledge of Data Lake, Databricks, Unity Catalog and related cloud services. Develop, maintain and optimise Databricks notebooks, SQL processes, data pipelines and transformation logic, ensuring solutions are scalable … experience transforming, modelling and optimising large and sophisticated datasets. Experience working with modern cloud data platforms such as Databricks, Data Lake, and related Azure services. Python experience is beneficial. Experience of automating processes, improving efficiency and implementing scalable analytics solutions. Experience owning and supporting enterprise ...

excellent opportunity for an engineer with strong Python and SQL skills who wants to build broader expertise across software engineering, cloud, data engineering and AI-enabled applications . Rather than focusing on one part of the technology stack, you'll work across backend services, APIs, databases, data … applications and contributing to client projects. Why this role? You’ll gain hands‐on exposure to: AWS cloud & migration Python development SQL, databases & data platforms Data pipelines & ETL/ELT APIs & backend engineering CI/CD & production systems Analytics & modern data platforms AI/ ...

Role Description The Technical Analyst – Data Lineage will support a Data Governance, Controls, and Reporting program for a top-tier banking client. Responsible for establishing and validating end-to-end lineage across critical datasets used in operational and regulatory reporting. Translate governance and reporting requirements into … actionable lineage deliverables (source-to-target mapping, lineage diagrams, metadata standards, and audit evidence). Work with Data Platform, Data Engineering, Architecture, Risk, Compliance, and Security teams to define lineage standards, metadata capture, and control points. Maintain lineage artifacts for Critical Data Elements (CDEs ...