1 to 25 of 633 Data Lake Jobs in London

Director , Data Governance Location: Global Reporting to: VP - Data Excellence WHO WE ARE Choreograph is WPP's global data products and technology company. Our mission is to transform marketing by building the fastest, most connected data platform that bridges marketing strategy to … scaled activation. We partner with agencies and clients to unlock the full value of data by combining technology, data, and analytics expertise. This is delivered through the Open Media Studio, an AI-enabled media and data platform designed for the future of advertising. Our … s Reporting and Analytics group, the Collective Intelligence d ata m odelling product team is responsible for realising the strategic value of combining data assets from across the GroupM business to unlock insights and power cross-functional data driven use cases. They will lead teams building More ❯

Join to apply for the Senior Data Engineers role at Foreign, Commonwealth and Development Office 1 week ago Be among the first 25 applicants Join to apply for the Senior Data Engineers role at Foreign, Commonwealth and Development Office London or East Kilbride - You will be … UK-based staff work in King Charles Street, London, Abercrombie House in East Kilbride and in Milton Keynes. These roles contribute to FCDOs Data Strategy to improve insights to the business by provisioning it with reliable and trustworthy data sources and improving their delivery in a … secure manner in compliance with Data regulations. The team is primarily Azure focused but other Cloud technologies such as Oracle and Amazon Web Services (AWS) are used in FCDO. The successful candidates will build complex data pipelines (both Extract Transform and Load {ETL} and Extract Load More ❯

advantage, and its technology-led service provides access to all major exchanges, order-flow management via screen, voice and DMA, plus award-winning data, insights and analytics. The Technology Department delivers differentiation, scalability and security for the business. Reporting to the COO, Technology provides digital tools, software services … our enterprise-wide services to end users and actively manages the firm's infrastructure and data. Within IT, Marex Technology has established a Data team that enables the firm to leverage data assets to increase productivity and improve business decisions, as well as maintain data … of the risk and compliance requirements associated with this. • Oracle Database • MongoDB • Cloud Data Technologies (Mainly Azure - SQL Database, Data Lake, HD Insight, Data Factory etc.) • A collaborative team player, approachable, self-efficient and influences a positive work environment • Demonstrates curiosity • Resilient in More ❯

architecting a scalable, reliable and efficient data solutions to support our business objectives. Responsibilities Design, develop, and maintain the data lake house architecture on AWS using best practices and industry standards. Implement data labelling strategy and principals as required by Data … Design and implement robust ETL/ELT processes to extract, transform and load data from various sources into the data lake ensuring data quality and integrity. Ensure data quality, reliability, availability, and scalability across the data lake house. … SQL Proficient in AWS data services such as S3, Glue, Athena, Redshift, EMR, Kinesis, Lambda, etc. Strong knowledge of data lake concepts, architectures, and design patterns. Experience in building and managing data pipelines using tools such as Airflow, Spark, Kinesis etc. Experience in More ❯

advantage, and its technology-led service provides access to all major exchanges, order-flow management via screen, voice and DMA, plus award-winning data, insights and analytics. The Technology Department delivers differentiation, scalability and security for the business. Reporting to the COO, Technology provides digital tools, software services … our enterprise-wide services to end users and actively manages the firm’s infrastructure and data. Within IT, Marex Technology has established a Data team that enables the firm to leverage data assets to increase productivity and improve business decisions, as well as maintain data … of the risk and compliance requirements associated with this. Oracle Database MongoDB Cloud Data Technologies (Mainly Azure - SQL Database, Data Lake, HD Insight, Data Factory etc.) Knowledge of advanced analytics for client segmentation, lifetime value analysis, cross-sell opportunities and campaign impact evaluation. More ❯

with: Salary : National ranging from £57,600 to £70,000 and London from £63,300 to £75,000 The team/department The Data Strategy & Services department supports the FCA’s Strategy by enhancing the quality and value of data through Data Management activities … and providing central co-ordination of all data-related activities. The departments key responsibilities include: Setting Data Management Policy across the FCA to establish data ownership and manage and mitigate data risk Delivering and managing technology solutions to support metadata management and … Group and ensure metadata management and data quality requirements are met by the Enterprise Data Platform (the Data Lake) Be the subject matter expert on key programmes to ensure close alignment and integration between the data lake and the data More ❯

please get in touch with at [emailprotected] or call TCS London Office number 02031552100 with the subject line: “Application Support Request”. Role : Data Architect Job Type: Permanent (Hybrid) Location: London, United Kingdom Ready to utilize your skills in designing, creating, and managing data architecture? Join … us as a Data Architect. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients … an exciting team where you will be challenged every day. • Build strong relationships with a diverse range of stakeholders. The Role As a Data Architect, you will be responsible for designing, creating, and managing data architecture. You will also ensure that data is efficiently More ❯

Technologies: Data Architect ETL/ELT Data Lake data warehousing data pipelines SQL Calling for a Data Architect who can understand and appreciate code to transform noisy real-world data into high-signal models that stand the … to work at an abstract level and build consensus; ability to see from and sell to multiple viewpoints. Designing and implementing Data Lake, Data Warehouse, and Data Marts in AWS. Creating efficient SQL queries and understanding query execution plans for tuning queries on … implementation of Data Pipelines on public cloud infrastructure. Strong understanding of Data Engineering concepts including ETL, ELT, Data Lake, Data Warehousing, and Data Pipelines. Experience designing and implementing Data Pipelines, Data Lakes, Data More ❯

team. The ideal candidate will have a strong background in managing technical projects related to legacy data platform migration, data lake build, and data analytics across multiple cloud platforms. This role requires a blend of project management expertise and technical acumen to ensure … projects on time and within budget. Key Responsibilities: Project Management: Lead and manage legacy data platform migration (Teradata, Hadoop), data lake build, and data analytics projects from initiation to completion. Develop comprehensive project plans, including scope, timelines, resource allocation, and budgets. Monitor project … IT professionals, to ensure seamless execution of projects. Technical Leadership: Provide technical guidance and expertise on data migration strategies, data lake architectures, and data analytics solutions. Ensure best practices in data management, data integration, and data security More ❯

Services, the successful candidate should have a strong background in managing technical projects related to legacy data platform migration, data lake build, and data analytics across multiple cloud platforms. This role requires excellent project management skills and technical experience to ensure successful delivery … data projects on time and within budget. Responsibilities: Lead and manage legacy data platform migration (Teradata, Hadoop), data lake build, and data analytics projects from initiation to completion. Develop comprehensive project plans, including scope, timelines, resource allocation, and budgets. Monitor project … scientists, and IT professionals, to ensure seamless execution of projects. Provide technical guidance and expertise on data migration strategies, data lake architectures, and data analytics solutions. Ensure best practices in data management, data integration, and data security More ❯

Central Operations Enterprise Data Architect - SVP Central Operations Enterprise Data Architect - SVP Overview of Citi: Citi is a world-leading global bank. We have approximately 200 million customer accounts and a presence in more than 160 countries and jurisdictions worldwide. We provide consumers, corporations, governments, and … and is responsible for driving process transformation, risk reduction, and efficiencies through best-in-class technology solutions. Including, development of shared services, comprehensive data architecture, automation, end-to-end solution design for large scale transformation initiatives, and adoption of Generative AI solutions. Job Purpose : The Central Operations Enterprise … Data Architect role is a critical hire in the group to become part of the team that drives data strategy, architecture, and design across critical initiatives -payments services, global reconciliations, reg. reporting, liquidity management, and strategic general ledger. The role requires hands on experience in designing More ❯

Services, the successful candidate should have a strong background in managing technical projects related to legacy data platform migration, data lake build, and data analytics across multiple cloud platforms. This role requires excellent project management skills and technical experience to ensure successful delivery … data projects on time and within budget. Responsibilities: Lead and manage legacy data platform migration (Teradata, Hadoop), data lake build, and data analytics projects from initiation to completion. Develop comprehensive project plans, including scope, timelines, resource allocation, and budgets. Monitor project … scientists, and IT professionals, to ensure seamless execution of projects. Provide technical guidance and expertise on data migration strategies, data lake architectures, and data analytics solutions. Ensure best practices in data management, data integration, and data security More ❯

and is responsible for driving process transformation, risk reduction, and efficiencies through best-in-class technology solutions. Including, development of shared services, comprehensive data architecture, automation, end-to-end solution design for large scale transformation initiatives, and adoption of Generative AI solutions. Job Purpose : The Central Operations Enterprise … Data Architect role is a critical hire in the group to become part of the team that drives data strategy, architecture, and design across critical initiatives -payments services, global reconciliations, reg. reporting, liquidity management, and strategic general ledger. The role requires hands on experience in designing … executing, and managing enterprise-wide data architecture, including design of frameworks to standardize data management, consumption, and data quality controls. Successful candidate will be working cross disciplines in engineering, architecture, and technology teams across Operations, Finance, CDO, and Technology functions to simplify data More ❯

UK-based staff work in King Charles Street, London, Abercrombie House in East Kilbride and in Milton Keynes. These roles contribute to FCDOs Data Strategy to improve insights to the business by provisioning it with reliable and trustworthy data sources and improving their delivery in a … secure manner in compliance with Data regulations. The team is primarily Azure focused but other Cloud technologies such as Oracle and Amazon Web Services (AWS) are used in FCDO. The successful candidates will build complex data pipelines (both Extract Transform and Load {ETL} and Extract Load … and Transform {ELT}) in the Azure cloud platforms. You will work with structured and unstructured data, data lakes, data warehouses to service operational and analytical business needs. Job description The successful candidates will: Work collaboratively with Enterprise Data Colleagues to develop pipelines More ❯

in Azure Databricks, handling ingestion from various data sources, performing complex transformations, and publishing data to Azure Data Lake or other storage services. Write efficient and standardized Spark SQL and PySpark code for data transformations, ensuring data integrity and … transformation logic using Spark, ensuring data is cleaned, transformed, and enriched according to business requirements. Leverage Databricks features such as Delta Lake to manage and track changes to data, enabling better versioning and performance for incremental data loads. Data Publishing … Integration: Publish clean, transformed data to Azure Data Lake or other cloud storage solutions for consumption by analytics and reporting tools. Define and document best practices for managing and maintaining robust, scalable data pipelines. Data Governance & Security: Implement and maintain data More ❯

Architectural Design: Lead the end-to-end design of the Databricks Lakehouse architecture (Medallion architecture), including data ingestion patterns, storage layers (Delta Lake), processing frameworks (Spark), and consumption mechanisms. Technology Selection: Evaluate and recommend optimal Databricks features and integrations (e.g., Unity Catalog, Photon, Delta Live Tables, MLflow … and complementary cloud services (e.g., Azure Data Factory, Azure Data Lake Storage, Power BI). Security & Governance Frameworks: Design robust data governance, security, and access control models within the Databricks ecosystem, ensuring compliance with industry standards and regulations. Phase 2: Core Platform Build … sustainability of the platform. Required Skills & Experience Proven Databricks Expertise: Deep, hands-on experience designing and implementing solutions on the Databricks Lakehouse Platform (Delta Lake, Unity Catalog, Spark, Databricks SQL Analytics). Cloud Data Architecture: Extensive experience with Azure data services (e.g., Azure Data More ❯

for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that … engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data Mesh, lakehouse, data vault and data warehouses. Our data engineers create pipelines that support our data scientists and power our front-end applications. This means we do data-intensive work for both More ❯

Technologies: Enterprise Data Architect, Data Engineer, Financial Services, Insurance Our client, one of the world's largest commercial insurance companies with operations in 54 countries and territories, has a need for a skilled Data Architect/Data Engineer to join its London … based team. The role is 3 days onsite and 2 days remote. The role: Do you have data engineering or architecture experience within the financial services industry? If you are interested in growing your skills and career within one of the largest commercial insurers in the world, then … functional data management solutions. Hands-on experience architecting and implementing large scale multi-field master data management, data lake, business intelligence, data warehouse, and data quality solutions are a must-have. Experience in architecting enterprise knowledge graph capability from More ❯

Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £50,000 - £77,500 - depending on experience Department: Technology and Data We’re First Central Insurance & Technology Group (First Central for short), an innovative, market-leading insurance company. We protect the things customers love so they can get … on with what matters to them in life. Data drives us. It fuels our outstanding distribution, finance, technology and legal services. Our underwriting skills are built on data expertise; it creates the insights we need to give the right cover to the right customers at the … self-testing pipelines that proactively identify processing issues or discrepancies. You’ll build solutions that pipe transform data into data lake storage areas, physical database models and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. More ❯

About Workato Workato transforms technology complexity into business opportunity. As the leader in enterprise orchestration, Workato helps businesses globally streamline operations by connecting data, processes, applications, and experiences. Its AI-powered platform enables teams to navigate complex workflows in real-time, driving efficiency and agility. Trusted by a … company for remote workers As Director Product Manager, you will define and execute the strategy to establish Workato as the enterprise leader in data orchestration. Your goal is to build a unified platform that seamlessly orchestrates data pipelines for ETL, ELT, and Reverse ETL (data activation) —eliminating the need for fragmented tools and enabling enterprises to move data efficiently across their ecosystem. What You’ll Do Leadership in Enterprise Data Orchestration Develop and execute the product strategy for a unified data orchestration platform supporting ETL, ELT, and More ❯

for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that … engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data Mesh, lakehouse, data vault and data warehouses. Our data engineers create pipelines that support our data scientists and power our front-end applications. This means we do data-intensive work for both More ❯

Architectural Design: Lead the end-to-end design of the Databricks Lakehouse architecture (Medallion architecture), including data ingestion patterns, storage layers (Delta Lake), processing frameworks (Spark), and consumption mechanisms. Technology Selection: Evaluate and recommend optimal Databricks features and integrations (e.g., Unity Catalog, Photon, Delta Live Tables, MLflow … and complementary cloud services (e.g., Azure Data Factory, Azure Data Lake Storage, Power BI). Security & Governance Frameworks: Design robust data governance, security, and access control models within the Databricks ecosystem, ensuring compliance with industry standards and regulations. Phase 2: Core Platform Build … sustainability of the platform. Required Skills & Experience Proven Databricks Expertise: Deep, hands-on experience designing and implementing solutions on the Databricks Lakehouse Platform (Delta Lake, Unity Catalog, Spark, Databricks SQL Analytics). Cloud Data Architecture: Extensive experience with Azure data services (e.g., Azure Data More ❯

Architectural Design: Lead the end-to-end design of the Databricks Lakehouse architecture (Medallion architecture), including data ingestion patterns, storage layers (Delta Lake), processing frameworks (Spark), and consumption mechanisms. Technology Selection: Evaluate and recommend optimal Databricks features and integrations (e.g., Unity Catalog, Photon, Delta Live Tables, MLflow … and complementary cloud services (e.g., Azure Data Factory, Azure Data Lake Storage, Power BI). Security & Governance Frameworks: Design robust data governance, security, and access control models within the Databricks ecosystem, ensuring compliance with industry standards and regulations. Phase 2: Core Platform Build … sustainability of the platform. Required Skills & Experience Proven Databricks Expertise: Deep, hands-on experience designing and implementing solutions on the Databricks Lakehouse Platform (Delta Lake, Unity Catalog, Spark, Databricks SQL Analytics). Cloud Data Architecture: Extensive experience with Azure data services (e.g., Azure Data More ❯

Architectural Design: Lead the end-to-end design of the Databricks Lakehouse architecture (Medallion architecture), including data ingestion patterns, storage layers (Delta Lake), processing frameworks (Spark), and consumption mechanisms. Technology Selection: Evaluate and recommend optimal Databricks features and integrations (e.g., Unity Catalog, Photon, Delta Live Tables, MLflow … and complementary cloud services (e.g., Azure Data Factory, Azure Data Lake Storage, Power BI). Security & Governance Frameworks: Design robust data governance, security, and access control models within the Databricks ecosystem, ensuring compliance with industry standards and regulations. Phase 2: Core Platform Build … sustainability of the platform. Required Skills & Experience Proven Databricks Expertise: Deep, hands-on experience designing and implementing solutions on the Databricks Lakehouse Platform (Delta Lake, Unity Catalog, Spark, Databricks SQL Analytics). Cloud Data Architecture: Extensive experience with Azure data services (e.g., Azure Data More ❯

Architectural Design: Lead the end-to-end design of the Databricks Lakehouse architecture (Medallion architecture), including data ingestion patterns, storage layers (Delta Lake), processing frameworks (Spark), and consumption mechanisms. Technology Selection: Evaluate and recommend optimal Databricks features and integrations (e.g., Unity Catalog, Photon, Delta Live Tables, MLflow … and complementary cloud services (e.g., Azure Data Factory, Azure Data Lake Storage, Power BI). Security & Governance Frameworks: Design robust data governance, security, and access control models within the Databricks ecosystem, ensuring compliance with industry standards and regulations. Phase 2: Core Platform Build … sustainability of the platform. Required Skills & Experience Proven Databricks Expertise: Deep, hands-on experience designing and implementing solutions on the Databricks Lakehouse Platform (Delta Lake, Unity Catalog, Spark, Databricks SQL Analytics). Cloud Data Architecture: Extensive experience with Azure data services (e.g., Azure Data More ❯