1 to 25 of 52 Data Lake Jobs in the City of London

models, performance dashboards). Engineering & Implementation Build robust batch and streaming pipelines using Azure Data Factory, Databricks, and Spark Structured Streaming. Implement secure, scalable storage using Delta Lake formats, Azure Data Lake Gen2, and time-series solutions (e.g. Azure Data Explorer). Deliver data validation, schema evolution, metadata management, and … can own and evolve the platform post-delivery. Required Skills & Experience Extensive experience delivering enterprise-scale data platforms in cloud environments(preferably Azure). Deep expertise in lake house architectures, real-time/batch processing, and telemetry/IoT pipelines. Proven ability to lead complex delivery across technical and non-technical teams. Strong hands-on experience with … Azure Event Hubs, IoT Hub, Data Factory, Data Lake Gen2, Synapse, Databricks Spark, Structured Streaming, Delta Lake, Parquet SQL, Python Time-series DBs (Azure Data Explorer, InfluxDB, TimescaleDB) Familiarity with Medallion architecture, schema evolution, cost optimisation, and system observability. Track record of mentoring internal teams and embedding best practices in technical delivery. More ❯

models, performance dashboards). Engineering & Implementation Build robust batch and streaming pipelines using Azure Data Factory, Databricks, and Spark Structured Streaming. Implement secure, scalable storage using Delta Lake formats, Azure Data Lake Gen2, and time-series solutions (e.g. Azure Data Explorer). Deliver data validation, schema evolution, metadata management, and … can own and evolve the platform post-delivery. Required Skills & Experience Extensive experience delivering enterprise-scale data platforms in cloud environments(preferably Azure). Deep expertise in lake house architectures, real-time/batch processing, and telemetry/IoT pipelines. Proven ability to lead complex delivery across technical and non-technical teams. Strong hands-on experience with … Azure Event Hubs, IoT Hub, Data Factory, Data Lake Gen2, Synapse, Databricks Spark, Structured Streaming, Delta Lake, Parquet SQL, Python Time-series DBs (Azure Data Explorer, InfluxDB, TimescaleDB) Familiarity with Medallion architecture, schema evolution, cost optimisation, and system observability. Track record of mentoring internal teams and embedding best practices in technical delivery. More ❯

months | 💷 Competitive Day Rate We are supporting a leading client in Financial Services who are at the early stages of building a new enterprise Data Lake on Azure Cloud . To deliver this programme, we’re looking for experienced Contract Data Engineers with proven expertise in Databricks and Snowflake , available for immediate engagement. The role … Snowflake Work closely with architects and stakeholders to define data architecture, storage, and integration patterns Contribute to the build of a secure, production-ready Data Lake from the ground up Support best practices across data quality, governance, and CI/CD You will bring: Strong commercial experience as a Data Engineer … End-to-end project exposure, ideally from greenfield/early-stage Data Lake builds Deep hands-on knowledge of Databricks (Spark, Delta Lake, ML pipelines) and Snowflake (warehousing, optimisation, security) Solid understanding of Azure Cloud services (Data Factory, Synapse, Storage, DevOps) Strong SQL, Python, and ETL/ELT background Contract details: Start: ASAP Duration More ❯

Senior Data SME - Job Description Experience : 15+ years Experience in all 4 platforms, Business Platform, Technology platform, Enablement platform, Foundation Platform Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver … data solutions and integration pipelines in accordance with agreed organizational standards that ensure services are resilient, scalable and future-proof Collaborate with cross-functional teams to define and implement cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data … of traditional and distributed computing paradigm. Experience in designing and building scalable data pipelines. Should have excellent knowledge in data warehouse/data lake technology and business intelligence concepts Should have good knowledge in Relational, No-SQL, Big Data Databases and should be able to write complex SQL queries Should have More ❯

Senior Data SME - Job Description Experience : 15+ years Experience in all 4 platforms, Business Platform, Technology platform, Enablement platform, Foundation Platform Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver … data solutions and integration pipelines in accordance with agreed organizational standards that ensure services are resilient, scalable and future-proof Collaborate with cross-functional teams to define and implement cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data … of traditional and distributed computing paradigm. Experience in designing and building scalable data pipelines. Should have excellent knowledge in data warehouse/data lake technology and business intelligence concepts Should have good knowledge in Relational, No-SQL, Big Data Databases and should be able to write complex SQL queries Should have More ❯

of this document, please get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “ Application Support Request” Role: Senior GCP Data Engineer. Job Type: Permanent Location: London, UK (Hybrid - 2 days WFO) Number of hours: 40 hours per week – full time We have an exciting opportunity for you as a … GCP Data Engineer. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide. For … leadership. Gain access to endless learning opportunities. Lead projects and inspire both colleagues and stakeholders. Lead a team and their technical growth. The Role As a Senior GCP Data Engineer you will be responsible for providing top-tier data capabilities, leveraging your engineering skills, and embracing the possibilities offered by cloud technology. Key responsibilities: API Development More ❯

of this document, please get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “ Application Support Request” Role: Senior GCP Data Engineer. Job Type: Permanent Location: London, UK (Hybrid - 2 days WFO) Number of hours: 40 hours per week – full time We have an exciting opportunity for you as a … GCP Data Engineer. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide. For … leadership. Gain access to endless learning opportunities. Lead projects and inspire both colleagues and stakeholders. Lead a team and their technical growth. The Role As a Senior GCP Data Engineer you will be responsible for providing top-tier data capabilities, leveraging your engineering skills, and embracing the possibilities offered by cloud technology. Key responsibilities: API Development More ❯

Data Architect London Area, United Kingdom (Hybrid) Salary: £110,000 basic Summary We’re seeking a highly skilled Data Architect to take ownership of the organisation’s enterprise data strategy and architecture. This is a senior role responsible for designing scalable, secure, and future-ready data solutions that enable business growth, innovation … and data-driven decision-making. Objectives Define and deliver an enterprise-wide data architecture roadmap . Collaborate with senior stakeholders to align data strategy with business objectives. Ensure data platforms and solutions are resilient, secure, and compliant . Promote best practices in data modelling, governance, and integration across the organisation. … Responsibilities Design and optimise the enterprise data landscape , including data models, storage, and integration layers. Implement and oversee data governance frameworks , covering quality, security, and compliance. Partner with analytics, BI, and data science teams to enable scalable and consistent access to data . Provide guidance on data ingestion More ❯

Data Architect London Area, United Kingdom (Hybrid) Salary: £110,000 basic Summary We’re seeking a highly skilled Data Architect to take ownership of the organisation’s enterprise data strategy and architecture. This is a senior role responsible for designing scalable, secure, and future-ready data solutions that enable business growth, innovation … and data-driven decision-making. Objectives Define and deliver an enterprise-wide data architecture roadmap . Collaborate with senior stakeholders to align data strategy with business objectives. Ensure data platforms and solutions are resilient, secure, and compliant . Promote best practices in data modelling, governance, and integration across the organisation. … Responsibilities Design and optimise the enterprise data landscape , including data models, storage, and integration layers. Implement and oversee data governance frameworks , covering quality, security, and compliance. Partner with analytics, BI, and data science teams to enable scalable and consistent access to data . Provide guidance on data ingestion More ❯

About the Opportunity This is a rare opportunity for a Data Engineer to work at the intersection of cutting-edge technology and elite sports performance. You’ll join a collaborative, high-standard engineering team with a culture built around creativity, innovation, and excellence. In this role, you’ll play a key part in designing and developing scalable data … football world—including performance insights for some of the most well-known footballers in the industry . This is the perfect environment for those passionate about leveraging advanced data engineering to drive real-world results in sports analytics. Key Responsibilities Design, build, test, and maintain scalable and high-performance data pipelines Ensure all systems adhere to … data scientists, analysts, and performance experts to enable end-to-end data workflows Own the architecture and maintenance of a GCP-based data lake/lakehouse environment Your Background 4+ years of industry experience in Data Engineering roles Advanced-level Python for data applications and high proficiency in SQL More ❯

About the Opportunity This is a rare opportunity for a Data Engineer to work at the intersection of cutting-edge technology and elite sports performance. You’ll join a collaborative, high-standard engineering team with a culture built around creativity, innovation, and excellence. In this role, you’ll play a key part in designing and developing scalable data … football world—including performance insights for some of the most well-known footballers in the industry . This is the perfect environment for those passionate about leveraging advanced data engineering to drive real-world results in sports analytics. Key Responsibilities Design, build, test, and maintain scalable and high-performance data pipelines Ensure all systems adhere to … data scientists, analysts, and performance experts to enable end-to-end data workflows Own the architecture and maintenance of a GCP-based data lake/lakehouse environment Your Background 4+ years of industry experience in Data Engineering roles Advanced-level Python for data applications and high proficiency in SQL More ❯

Title: Data Transformation leader Work Location: London Work from Office : 3 days per week (Hybrid model) Experience: 12-18 Years We at Coforge are hiring Data Solution Architect professional for London. About the Role We are seeking an accomplished Senior Data Leader to spearhead a high-impact data transformation programme for a … leading UK insurance client . This is a critical role that requires strong leadership, deep expertise in enterprise data strategy, and proven delivery of large-scale data initiatives in complex, regulated environments. The successful candidate will be accountable for shaping, governing, and delivering data capabilities that drive business value, regulatory compliance, and digital transformation … outcomes. Key Responsibilities Data Strategy & Governance: Define and implement a robust enterprise data strategy , aligned with client’s insurance business priorities. Establish data governance frameworks , policies, and operating models ensuring data quality, lineage, and compliance with UK/EU regulations (FCA, PRA, GDPR, Solvency II). Data Transformation & Architecture: Lead More ❯

Title: Data Transformation leader Work Location: London Work from Office : 3 days per week (Hybrid model) Experience: 12-18 Years We at Coforge are hiring Data Solution Architect professional for London. About the Role We are seeking an accomplished Senior Data Leader to spearhead a high-impact data transformation programme for a … leading UK insurance client . This is a critical role that requires strong leadership, deep expertise in enterprise data strategy, and proven delivery of large-scale data initiatives in complex, regulated environments. The successful candidate will be accountable for shaping, governing, and delivering data capabilities that drive business value, regulatory compliance, and digital transformation … outcomes. Key Responsibilities Data Strategy & Governance: Define and implement a robust enterprise data strategy , aligned with client’s insurance business priorities. Establish data governance frameworks , policies, and operating models ensuring data quality, lineage, and compliance with UK/EU regulations (FCA, PRA, GDPR, Solvency II). Data Transformation & Architecture: Lead More ❯

Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Description: We are looking for a seasoned AWS Data Engineer to join our team and contribute to the development of scalable, secure, and high-performance data solutions. This role involves modernizing mainframe legacy systems, building robust … data pipelines, and enabling advanced analytics using AWS-native technologies. You’ll collaborate with cross-functional teams and play a key role in shaping our data strategy. Skills Must have : Proven experience in designing and maintaining scalable data lakes using AWS S3, with strong understanding of data lifecycle, access control, and performance … AWS CloudFormation and Terraform to automate and manage cloud resources. Experience developing ETL workflows using AWS Glue, querying data with Athena, and managing access and governance with Lake Formation. Strong command of AWS Lambda for serverless data processing and Boto3 for programmatic interaction with AWS services. Demonstrated experience working with GDPR-compliant architectures and handling More ❯

Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Description: We are looking for a seasoned AWS Data Engineer to join our team and contribute to the development of scalable, secure, and high-performance data solutions. This role involves modernizing mainframe legacy systems, building robust … data pipelines, and enabling advanced analytics using AWS-native technologies. You’ll collaborate with cross-functional teams and play a key role in shaping our data strategy. Skills Must have : Proven experience in designing and maintaining scalable data lakes using AWS S3, with strong understanding of data lifecycle, access control, and performance … AWS CloudFormation and Terraform to automate and manage cloud resources. Experience developing ETL workflows using AWS Glue, querying data with Athena, and managing access and governance with Lake Formation. Strong command of AWS Lambda for serverless data processing and Boto3 for programmatic interaction with AWS services. Demonstrated experience working with GDPR-compliant architectures and handling More ❯

to work with an organisation that’s passionate about your learning journey and committed to your professional career and personal development. Role Overview We are currently seeking a Data Analyst to come join our Cyber team here at Albany Beck. As a Data Analyst, you will play a critical role in designing and embedding our client … s data mesh, plugging in and managing multiple source data streams, and developing meaningful dashboards that bring clarity to over 400+ risk metrics. You’ll combine strong technical expertise with stakeholder engagement skills to ensure data is not just cleansed, but truly understood, contextualised, and actionable. Key Responsibilities Plug in and manage multiple source … ensuring data integrity and governance. Review, manage, and improve 400–500 Cyber & Risk metrics, positioning them effectively for senior leadership. Support the transition from data lake to data mesh, enabling data to be materialised, accessed, and visualised with ease. Develop and maintain Power BI dashboards, ensuring metrics are clearly presented and More ❯

to work with an organisation that’s passionate about your learning journey and committed to your professional career and personal development. Role Overview We are currently seeking a Data Analyst to come join our Cyber team here at Albany Beck. As a Data Analyst, you will play a critical role in designing and embedding our client … s data mesh, plugging in and managing multiple source data streams, and developing meaningful dashboards that bring clarity to over 400+ risk metrics. You’ll combine strong technical expertise with stakeholder engagement skills to ensure data is not just cleansed, but truly understood, contextualised, and actionable. Key Responsibilities Plug in and manage multiple source … ensuring data integrity and governance. Review, manage, and improve 400–500 Cyber & Risk metrics, positioning them effectively for senior leadership. Support the transition from data lake to data mesh, enabling data to be materialised, accessed, and visualised with ease. Develop and maintain Power BI dashboards, ensuring metrics are clearly presented and More ❯

evolving Lloyds managing agent thats leading the way across multiple lines, including Property, Casualty, and Specialty. As part of a major transformation, theyre building a modern, business-driven data platform from the ground up and theyre looking for a Senior Data Engineer to help shape it. About the Business This Lloyds managing agent is authorised and … regulated by the PRA and FCA, managing a high-performing syndicate. They are known for underwriting excellence and are investing heavily in data and technology to support their long-term growth. Why this role? You'll play a key role in delivering a robust, scalable data platform that unlocks better MI, improves data quality … This is a genuinely exciting opportunity to influence the data direction of a Lloyds business, not just maintain it. Key responsibilities: Design and build Data Lake and Data Warehouse solutions Create scalable, automated batch and streaming data pipelines Optimise metadata, catalogue, lineage, and data quality processes Support business teams More ❯

Senior Data Engineer Salary up to £65,000 Remote First, in office 1 x a month This retailer is scaling their digital and analytics capabilities, they are looking for a Senior Data Engineer with deep expertise in the Azure ecosystem to help architect and optimise their modern data platform. In this critical role, you … ll design and maintain secure, scalable, and high-performance data pipelines and storage solutions. Working cross-functionally, you’ll enable data-driven decision-making across the business – from supply chain to customer insights. What … You’ll Be Doing Design and manage scalable data pipelines using Azure Data Factory, Synapse Analytics, and Databricks. Optimise and structure Azure Data Lake Storage Gen2 for performance, security, and scalability. Develop efficient data wrangling processes for structured and semi-structured data. Use SQL and Python to build robust data More ❯

Senior Data Architect is required by this SaaS vendor operating within the Retail sector, where you will oversee conceptual and logical data systems, adhering to existing data strategies. You'll design data solutions to optimise and improve the product offering. Ideally you can demonstrate experience across - Full data production life … cycle Conceptual and logical data designs Data modelling (3NF) Data mining Data Vaults/Kimball methodology Azure Cloud Services - Databricks, ADF, CosmosDB, Azure SQL Data warehouse design, Data lakes/lakehouses Working with both structured and unstructured data is essential Stakeholder engagement across business and data More ❯

Senior Data Architect 100 Liverpool street, London – hybrid Contract to 31st March Inside ir35 About the role My client are seeking a highly experienced and strategic Technical Data Architect to join our team in corporate and investment banking (primary and secondary markets). This senior-level role needs to be a leader with deep technical expertise … knowledge, and the ability to influence stakeholders inside our local regional entity and the global group. The ideal candidate will work with current architects to drive our Technical Data Strategy, ensuring alignment with enterprise architecture and business goals. Responsibilities • Role will be responsible for developing solution designs for a portfolio of projects across the EMEA entity and overseeing … solution designs developed by others. With a focus on data solutions to be delivered by the EMEA Data and Analytics technology team. • Collaborating with colleagues in other entities across the global group to share thinking, define technical strategy and drive its consist application where possible. • Working with the Data Office to understand requirements and More ❯

Senior Data Architect 100 Liverpool street, London – hybrid Contract to 31st March Inside ir35 About the role My client are seeking a highly experienced and strategic Technical Data Architect to join our team in corporate and investment banking (primary and secondary markets). This senior-level role needs to be a leader with deep technical expertise … knowledge, and the ability to influence stakeholders inside our local regional entity and the global group. The ideal candidate will work with current architects to drive our Technical Data Strategy, ensuring alignment with enterprise architecture and business goals. Responsibilities • Role will be responsible for developing solution designs for a portfolio of projects across the EMEA entity and overseeing … solution designs developed by others. With a focus on data solutions to be delivered by the EMEA Data and Analytics technology team. • Collaborating with colleagues in other entities across the global group to share thinking, define technical strategy and drive its consist application where possible. • Working with the Data Office to understand requirements and More ❯

Are you're ready to lead data strategy in a high-growth business in one of the most dynamic sectors globally, we want to hear from you. Apply now and be part of a team that’s redefining intelligence for the digital age. Role Summary TMT Finance, the leading intelligence platform for global Digital Infrastructure M&A and … financing, is seeking a visionary Head of Data to lead the next phase of our data strategy and operations. This high-impact leadership role is at the intersection of finance, technology, and infrastructure - where your work will directly shape how the world’s top dealmakers’ access and use proprietary data. You’ll be at the forefront … team (12 people), with regular travel to Mumbai and a focus on coaching, development, and scaling. Data Architecture & Governance: Establish a unified data lake and implement best-in-class governance, tooling, and quality control processes. Editorial Collaboration: Work closely with the Editorial team to integrate data, analysis, and visualisations into content More ❯

Are you're ready to lead data strategy in a high-growth business in one of the most dynamic sectors globally, we want to hear from you. Apply now and be part of a team that’s redefining intelligence for the digital age. Role Summary TMT Finance, the leading intelligence platform for global Digital Infrastructure M&A and … financing, is seeking a visionary Head of Data to lead the next phase of our data strategy and operations. This high-impact leadership role is at the intersection of finance, technology, and infrastructure - where your work will directly shape how the world’s top dealmakers’ access and use proprietary data. You’ll be at the forefront … team (12 people), with regular travel to Mumbai and a focus on coaching, development, and scaling. Data Architecture & Governance: Establish a unified data lake and implement best-in-class governance, tooling, and quality control processes. Editorial Collaboration: Work closely with the Editorial team to integrate data, analysis, and visualisations into content More ❯

of this role is to develop, maintain and, where necessary, provide support to end users for Infor Sun Systems and associated products (Bank Reconciliation, Q&A, Data lake, interfaces etc), You will work within the Financial Systems team and your stakeholder/s with be the wider finance functionYou will have design authority and be encourage to … Development and maintenance of existing processes requiring SQL or VBA expertise. Be team representative responsible for liaising with Group Technology on technical issues (e.g. Interface/Data Lake/SQL/Server/Database issues) Continually review and make recommendations for improvement tools, systems, and process. Co-ordinate the annual audit user reviews for Sun systems Support … the Finance Systems Accounting team where necessary. SKILLS/EXPERIENCE REQUIRED: Understanding of data structures and experience of extracting and utilising data to drive key strategic decisions, including the production of insightful analysis. Financial controls and an appreciation for financial/management accounting Strong communication and Stakeholder management skills. Systems development and change control. Sun Super More ❯