226 to 250 of 277 Data Lake Jobs in London

Head of Data Engineering Description of Role and Client: The Head of Data Engineering will lead the technical development and operational management of data engineering solutions for a prominent insurance organization. The client requires a data engineering expert capable of managing complex environments and collaborating with senior technical teams. This role falls … inside IR35. Responsibilities: Design, develop, and manage data pipelines, warehouses, and data lakes. Optimize and maintain enterprise data engineering platforms. Lead strategic management of data engineering solutions across cloud and hybrid environments. Collaborate closely with Data Architects, CIO teams, and senior stakeholders. Continuously enhance the efficiency, reliability, and scalability of … data engineering landscapes. Candidate Requirements/Profile: Extensive data engineering experience within insurance sectors. Proficiency with AWS, Azure, GCP, and hybrid data environments. Relevant certifications in cloud platforms or big data technologies. Demonstrated ability to strategically own and enhance enterprise data platforms. Contract duration: Initial 6-month term, with likely More ❯

Head of Data Engineering Description of Role and Client: The Head of Data Engineering will lead the technical development and operational management of data engineering solutions for a prominent insurance organization. The client requires a data engineering expert capable of managing complex environments and collaborating with senior technical teams. This role falls … inside IR35. Responsibilities: Design, develop, and manage data pipelines, warehouses, and data lakes. Optimize and maintain enterprise data engineering platforms. Lead strategic management of data engineering solutions across cloud and hybrid environments. Collaborate closely with Data Architects, CIO teams, and senior stakeholders. Continuously enhance the efficiency, reliability, and scalability of … data engineering landscapes. Candidate Requirements/Profile: Extensive data engineering experience within insurance sectors. Proficiency with AWS, Azure, GCP, and hybrid data environments. Relevant certifications in cloud platforms or big data technologies. Demonstrated ability to strategically own and enhance enterprise data platforms. Contract duration: Initial 6-month term, with likely More ❯

Job Details: Enterprise Data Governance & Architecture Lead Job Title: Enterprise Data Governance & Architecture Lead Reports to: Head of Technology Data, Architecture & Technology Strategy Department: Technology Location: Leeds/Manchester/Bristol/Glasgow DEPARTMENT DESCRIPTION The Data Platform team is a key component of C4's Technology organization that provides an enriched … and valuable ecosystem of data platform and data services that drive innovation for our partners and clients, within C4. Data is the most valuable asset in C4. The Data Platform Department is dedicated to developing advanced technology (e.g. Cloud, Machine Learning and Big Data), systems and services to make data secure, high quality, rich, fast, and easy to use, enabling C4 to leverage its data asset effectively and timely to maximize technology/business development and differentiate C4 from others in the Broadcast and Media industry. JOB PURPOSE Your role as Data Governance & Architecture Lead in the DATS Team is to act as one More ❯

individual without security clearance is welcome to apply and will always be considered for this or wider opportunities in CGI, where appropriate. We're looking to grow our Data Office team, working directly with the client to ensure that all aspects of their Data Management strategy are delivered. Data Modelling Design and develop Conceptual … Logical, and Physical Data Models to support robust data architectures. Produce high-quality documentation including data dictionaries, database designs, and data flow diagrams. Work with Ontologies and Knowledge Graphs to enhance semantic understanding of data. Apply modelling languages such as UML or Express-G to effectively communicate data structures. Data Standards & Governance Lead efforts to assure systems and data models against internal and industry standards. Develop, promote, and govern data standards across teams and business units. Act as a champion for data quality and consistency, influencing stakeholders to adopt best practices. Design and implement Data Catalogues and Metadata Repositories to More ❯

individual without security clearance is welcome to apply and will always be considered for this or wider opportunities in CGI, where appropriate. We're looking to grow our Data Office team, working directly with the client to ensure that all aspects of their Data Management strategy are delivered. Your future duties and responsibilities As a Technical … BA you will be responsible for: Data Modelling Design and develop Conceptual, Logical, and Physical Data Models to support robust data architectures. Produce high-quality documentation including data dictionaries, database designs, and data flow diagrams. Work with Ontologies and Knowledge Graphs to enhance semantic understanding of data. Utilise modelling tools … such as Visio, Sparx Enterprise Architect, or Draw.IO. Apply modelling languages such as UML or Express-G to effectively communicate data structures. Data Standards & Governance Author and maintain detailed technical specifications and documentation. Lead efforts to assure systems and data models against internal and industry standards. Develop, promote, and govern data standards More ❯

Octopus Energy, a leading force in the energy sector, is seeking a Data Engineer to join their Energy Markets team. This role sits at the intersection of energy trading, forecasting, and technological innovation, supporting the company's mission towards Net Zero transition. The position offers a unique opportunity to work with complex data engineering challenges while … contributing to sustainable energy solutions. As a Data Engineer, you'll be responsible for designing and maintaining critical data pipelines that support core trading, forecasting, risk, and PPA processes across all Octopus international regions. The role leverages a modern tech stack including SQL, Python, Airflow, Kubernetes, and various other cutting-edge technologies. You'll work with … risk and PPA processes Develop automations and alerts for pipeline monitoring Set up and maintain processes for capturing, preparing and loading data into the data lake Design and build operational dashboards Work with international teams to ensure best practices and code standardization Take ownership of data platform improvements Share knowledge and upskill team More ❯

diverse technical and business teams. Candidate Requirements/Profile: Significant enterprise architecture experience in insurance environments. Expertise in application integrations, APIs, and architectural frameworks. Knowledge of Oracle, Snowflake, data lakes, and extensive data warehouses. Strong skills in security, risk management, and compliance. Excellent stakeholder communication and engagement capabilities. Onsite attendance three times weekly at the client More ❯

diverse technical and business teams. Candidate Requirements/Profile: Significant enterprise architecture experience in insurance environments. Expertise in application integrations, APIs, and architectural frameworks. Knowledge of Oracle, Snowflake, data lakes, and extensive data warehouses. Strong skills in security, risk management, and compliance. Excellent stakeholder communication and engagement capabilities. Onsite attendance three times weekly at the client More ❯

or OMP) and Analytics Platforms will be supported by multiple Initiatives that are based on SAP & non-SAP Technologies like BTP-Datasphere, SAP Analytics Cloud, Mars Data Lake and possibly other common edge systems to enable interoperability and further adherence to Mars Inc Operating Model. Moreover, this new tech ecosystem will have to interact with the specific … to Business Integrator (BI) and Systems Integrator (SI) teams regarding Process Governance, Enterprise tools like Signavio, SAP Solutions Manager, SAP CALM, SAP BODS, Info Steward, ER Studio, Datasphere, One Lake, LeanIX and ServiceNow Provide guidance to BI and SI teams on end-to-end business processes execution with Edge systems. Work collaboratively with SAP and Non-SAP Infrastructure, Cloud … record of delivering results in the following Business Capabilities/Solutions: E2E Planning, WMS, OMS, PLM, Logistics, Financial Systems, Sales & Marketing systems, Data Warehouse, Data Lake and overall Enterprise Architecture. What will be your key responsibilities? Royal Canin Transformation Architect Leadership (leading the EOS architecture team): Develop and maintain enterprise architecture goals, segment strategies, industry More ❯

or OMP) and Analytics Platforms will be supported by multiple Initiatives that are based on SAP & non-SAP Technologies like BTP-Datasphere, SAP Analytics Cloud, Mars Data Lake and possibly other common edge systems to enable interoperability and further adherence to Mars Inc Operating Model. Moreover, this new tech ecosystem will have to interact with the specific … to Business Integrator (BI) and Systems Integrator (SI) teams regarding Process Governance, Enterprise tools like Signavio, SAP Solutions Manager, SAP CALM, SAP BODS, Info Steward, ER Studio, Datasphere, One Lake, LeanIX and ServiceNow Provide guidance to BI and SI teams on end-to-end business processes execution with Edge systems. Work collaboratively with SAP and Non-SAP Infrastructure, Cloud … record of delivering results in the following Business Capabilities/Solutions: E2E Planning, WMS, OMS, PLM, Logistics, Financial Systems, Sales & Marketing systems, Data Warehouse, Data Lake and overall Enterprise Architecture. What will be your key responsibilities? Royal Canin Transformation Architect Leadership (leading the EOS architecture team): Develop and maintain enterprise architecture goals, segment strategies, industry More ❯

My client is a high-growth Ad-Tech company using advanced machine learning to transform how digital advertising works. Their platform handles vast amounts of data to deliver real-time, actionable insights for marketing teams around the world. They foster a collaborative, inclusive environment where engineers are empowered to shape the technology and contribute meaningfully to the product. … Developer to help them on their journey. The Role This is a senior-level, hands-on backend engineering role. You’ll design and maintain scalable backend services and data pipelines that power their core machine learning platform. You’ll work closely with cross-functional teams to ensure systems are robust, efficient, and production-ready. Key Responsibilities Design, develop … and maintain backend services and APIs using Python - FastAPI Build and optimise ETL pipelines for large-scale data processing Integrate third-party APIs and data sources Ensure code is clean, well-tested, and performance-optimised Collaborate with DevOps and Data Science teams to ensure smooth deployment and monitoring of services Requirements Strong Python skills More ❯

and interpersonal skills, with the ability to effectively collaborate with cross-functional teams Strong problem-solving and decision-making abilities Knowledge of agile project management methodologies Experience with data analysis and reporting Ability to adapt to changing priorities and work well under pressure Project management certification (e.g., PMP) is a plus Bachelor's degree in a relevant field … Real-Time Monitoring : Implement AI algorithms to detect and flag unusual transactions in real-time. Predictive Analytics : Use machine learning models to predict potential fraud based on historical data and behavioural patterns. 3. Loan Processing Automation Credit Scoring : AI can evaluate creditworthiness more accurately by analyzing a wider range of data points. Document Verification : Automate the … main emphasis of this position to is harness the data from a variety of data tables at the bank and collate a Data Lake from which to extract a variety of AI reports to increase the banks customer strategy. By strategically implementing AI in these areas, a Digital Banking Operations Manager can greatly More ❯

microservices-based integration strategies for PolicyCenter, BillingCenter, ClaimCenter, Reinsurance Management. Establish best practices for Guidewire DataHub, InfoCenter, and AI-driven analytics solutions. Drive legacy system modernization and define data migration strategies from on-premises systems to Guidewire Cloud. Ensure compliance with regulatory, security, and industry standards for insurance and reinsurance businesses. Solution and Develop Guidewire Cloud based API … s. System Integration & Implementation: Lead end-to-end integration between Guidewire applications and external platforms like CRM, Payments, AI models, Data Lakes, Catastrophe Risk Modelling Systems (RMS, AIR). Define cloud adoption roadmaps, hybrid cloud strategies, and multi-cloud deployments. Guide implementation teams on Guidewire configurations, extensions, and customization for all lines of Business and reinsurance workflows. Oversee More ❯

Head of Data Science (hands on) - FinTech Head of Data Science role with a fast-growing B2B FinTech company, backed by multiple billionaires and a major global investment firm. You'll join an existing team of 2 Data Scientists within a wider business of 35 staff and report to the Chief Product Officer. The … CEO is a former Data Scientist, providing opportunities for knowledge exchange! The Head of Data Science will work on: Credit risk models: Collaborate with the Chief Risk Officer to develop advanced machine learning models. Affordability models: Utilize bureau and open banking data to create transaction classification models and determine safe borrowing limits for individual … services. Data analytics tech: Partner with the CTO and developers to establish optimal data and analytics environments, including rapid model deployment and data lake creation using AWS Lake Formation. Apply now for this Head of Data Science role with a rapidly growing FinTech. More ❯

DATA ENGINEER LONDON BASED £35,000-40,000 PER ANNUM This UK-based software … firm is searching for a new Data Engineer, you will be joining their product engineering organisation, and will be responsible for building a new data lake in GCP. You will also be responsible for building new data pipelines in Python. THE COMPANY The company works within the Adtech space and is responsible for … implementing best coding practices within the team and will be using Python to code. Work collaboratively with the data science team, to create a data lake using GCP. Build and maintain Data Pipelines using Python. Develop real-time streaming features using big data tools such as Spark. SKILLS AND EXPERIENCE Extensive More ❯

Data Engineer - Active SC + NPPV3 Clearance Up to £550 per day (Outside IR35) 3 months initially Primarily Remote (Must be UK-based) My client is a major International Consultancy who urgently require Senior Data Engineers with active (SC) Security and NPPV3 Clearance to work with an end client. Key Requirements: Commercial experience as a Senior … Data Engineer, with an active SC + NPPV3 Clearance Experience with Azure Data Factory for building and orchestrating data pipelines Experience with Databricks for Data transformation Experience with Azure Synapse Familiar with Azure Data Lake Active SC Clearance +NPPV3 Clearance Nice to have: Immediate availability Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of More ❯

Role: Data & Migration Workstream Lead Location: London (Oxford Circus) Hybrid: 1-2 days per week in the office About Monument Technology Limited In building its core UK banking business, Monument has developed an open, scalable, cloud native and world-leading banking technology platform, the third pillar of the Banks strategy, which has allowed it to make significant inroads … deploy, scale and innovate at a fraction of the cost. From front end mobile apps, through core banking and CRM to the general ledger and a data lake, the platform can be consumed in whole ( bank in a box ) or in part as required. Our technology stack has gained positive attention from multiple players globally and over … empowering business in the UK and Neo Banks globally to revitalise their existing technology stacks and to develop innovative new platforms. We re looking for a highly experienced Data & Migration Workstream Lead to drive the planning, execution, and delivery of all data-related activities across multiple complex projects and workstreams. This is a hands-on leadership More ❯

Role: Data & Migration Workstream Lead Location: London (Oxford Circus) Hybrid: 1-2 days per week in the office About Monument Technology Limited In building its core UK banking business, Monument has developed an open, scalable, cloud native and world-leading banking technology platform, the third pillar of the Banks’ strategy, which has allowed it to make significant inroads … deploy, scale and innovate at a fraction of the cost. From front end mobile apps, through core banking and CRM to the general ledger and a data lake, the platform can be consumed in whole (“bank in a box”) or in part as required. Our technology stack has gained positive attention from multiple players globally and over … Our dynamic integration frame and architecture allows the platform to scale globally with many components adaptable to other geographies. THE ROLE We’re looking for a highly experienced Data & Migration Workstream Lead to drive the planning, execution, and delivery of all data-related activities across multiple complex projects and workstreams. This is a hands-on leadership More ❯

Role: Data & Migration Workstream Lead Location: London (Oxford Circus) Hybrid: 1-2 days per week in the office About Monument Technology Limited In building its core UK banking business, Monument has developed an open, scalable, cloud native and world-leading banking technology platform, the third pillar of the Banks’ strategy, which has allowed it to make significant inroads … deploy, scale and innovate at a fraction of the cost. From front end mobile apps, through core banking and CRM to the general ledger and a data lake, the platform can be consumed in whole (“bank in a box”) or in part as required. Our technology stack has gained positive attention from multiple players globally and over … Our dynamic integration frame and architecture allows the platform to scale globally with many components adaptable to other geographies. THE ROLE We’re looking for a highly experienced Data & Migration Workstream Lead to drive the planning, execution, and delivery of all data-related activities across multiple complex projects and workstreams. This is a hands-on leadership More ❯

Data Scientist II (Marketing Testing) page is loaded Data Scientist II (Marketing Testing) Apply locations UK - London time type Full time posted on Posted Today time left to apply End Date: July 6, 2025 (28 days left to apply) job requisition id R-95431 Expedia Group brands power global travel for everyone, everywhere. We design cutting … offices), and career development resources, all to fuel our employees' passion for travel and ensure a rewarding career journey. We're building a more open world. Join us. Data Scientist II (Marketing Testing) If you're as passionate as we are about using data to drive positive change and build an outstanding marketing experience, this may … be the role for you! We are looking for a hardworking and intelligent individual to fill the Data Scientist II role (Marketing Testing) within the Marketing Measurement Analytics team. You will provide powerful insights and recommendations that will shape how our EG brands advertise to customers. This is a great opportunity to join a fun, exciting, data More ❯

reviews, system architecture, and best practice implementation. Ensure software development aligns with industry standards, security protocols, and business goals. Coordinate with cross-functional teams including Product, QA, and Data teams. Work closely with stakeholders to define technical requirements and translate them into effective solutions. Drive continuous improvement in system reliability, security, and efficiency. Collaborate with data teams to develop data lakes and integrate AI-driven solutions. Why This Role? This is an opportunity to step into a leadership position where you will have full ownership of the development function and play a key role in shaping the company’s technological future. Apply now to learn more about the opportunity. More ❯

identity, access management, resource management, security and providing massively scaled, distributed platform capabilities to all of AWS. We enable our customers to control and secure the most sensitive data on the internet. We are building some of the largest and most complex distributed systems in the world, and we need brilliant engineering leaders to work with us on … more features within those services, than any other cloud provider-from infrastructure technologies like compute, storage, and databases-to emerging technologies, such as machine learning and artificial intelligence, data lakes and analytics, and Internet of Things. AWS Platform is the glue that holds the AWS ecosystem together. Whether its Identity features such as access management and sign on … We make recruiting decisions based on your experience and skills. We value your passion to discover, invent, simplify and build. Protecting your privacy and the security of your data is a longstanding top priority for Amazon. Please consult our Privacy Notice () to know more about how we collect, use and transfer the personal data of our More ❯

to present complicated technical information appropriately to business areas including architecture governance to enable informed decisions. • Excellent understanding of Microsoft Azure, with experience of: express route, data lake, Office 365, hybrid network architecture models, role-based access control, PaaS and IaaS. This is a little tastier of the role and a more detailed spec is available upon More ❯

to present complicated technical information appropriately to business areas including architecture governance to enable informed decisions. • Excellent understanding of Microsoft Azure, with experience of: express route, data lake, Office 365, hybrid network architecture models, role-based access control, PaaS and IaaS. This is a little tastier of the role and a more detailed spec is available upon More ❯

in leading or supporting network transition efforts to Azure or hybrid environments. Palo Alto Ecosystem: Deep experience with Palo Alto firewalls, Panorama, Prisma Access, GlobalProtect, Cortex Data Lake, and DLP. Application Layer Security: Proven experience configuring Layer 7 security and App-ID, ContentID, and User-ID policies. WAF & Zero Trust Implementations: Hands-on with WAF deployments (CloudFIare More ❯