19 of 19 Data Lake Jobs in the City of London

Role: Contract Business Analyst Domain: Shipping, maritime & energy Project: Data warehouse & data lake implementation Location: London (Hybrid) Rate: £700/d (Inside IR35) Contract: 6 months (multi-year scope) X4 Technology are partnered with a global energy leader on an exciting contract opportunity for a detail-orientated contract Business Analyst. You'll support the development … to optimise vessel operations across LNG and Products fleets. You'll play a key role designing, building and implementing large-scale data warehouse and data lake platforms , shaping how vessel performance data is captured, modelled and visualised within the dashboard. Requirements for the Business Analyst - Data Platforms in Shipping & Energy Proven … BA experience on large-scale Data Warehouse or Data Lake platform implementations, particularly in SAP or Azure Strong analytical skills with the ability to interpret complex datasets Excellent stakeholder management and communication skills Familiarity with data visualisation tools (eg Power BI , Tableau ) Nice to have: Experience in maritime, logistics, or energy sectors; exposure More ❯

An exciting opportunity has arisen to join a well established organisation in the insurance space, in a challenging Data Engineer role. There will be … a lot of stakeholder engagement, so the ideal candidate will have both hands on and business facing experience. Preferably in the insurance sector. Key responsibilities: Design Data Lake and Data Warehouse solutions. Design Data Models using Data Vault and Dimensional modelling methods Implement automated, reusable and efficient batch data pipelines and streaming data pipelines Work closely with Governance and Quality teams to ensure metadata, catalogue, lineage and known solutions to data issues are optimised Work closely with other data specialists and technicians in the organisation, such as Actuarial and Finance, to help with their data presentation requirements and help More ❯

maintain interactive Power BI dashboards and reports Extract, transform, and load (ETL) data from Salesforce , Simpro , Unleashed and other systems into the Microsoft Fabric Data Lake (OneLake) Build and manage data pipelines into Fabric using tools like Dataflows , Data Factory , or Synapse Pipelines Ensure seamless integration between Fabric Data Lake and Power BI semantic models Develop and optimize data models for performance, scalability, and usability Collaborate with business users to gather requirements and deliver self-service reporting solutions Maintain data quality, governance, and consistency across the reporting stack Support and maintain existing Power BI solutions, while also implementing new ones based on … including OneLake, Lakehouse , and data pipeline tools Hands-on experience extracting data from systems like Salesforce , Simpro , and ERP platforms into a data lake environment Strong DAX, Power Query (M), and SQL skills Familiarity with data modeling, ETL frameworks , and structured/unstructured data handling Knowledge of Power BI More ❯

totaled $13.8 billion. Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver data solutions and integration pipelines in accordance with agreed organizational standards that ensure services are resilient, scalable and … cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data platforms which involves Cloud & related technologies, Graph databases, Virtualization Technology Perspective Worked in multiple large distributed mission critical applications as an architect. Proven experience as architect and engineering lead … of traditional and distributed computing paradigm. Experience in designing and building scalable data pipelines. Should have excellent knowledge in data warehouse/data lake technology and business intelligence concepts Should have good knowledge in Relational, No-SQL, Big Data Databases and should be able to write complex SQL queries Should have More ❯

Location: London (Hybrid - 3 days in office) Salary: Up to £74,000 per annum Contract Type: Fixed Term (18 months) Are you a visionary Data Architect ready to shape the future of data in a world-renowned cultural institution? We're working with a prestigious organisation embarking on a major digital and data transformation … and they need a strategic and hands-on Data Architect to lead the charge. This is a rare opportunity to join a high-impact transformation programme at a pivotal moment. You'll be instrumental in designing and implementing the organisation's first enterprise-wide data strategy, building a trusted, AI-ready data estate, and … track record in enterprise data strategy and systems integration. Deep expertise in Azure data services e.g. Azure Data Factory, Azure Data Lake, Azure Synapse, Azure Databricks. Strong stakeholder engagement skills - able to translate complex data concepts into business value. Experience preparing data estates for AI/ML More ❯

Data Governance Lead Location: Hybrid (London or Remote, UK-based preferred) Team: Data & Scientific Computing Type: Full-time, Individual Contributor The Opportunity We’re looking for a Data Governance Lead to scale our internal data governance practice. You will work cross-functionally with data scientists, ML engineers, software developers, and … the challenge of building scalable governance foundations in a fast-moving R&D environment. What You'll Do Design and implement standards for metadata, documentation, structure, format , and data ownership , ensuring alignment with FAIR principles Coordinate data stewardship efforts across scientific and technical teams (e.g., Data Science, Machine Learning, Wet Lab, Discovery) Lead the … development and adoption of the internal data catalogue , enabling discoverability and traceability of datasets Support no-code exploration tools to empower scientists and lab users with intuitive data access Build robust documentation and governance workflows for versioning, data lineage, access, and retention Translate regulatory and licensing requirements into actionable workflows and policies Promote best More ❯

remote Benefits: Healthcare and great holidays The Role As a Machine Learning Operations Engineer, you will be instrumental in designing, deploying, and maintaining machine learning systems that drive data-driven decision-making in the pensions and financial services sector. Using Azure's cloud ecosystem, you will build scalable ML workflows that support actuarial modelling, risk prediction, and client … regression, ensemble methods, survival models) to improve predictions and automate core processes. 2. MLOps & Model Lifecycle Management * Own the end-to-end ML lifecycle using Azure ML pipelines, Data Factory (ADF), and ML tracking tools. * Implement CI/CD pipelines with Azure DevOps, ensuring robust version control, testing, and seamless deployment. * Monitor production ML systems for performance, data … performance over time. 3. Data Engineering & Preprocessing * Develop and maintain scalable ETL/ELT data pipelines using Azure Data Factory, Data Lake, and SQL. * Prepare and preprocess large datasets to ensure data quality and readiness for ML modelling and analytics workflows. 4. Software Engineering & Collaboration * Write clean, maintainable, and More ❯

Data Engineer – Data Consultancy A forward-thinking UK-based data consultancy is seeking talented Data Engineers to help clients unlock the full potential of their data assets. In this role, you’ll be instrumental in guiding organisations through the evolving landscape of data strategy, engineering, and analytics Key … the gap between business needs and technical solutions. Deliver high-impact work with precision, proactively identifying challenges and proposing smart, scalable solutions. Architect and maintain resilient, high-performance data pipelines (ETL/ELT) to ingest, transform, and deliver data from diverse sources. Required Skills & Experience: Deep expertise in building and deploying data solutions using … platforms like Databricks (Azure/AWS) , Microsoft Fabric , Azure Data Factory , and Azure Synapse . Solid experience with the Microsoft data stack —including SSIS , SSAS , and SSRS . A strong foundation in data disciplines such as governance , architecture , modelling , data lakes , warehousing , MDM , and BI . Advanced skills in SQL and Python More ❯

of this role is to develop, maintain and, where necessary, provide support to end users for Infor Sun Systems and associated products (Bank Reconciliation, Q&A, Data lake, interfaces etc), You will work within the Financial Systems team and your stakeholder/s with be the wider finance functionYou will have design authority and be encourage to … Development and maintenance of existing processes requiring SQL or VBA expertise. Be team representative responsible for liaising with Group Technology on technical issues (e.g. Interface/Data Lake/SQL/Server/Database issues) Continually review and make recommendations for improvement tools, systems, and process. Co-ordinate the annual audit user reviews for Sun systems Support … the Finance Systems Accounting team where necessary. SKILLS/EXPERIENCE REQUIRED: Understanding of data structures and experience of extracting and utilising data to drive key strategic decisions, including the production of insightful analysis. Financial controls and an appreciation for financial/management accounting Strong communication and Stakeholder management skills. Systems development and change control. Sun Super More ❯

trading platforms, and/or IBA systems). Architecting solutions with Microsoft Azure technologies, Sales force (including Force.com) technologies and modern data platforms (e.g. Data lake house architecture) and Business Intelligence (e.g. Microsoft Power BI) technologies Knowledge of Enterprise Architecture tools (experience in BizzDesign) Good knowledge and awareness of enterprise-grade CRM, HR and Finance More ❯

SQL, ETL, Azure Senior Data Engineer is required to join a forward-thinking data team within a thriving city-based insurance group. This role will see you playing a critical role in delivering reliable, scalable and business-focused data solutions. With a strong focus on Microsoft technologies and cloud-based tools, you’ll work … through data. The ideal candidate here will have a strong background in insurance MI or reporting—experience within an MGA or insurance carrier is essential. Key Responsibilities Deliver data solutions and changes that support evolving business requirements. Build and maintain robust, scalable data pipelines using SQL and ETL best practices. Collaborate with stakeholders to analyse, define … and implement solutions to complex data challenges. Proactively assess the impact of changes on the broader data model and ensure integrity is maintained. Work alongside the MI/reporting team to ensure data is accurately reflected in dashboards and reporting tools. Consult with business analysts, system owners and architects to align technical delivery with More ❯

in alignment with business priorities. Support the launch of new products and streamline maintenance of existing products. Technical Skills & Knowledge: Proven experience in technical architecture, including UIs, microservices, data lakes, APIs, RDBMS, and NoSQL databases. Strong understanding of Agile and SAFe methodologies. Experience designing solutions in distributed, resilient environments and integrating enterprise applications. Cloud architecture expertise (AWS preferred More ❯

to face time, hybrid out of one of the offices. This exciting opportunity will suit an experienced Python Developer who is well versed in modern AI, Cloud and data stacks. They are a big believer in sharing thoughts and encouraging and supporting innovation and creativity. The Python Developer will also be given the chance to be involved in … conception through to completion and launch. Python Developer Experience: * Python, including APIs, data structures, and async processing * Databricks/Microsoft Fabric * Cloud, preferably Azure (Data Lake, Functions, App Services) * Containerisation with Docker and CI/CD pipelines * MLOps tooling (MLFlow, Git-based versioning, environment tracking) Desirable Skills & Interests * LangChain, Langflow, or similar frameworks for building More ❯

point-to-site and site-to-site for high secure VPN connectivity from end user’s device and Sizewell C various offices and sites. Configuration of Data Lake storage, ensuring security hardening. Compliance of backup and restoration. Integration of IAAS, PAAS and SAAS application with Microsoft Entra ID (AAD) for secure access through SAML SSO. Maintain the More ❯

Permanent role - Junior Data Engineer/Developer - London/Hybrid/Remote Gibbs Consulting is looking for a self-motivated and focused Junior Data Engineer/Developer to join our internal team. If you're passionate about data, curious about the world of AI/ML, and eager to grow your technical capabilities in … to take the next step in your career. Essential Solid programming knowledge with Python Experience using Pandas, NumPy, Matplotlib, and PyTorch Strong understanding of SQL for querying and data manipulation Familiarity with CI/CD workflows and Git version control Detail-oriented and proactive problem solver Enthusiastic about using data to inform business decisions Collaborative team … player eager to learn and contribute Desirable Exposure to cloud platforms : GCP , Azure , or AWS Familiarity with Data Lakes , Data Warehouses , or LakeHouse architecture Interest in AI/ML and applied data science use cases Please feel free to contact myself - Daisy Nguyen at Gibbs Consulting for a confidential chat to know more details More ❯

Data Project | Insurance Im hiring a DevOps Engineer to join the technology division of a global insurance company, working on a major AWS-based data lake project . Youll be part of a collaborative, high-performing product team delivering secure, scalable cloud infrastructure that underpins innovative insurance products. Location: London Working Policy: 2 days in … Proven experience with CI/CD automation & high-availability systems Git proficiency Bonus: Python, cloud security, disaster recovery If you want to work on a large-scale AWS data platform for a global brand - please apply now. DevOps | AWS | Terraform | Data Project | Insurance More ❯

Data Analyst – Commercial Business Partnering Hybrid – 1–2 days/week in Central London £42,700–£53,700 + bonus If you're craving a hands-on analytics role that goes beyond the dashboards — where your insights directly inform pricing, product, market expansion, and revenue forecasting — this could be your next move. I’m working with a global … operating at the intersection of media, brand consultancy, and digital content , they’re building out a smarter, more scalable approach to commercial insight — and they’re hiring a Data Analyst to help drive that forward. The Role This is a rare standalone analytics role within the Commercial Business Partnering team — giving you end-to-end ownership of how … data supports decision-making across sales, marketing, pricing, publishing, and even venue launches. You’ll be partnering with stakeholders across five continents, creating actionable insights from systems like Salesforce, NetSuite, and Google Analytics , and working directly with the CFO. What You’ll Be Doing: Partnering with commercial teams to define, explore and answer business questions Connecting multiple data More ❯

Senior Consultant - MediaTech We’re working with a global consulting firm that partners with the most ambitious organisations to solve their most complex tech and data challenges. They’re currently hiring for senior IT consultants and architects to lead high-impact engagements focused on product-tech transformation in the media, B2B/B2C content, and data services sectors. You’ll work at the intersection of product architecture, cloud strategy, data platforms, and AI-enabled digital delivery, shaping the future of content, commerce, and customer intelligence. What You’ll Do Work with global media and information services clients to deliver end-to-end digital product strategies, cloud-native architectures, and transformation roadmaps. Design … and implement technical architectures for data-driven products, spanning platforms, APIs, integrations, and distributed systems. Lead the design and delivery of next-gen cloud and data solutions, using platforms like Azure, AWS, Snowflake, and Databricks. Collaborate with multidisciplinary teams to deliver scalable solutions that power real-time customer experiences, intelligent decisioning, and monetisation models. Provide architectural More ❯

DV Cleared Data Architect - Outside ir35 Contract Role - Onsite London/Cheltenham Empiric are looking for several experienced Data Architects with Active DV Clearance (Developed Vetting) for a long-term programme with a Public Sector customer of ours. Skills/Experience: Hands-on experience implementing and maintaining metadata repositories and data catalogues using tools … like Apache Atlas, Hive Metastore, AWS Glue, and AWS DataZone Experience designing pipelines, data lakes & warehouses Experience designing physical, logical, and conceptual data models to support scalable and maintainable systems. Tools like Visio & Spark are useful. Details: Onsite in either Central London or Cheltenham 12-month rolling contract basis Outside ir35 - £750+ depending on experience Must More ❯