26 to 50 of 59 Data Lake Jobs in London

Data Solution Architect - Databricks Location: UK Wide (Hybrid) Salary: Up to £110,000 + Bonus + Excellent Benefits Security Clearance: Must be eligible for SC Clearance The Opportunity We're recruiting for an experienced Data Solution Architect with strong Databricks expertise to join a leading technology … consultancy delivering large-scale data, analytics, AI and cloud transformation programmes. This role will see you designing and delivering modern data platforms, working closely with clients and technical teams to build scalable, secure and high-performing solutions using Databricks, Apache Spark and cloud technologies. ...

required Sole UK Nationals only Our client, a global technology consultancy, is looking to appoint a Senior Databricks Engineer to join a growing data engineering function delivering enterprise-scale analytics and data platform solutions. This is a senior, hands-on technical role within a small, highly … bring: Strong commercial experience with Databricks in enterprise environments Excellent SQL skills working with large, complex datasets Experience designing and building data lake or lakehouse architectures Proven experience developing data platforms from the ground up Knowledge of data modelling and reporting solutions, including ...

cleared Data Architect (AWS) - Public Sector Duration: 6 months Start Date: Flexible Rate: £550 - £700 (depending on SFIA level) Location: London or Manchester (hybrid) Clearance: SC Overview We're looking for a Data Architect to design secure, scalable AWS data platforms that support public … Drive best practices in data quality, integration, and lifecycle management Key Skills Strong AWS data experience (e.g., S3, Redshift, Glue, Lake Formation, Athena) Proven experience in public sector or regulated environments Data modelling (conceptual, logical, physical) expertise Knowledge of data governance ...

looking for a deeply technical Enterprise Architect who will own the delivery of AI projects end to end from the silicon and data center design that underpins AI workloads, through the software and MLOps stack, to the governance frameworks that make AI trustworthy and defensible at scale. This … QLoRA), RAG architecture design, vector databases (Pinecone, Milvus, Weaviate), and agentic frameworks (LangChain, LangGraph, Semantic Kernel). Data pipelines: data lake/lakehouse architectures, ETL/ELT, and data quality/lineage tooling that feed AI systems. Automation, Orchestration & Observability Infrastructure-as-code ...

Entry-level Data & AI Consultant role for individuals looking to build a career in data engineering and AI. You will work on real client projects, supporting the design and delivery of data pipelines, models, dashboards, and AI-driven solutions. This is not a passive … Support development of Power BI dashboards Assist in AI use cases (automation, simple models, insights) Work within Azure-based environments (Databricks, Data Lake, etc.) Test, validate, and document solutions Training Possible promotion within the organisation Moving onto a higher level apprenticeship Apprenticeship Standard Artificial intelligence ...

Data Engineering Lead - Value & Analytics Location: London or Edinburgh Working pattern: Hybrid working Start date: ASAP Employment type: Permanent Salary: £38,000 - £46,000 (+ £3,300 London Weighting) Level: Senior The Opportunity A leading international organisation specialising in education, cultural relations and global collaboration is looking … Data Engineering Lead to join its Value Management function. You will build the technical infrastructure that provides visibility of portfolio performance, strategic value and benefits realisation across a complex global organisation. Taking ownership of the data engineering and analytics capabilities behind the organisation's Value Dashboard ...

looking for an Analytics Engineer to join our client's high-performing Business Intelligence team, helping to build scalable, high-quality data solutions that power reporting, dashboards and self-service analytics across the business. Working closely with BI Developers and business stakeholders, you'll design and optimise …/ELT pipelines, develop curated data models, and translate business requirements into reliable backend data solutions. This is a fantastic opportunity for someone who enjoys solving complex data challenges and wants to work with modern cloud technologies in a collaborative, forward-thinking environment. What ...

ability to effectively collaborate with cross-functional teams Strong problem-solving and decision-making abilities Knowledge of agile project management methodologies Experience with data analysis and reporting Ability to adapt to changing priorities and work well under pressure Project management certification (e.g., PMP) is a plus Bachelor … harness the data from a variety of data tables at the bank and collate a Data Lake from which to extract a variety of AI reports to increase the banks customer strategy. By strategically implementing AI in these areas, a Digital Banking Operations ...

contract basis. Hybrid working - London based We combine deep domain expertise with innovative, bespoke delivery to help clients solve complex risk, data, AI, and technology challenges. As a Solutions Architect, you will play a pivotal role in shaping the design, engineering direction, and delivery quality of both client … management, and governance frameworks. Ability to balance strategic thinking with hands-on problem solving. Desirable Experience designing architectures involving Snowflake, Azure Data Lake, Databricks, or similar modern data platforms. Relevant cloud certifications (e.g. Azure Solutions Architect Expert). Experience working within regulated industries (finance ...

Senior Project Manager/Programme Manager – BI Data Reporting/BI Dashboard London, City - £(Apply online only) per day, outside IR35. Hybrid. Agile, BI, Data, Dashboard, Business Intelligence, Insurance The Company: Our client is a City of London-based specialist motor insurance specialist. The business … unsupportable and uncertain data and BI environment, in essence transforming myriad ‘data puddles’ into a comprehensive ‘data lake’, informing decision making and enabling better CRM and client engagement. The incoming Programme Manager will be mandated to deliver this change, managing a series ...

based analytics tools delivering exposure, loss simulation and risk insights to underwriting teams Build and integrate solutions within a modern data lake architecture Design bespoke exposure calculation engines using Open Exposure Data (OED) formats Support AI-driven initiatives, including natural language querying and agentic workflows … Collaborate with Data, Infrastructure, Claims, Pricing and Underwriting teams Contribute to the development of a reinsurance results data warehouse and portfolio analytics capability Improve data quality, reconciliation processes and reporting frameworks Skills & Experience 3–5 years' software development experience Strong Python development skills with ...

Familiarity with school/trust Financial Management Systems (FMS). Knowledge of school/trust budget planning. Ability to manage a data lake, including data ingestion, storage, governance, and integration with analytics tools. Advanced proficiency in Microsoft Office suite. Strong customer relationship management skills. Skilled ...

relevant colleagues from SA practice and providing regular updates to assure timely progress and alignment with relevant stakeholders and teams like Security, AW data squads, ERP etc. Integration Landscape: Current integrations include: SAP (existing integration) GIS (new integration … requirement) Scheduled interfaces between SAP and current AIPM platform Existing pattern: Data flows between SAP, current AIPM platform, AW Data Lake exist GIS Integration: Limited data feeds being ingested by AW Data Lake. Architectural artefacts and governance Based on SI process ...

seeking a highly skilled IT Business Solutions Manager specialising in Data & Analytics within the Azure and IT domain to join our client. In this role, you will be instrumental in supporting Western European markets by designing, implementing, and evolving data-driven solutions to optimise decision-making. … Your primary focus will be on maximising data value through advanced analytical tools, robust project management, and a collaborative approach with global teams. You will oversee the full lifecycle of data solutions, from data ingestion and processing to insight generation and visualisation, ensuring compliance ...

seeking a highly skilled IT Business Solutions Manager specialising in Data & Analytics within the Azure and IT domain to join our client. In this role, you will be instrumental in supporting Western European markets by designing, implementing, and evolving data-driven solutions to optimise decision-making. … Your primary focus will be on maximising data value through advanced analytical tools, robust project management, and a collaborative approach with global teams. You will oversee the full lifecycle of data solutions, from data ingestion and processing to insight generation and visualisation, ensuring compliance ...

seamlessly integrated and consumed across the business. Furthermore, you will drive the integration of exposure tooling with the existing data lake architecture, ensuring data is stored and maintained in an appropriate format accessible to the latest AI technologies KEY REQUIREMENTS: Strong Python capabilities Strong Databricks … experience London Market experience is a plus AI experience is a bonus Experience in Property insurance and/or experience dealing with exposure data is highly desirable. Geospatial experience or experience working with geospatial datasets in Python is desirable. Experience with Catastrophe modelling software is advantageous ...

Data Platform Engineer (Microsoft Fabric & Python) 12 Month Contract | Inside IR35 | £480pd-£520pd We're seeking a hands-on Data Platform Engineer to own and evolve our Microsoft Fabric-based Enterprise Data & Analytics Platform (EDAP). This role is ideal for someone who combines … lead platform engineering initiatives while coaching a team of BI Developers in Fabric, Python and Spark, helping drive the organisation's data engineering capability forward. Key Responsibilities Development, support and enhancement of EDAP on Microsoft Fabric. Design and build scalable data pipelines and integrations. Set engineering ...

scale modernization programs, and fostering a culture of innovation. You will be at the forefront of transforming our legacy systems into a modern, data-enabled, and microservices-based architecture to support our growing business needs. Key Responsibilities Technology Leadership & Strategy: Define and execute a comprehensive technology roadmap … velocity, quality, and team morale. Manage relationships with key stakeholders, including business heads, product owners, and infrastructure teams, to ensure alignment and transparency. Data Enablement & Analytics: Develop and implement a robust data strategy to unlock the value of our securities finance data. Architect and build data ...

Cleared Data Architect | AWS/Azure | Government & Defence | Inside IR35 | £800 - £950 Are you a DV Cleared Data Architect who can engage with senior stakeholders just as effectively as you can design cloud data solutions? We're looking for experienced Data Architects … between technical delivery teams and business decision-makers. What we're looking for: Active DV Clearance Proven experience designing enterprise-scale data architectures Strong cloud expertise (AWS and/or Azure) Experience with modern data platforms, data lakes, and analytics solutions Ability to consult ...

solve business problems. Key responsibilities: Build web-based tools to deliver exposure and portfolio insights Integrate analytics platforms with modern data lake architecture Develop solutions using AI, natural language querying, and automation Support exposure and financial calculation engines using standard data formats Collaborate with Underwriting … Pricing, Claims, and Data teams A strong role at the intersection of development, data, and insurance analytics, with broad exposure to key business areas. Please apply for more information ...

Stepstone Group, we have a simple yetvery importantmission: The right job for everyone. Using our data, platform, and technology, we create opportunities for jobseekers and companies around the world to find a perfect match in fair andequitableway. With over 20 brands across 30+ countries, we strive for fair … market and becoming the worlds leading job platform. Job Description Join our team and youll be responsible for providing technical leadership for our Data Platform team, defining technical direction and driving architectural decisions across data, platform and infrastructure domains. Working in the Data Platform ...

Stepstone Group, we have a simple yetvery importantmission: The right job for everyone. Using our data, platform, and technology, we create opportunities for jobseekers and companies around the world to find a perfect match in fair andequitableway. With over 20 brands across 30+ countries, we strive for fair … market and becoming the worlds leading job platform. Job Description Join our team and youll be responsible for providing technical leadership for our Data Platform team, defining technical direction and driving architectural decisions across data, platform and infrastructure domains. Working in the Data Platform ...

network for the world’s money. For everyone, everywhere. Job Description We are seeking a talented quantitative developer to join our Treasury Markets Data Science team. This role focuses on owning and operating the production infrastructure behind our FX pricing, risk, and trading systems with the opportunity … financial markets experience Term structure modelling, stochastic calculus or Monte Carlo methods Interest rate curve bootstrapping Algorithmic execution experience Data lake or warehouse experience (Snowflake, Iceberg, Spark etc.) We’re people without borders—without judgement or prejudice, too. We want to work with the best people ...

design systems and write code today, not from a distance. Azure. Strong working knowledge of the Microsoft ecosystem: Azure, Azure AI Foundry, data services, and cloud infrastructure. Must‐have, not nice‐to‐have. AI‐native development. Deeply embedded in the new phase of AI software engineering, sometimes called … augmented ones. The Role You will own the technical architecture end to end, leveraging our client's existing Azure infrastructure and data lake while making independent calls on new tooling. You will ship at startup speed, take an AI‐first approach to every layer of the product ...

Principal Data Architect DV Cleared Secure Government & Defense Programmes UK | Hybrid + Client Site Active DV Clearance required non‐negotiable We're working with a leading UK consultancy delivering mission‐critical data platforms across defence, national security, and highly classified government programmes. This is high‐impact … high‐security work designing data architectures that sit at the core of national capability. The Role Own the architecture. Lead from the front. You'll define and deliver secure, enterprise‐scale data platforms across complex, classified environments working directly with senior stakeholders and technical teams. What ...