226 to 250 of 272 Lakehouse Jobs in London

global financial institution based in London seeks a Data Engineer for the Lakehouse and AI Data Platform. In this role, you'll design, build, and support data pipelines, ensuring they are production-ready and meet data quality standards. You will work with technologies such as Python, SQL, and Apache ...

specialist or overlay capacity, across diverse industry verticals Strong data and cloud platform acumen, including familiarity with Customer Data Platforms (CDP) or lakehouse providers Preferred Qualifications: Experience selling against or working within CDP competitors Ability to lead use-case workshops and facilitate complex opportunity qualification and objection handling ...

core technologies below and have had exposure to the others from the following list. Core Within Microsoft Fabric you must have experience using: Notebooks Lakehouse/… Warehouses You should also be confident writing code in: SQL Python And you should understand the fundamentals of: Capacity management – throttling, overage, scaling Data Lakehouse architecture Git and version control Data Modelling and Data Warehouse Theory Within Microsoft Fabric, it would be good to have had exposure to: User ...

deliver a scalable, governed data ecosystem. Key Responsibilities Define and own the enterprise data architecture strategy and roadmap Lead the design of modern Azure lakehouse and data platform architectures Shape and embed enterprise data governance, modelling and architecture standards Drive the adoption of a data product operating model across … Enterprise Data Architect within large, complex organisations Previous line management or leadership experience Strong Azure data platform expertise, including Azure Databricks Experience designing modern lakehouse and enterprise data architectures Strong understanding of data governance, metadata, MDM and enterprise data modelling Experience supporting AI/ML initiatives and modern ...

deliver a scalable, governed data ecosystem. Key Responsibilities Define and own the enterprise data architecture strategy and roadmap Lead the design of modern Azure lakehouse and data platform architectures Shape and embed enterprise data governance, modelling and architecture standards Drive the adoption of a data product operating model across … Enterprise Data Architect within large, complex organisations Previous line management or leadership experience Strong Azure data platform expertise, including Azure Databricks Experience designing modern lakehouse and enterprise data architectures Strong understanding of data governance, metadata, MDM and enterprise data modelling Experience supporting AI/ML initiatives and modern ...

with clear ownership of cross-environment patterns and data contracts. Cloud Platform Design: Lead the data platform architecture across the cloud estate, designing scalable lakehouse patterns, real-time and batch pipeline architectures suitable for AI/ML infrastructure. Person Specification Data architecture expertise across multi-environment estates: proven experience … experience designing AI/ML data infrastructure - including feature stores, model training pipelines, inference serving, and GenAI/RAG architectures grounded in proprietary content. Lakehouse and modern data platform design: strong knowledge of open table formats (Apache Iceberg, Delta Lake), zone architecture (landing, cleansed, curated), streaming and batch pipeline ...

specialist or overlay capacity, across diverse industry verticals Strong data and cloud platform acumen, including familiarity with Customer Data Platforms (CDP) or lakehouse providers Preferred Qualifications Experience selling against or working within CDP competitors Ability to lead use‐case workshops and facilitate complex opportunity qualification and objection handling ...

type: Permanent/Full-time Sector and subsector: IT | Data Engineer Salary: Competitive salary Platform Architecture & Engineering responsibilities: Design and implement scalable Databricks Lakehouse platforms on AWS and/or Azure aligned to client requirements Architect end-to-end data platforms including ingestion, storage (Delta Lake), processing, and consumption … stakeholders Support rapid prototyping and proof-of-concept builds within Databricks to demonstrate platform capabilities and accelerate client adoption Provide best practice guidance on Lakehouse architecture, data modelling, workload optimisation, and cost management Produce high-quality technical documentation including architecture diagrams, architecture decision records (ADRs), runbooks, and deployment guides ...

supply chain data models - understanding product hierarchies, inventory flows, customer journeys, manufacturing, or merchandising analytics. Demonstrated experience architecting shared data models in modern lakehouse patterns, including defining silver-layer conformance standards and gold-layer consumption contracts. Practical experience with both traditional dimensional modeling (Kimball, Data Vault etc.) and modern … data mesh/lakehouse patterns, with ability to guide teams through transitional architectures harmonizing both paradigms. Understanding of Azure data platform capabilities (Synapse, Databricks, Unity Catalog, Data Factory) to guide architectural decisions in daily implementations. Track record of guiding teams through major digital transformations, particularly SAP S/4HANA ...

must demonstrate live coding, debugging, and solution-building skills Deep expertise in distributed data systems architecture: designing scalable pipelines, streaming architectures, lakehouse patterns, and cloud-native data platforms Proficient in the Databricks Platform Proven ability to lead architecture discussions with senior technical stakeholders: whiteboarding, design reviews, and trade … agents. Headquartered in San Francisco with 30+ offices around the globe, Databricks offers a unified platform that includes Genie, Lakebase, Agent Bricks, Lakeflow, Lakehouse, and Unity Catalog. To learn more, follow Databricks on LinkedIn , X , YouTube , and Instagram . Benefits At Databricks, we strive to provide comprehensive benefits ...

working at the intersection of data, technology and business strategy. We partner with enterprise organisations across industries to solve complex data challenges through modern Lakehouse architectures on Databricks. Joining Unifeye means more than delivering projects. From day one, you'll be trusted to take ownership, challenge conventional thinking … experienced Data Architects to join our Architecture team and lead the design and delivery of modern data and AI solutions on the Databricks Lakehouse Platform. You'll work across multiple enterprise engagements, partnering with customers to solve complex business challenges while collaborating with architects, engineers and AI specialists. ...

managing cloud infrastructure Experience building streaming data pipelines using Apache Flink, Apache Kafka, Spark Structured Streaming, or similar technologies Knowledge of modern data lakehouse architectures and ecosystem such as Kafka, Flink, Spark, Databricks, Snowflake, DBT, Airflow, Debezium, Delta/Iceberg, and comfort with Python/Java and SQL Experience … plus Experience with a SaaS or FinTech company Technologies we use: AWS Services: MSK, EC2, VPC, IAM, S3, SQS, Managed Flink, EKS Data Lakehouse: Kafka, Flink, Spark, Databricks, DBT, Debezium #J-18808-Ljbffr ...

Comply is the leading provider of compliance SaaS and consulting services for the global financial services sector. With more than 5,000 clients and hundreds of employees across the globe, Comply empowers Chief Compliance Officers ...

Flannery is one of the UK’s largest plant hire businesses. We supply and operate machines on most of the country’s major construction and infrastructure projects, which generates a substantial amount of data across ...

working at the intersection of data, technology and business strategy. We partner with enterprise organisations across industries to solve complex data challenges through modern Lakehouse architectures on Databricks. Joining Unifeye means more than delivering projects. From day one, you'll be trusted to take ownership, challenge conventional thinking … Principal Engineer to join our Engineering team and lead the hands-on build and delivery of modern data and AI solutions on the Databricks Lakehouse Platform. As our most senior individual contributor, you'll set the engineering standard at Unifeye. You'll work across multiple enterprise engagements, staying deep ...

data platform standards and best practices. Ensuring solutions balance centralised approaches (Synapse with CDM/RDM models, tabular models in Analysis Services) and lakehouse patterns (Databricks with decentralised principles) appropriately. Defining and evolving solution patterns, reference architectures, and best practices that build quality across data products. Leading technical design … team culture. Experience owning delivery roadmaps, OKRs, and budgets for an architecture or engineering function. Strong technical foundation across the data platform stack: Databricks lakehouse architecture (Delta Lake, medallion patterns), Azure Synapse (star schemas, dedicated pools), and data pipeline orchestration (ADF or Databricks Workflows). Experience with data quality ...

Sector and subsector: IT | Test & QA Salary: Competitive salary You will own the quality assurance of Sagacity's client data platform deployments — the Databricks Lakehouse pipelines, gold-layer views, and analytics datasets that drive marketing, billing, credit and debt outcomes for our clients across financial services, retail, energy, telecoms … checks, data quality rules, and migration parity — using SPHERE's YAML-driven test framework Investigate test failures systematically: trace root causes through the Databricks Lakehouse stack (bronze → silver → gold), distinguish pipeline bugs from data issues, and produce clear, evidenced findings for the development team Manage QA work items ...

senior Databricks authority on site, trusted by both the client and Databricks. Key responsibilities: Lead the architecture and build of a secure Databricks Lakehouse on Azure or AWS, using medallion (bronze, silver, gold) design Design and implement Unity Catalog governance: catalogues, schemas, role-based access control, row and column … Databricks Champion status Databricks Summit, user group or community speaking MLflow, Model Serving, Mosaic AI or Genie delivery experience Lakebase, Delta Sharing or Lakehouse Federation experience Knowledge of GDS Service Standard, NCSC cloud security principles and government data classifications DV clearance or willingness to undergo DV vetting #J ...

across conceptual to dimensional layers to support data-driven decision-making. You will work within the Data and Information team, contributing to a medallion lakehouse architecture and governance framework, with Power BI consumption as a key outcome. #J-18808-Ljbffr ...

prem and cloud environments. You will enable real-time analytics and governance while promoting self-service insights for business users. Key skills include data lakehouse design (Iceberg), AWS/Azure data services, dbt, Airflow, and BI/dashboard experience. The role emphasizes automation, quality, and collaboration with architects. #J ...

systems. You will enforce standards, engage in TDA governance, and ensure designs are documented before build ends. You will lead data platform design for lakehouse patterns and AI/ML pipelines, collaborating with engineering, product, and editorial teams. #J-18808-Ljbffr ...

NTT DATA is seeking a highly experienced Data Solutions Architect (Modern Big Data) to lead design and delivery of scalable data platforms in the Data & AI practice. You will steer cloud-native architectures, guide streaming ...

We're looking for a Data Platform Engineer to own the data foundation our AI agents run on. Procurement data is messy: ERP transactions, contracts, spreadsheets, PDFs and email, spread across systems that were never ...

Positions: 1 We are seeking an experienced AWS Architect with strong hands‐on expertise in designing and implementing cloud‐based data platforms and lakehouse architectures. The ideal candidate will be responsible for architecting scalable, secure, and high‐performance data solutions on AWS while collaborating closely with engineering and data … deliver robust cloud‐native data pipelines and analytics platforms. Key Responsibilities Design and implement scalable and secure data architectures on AWS. Build and manage lakehouse‐based data platforms using modern AWS data services. Architect and develop data ingestion, processing, and transformation pipelines. Design and optimize data storage solutions using ...

healthy, secure and performant, you'll also help modernise our data platforms and support our transition towards PostgreSQL, cloud‐native database services and modern lakehouse architectures. This is a hands‐on engineering role. You'll be troubleshooting performance issues, validating recovery strategies, automating operational processes, improving observability and helping … Infrastructure-as-Code familiarity (Terraform or Bicep) Experience with modern monitoring and observability platforms Experience supporting cloud migration or database modernisation programmes Knowledge of lakehouse architectures and modern analytics platforms What Actually Matters Reliability mindset – you understand databases are critical infrastructure and treat them accordingly Operational excellence – prevention ...