26 to 50 of 174 Lakehouse Jobs in London

LoRA/QLoRA), RAG architecture design, vector databases (Pinecone, Milvus, Weaviate), and agentic frameworks (LangChain, LangGraph, Semantic Kernel). Data pipelines: data lake/lakehouse architectures, ETL/ELT, and data quality/lineage tooling that feed AI systems. Automation, Orchestration & Observability Infrastructure-as-code: Terraform and Ansible ...

comparable cloud platform), Infrastructure as Code, and CI/CD practices. Deep understanding of data storage and modelling principles, including dimensional modelling, lakehouse patterns, and the governance and operational setup of tools like dbt, and applies data security and GDPR principles in platform-level architectural decisions Experience building ...

business objectives. Skills & Experience: Enterprise Data Architecture. Databricks. Snowflake. AWS and/or GCP. Designing modern cloud data platforms. Data Lakes, Data Warehouses and Lakehouse architectures. Data governance, security and architecture best practices. AI, Machine Learning or Data Science platforms (highly desirable). Banking, Financial Services or other highly ...

business objectives. Skills & Experience: Enterprise Data Architecture. Databricks. Snowflake. AWS and/or GCP. Designing modern cloud data platforms. Data Lakes, Data Warehouses and Lakehouse architectures. Data governance, security and architecture best practices. AI, Machine Learning or Data Science platforms (highly desirable). Banking, Financial Services or other highly ...

Source-to-target mapping Data transformation design Data reconciliation and validation techniques Cloud & Architecture Experience with cloud platforms (Azure, AWS, or GCP) Understanding of lakehouse architectures and hybrid data platforms Desirable Experience with medallion architecture (bronze/silver/gold layers) Knowledge of data governance tools (e.g., Purview, Collibra ...

Lead Solution Architect - Data Analytics include: Experience working with architecture frameworks and methodologies (e.g. TOGAF, Zachman) Broad knowledge of enterprise data technologies, including lakehouse and medallion architectures, legacy data platforms and data engineering (ETL, ELT, CDC) Experience working within large, complex or highly regulated organisations In return ...

building production-grade data platforms.Extensive experience implementing CI/CD pipelines using Azure DevOps, Jenkins, GitHub Actions, or equivalent DevOps tooling.Deep understanding of Data Lakehouse architecture, data modelling, security, and GDPR-compliant solution design.Experience using AI-enabled tools responsibly to improve engineering efficiency while maintaining appropriate human oversight, governance ...

with experience working with distributed data processing frameworks.Expertise delivering end-to-end data pipelines across ingestion, transformation, and serving layers within modern Data Lakehouse architectures.Experience with schema design, GDPR-compliant data solutions, DevOps tooling, and CI/CD processes.A collaborative approach to engineering with experience using AI-enabled tools ...

grade data platforms. Extensive experience implementing CI/CD pipelines using Azure DevOps, Jenkins, GitHub Actions, or equivalent DevOps tooling. Deep understanding of Data Lakehouse architecture, data modelling, security, and GDPR-compliant solution design. Experience using AI-enabled tools responsibly to improve engineering efficiency while maintaining appropriate human oversight ...

assessment, heterogeneous migration (for example Oracle/PostgreSQL to Azure), and modernisation tooling.Hands-on experience building end-to-end analytics solutions in Microsoft Fabric — Lakehouse/Warehouse, Data Factory pipelines, Spark and notebooks, semantic models, Power BI, and Real-Time Intelligence — or comparable modern data platforms such as Databricks.Understanding ...

Science, Data Science, or equivalent experience. 5+ years of experience in Data Engineering, Analytics Engineering, or related fields. Hands-on experience with Microsoft Fabric (Lakehouse, Dataflows Gen2, Pipelines, Notebooks) and/or Databricks. Strong proficiency in SQL, Spark, and Python, with experience across enterprise systems ...

analysts on good design practice, documentation quality and effective stakeholder communication. Key Knowledge, Skills and Experience Strong experience designing modern data platforms using Lakehouse and warehouse patterns across batch and streaming use cases. Deep understanding of cloud‐based data services (e.g., Azure, AWS, GCP) and big‐data technologies such ...

NoSQL, Databricks etc.)You have familiarity working with modern software engineering tools (Git, CI/CD pipelines), cloud technologies (e.g. AWS, Azure) and Data Lakehouse ArchitecturesYou have experience of designing and implementing technical data governance strategies with a focus on data quality and discoverable metadata, with practical knowledge ...

Data Modelling Advanced SQL Strong expertise in Power BI, DAX and Power Query Expert dimensional & semantic modelling Strong knowledge of Microsoft Fabric - Warehouse, Lakehouse, OneLake & Direct Lake Experience owning enterprise/cross-business-unit data models Strong stakeholder management and leadership skills This is a great opportunity ...

extend or become a permanent member of the team Compensation: OTE £90,000 Location: Hybrid/client-site as required Technology environment: AWS, Databricks, Lakehouse architecture, complex relational databases, ETL/CDC pipelines About Transform Together Transform Together is a digital transformation consultancy helping organisations deliver business and technology ...

Staff Software Engineer on the Data Engineering team, you set the technical direction for the Caspian Data Platform — the company's centralized lakehouse powering analytics, financial reporting, product intelligence, and data-driven operations across every business unit. You own the architecture for ingestion, transformation, governance, and data quality across ...

driving best practices, and guiding engineering teams to deliver scalable, secure, and cost optimized data platforms. \* Design end to end data platforms leveraging Databricks Lakehouse architecture, Delta Lake, Unity Catalog, and ML/AI workloads. \* Define data ingestion, transformation, governance, and consumption frameworks aligned to enterprise standards. \* Evaluate ...

democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. EEO Statement At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. ...

democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive ...

Strong expertise in data modelling and SQL Hands-on experience with AWS data stack (or similar cloud platforms) Deep understanding of modern data architectures (lakehouse, warehousing, ETL/ELT) Experience with data governance, quality, and compliance Ability to balance strategic thinking with pragmatic delivery Strong stakeholder engagement skills across ...

experience in data platform architecture, data engineering or cloud data infrastructureDeep expertise in Databricks (Unity Catalog, Delta Lake, Spark, Databricks SQL) or an equivalent Lakehouse platform, including administration, cost management and performance optimisationStrong understanding of cloud native architecture principles, cost models and CI/CD pipelinesProven experience implementing data ...

data platforms, including technologies such as GCP, BigQuery, Dataflow, Dataproc, Azure, AWS, or equivalent solutions. Strong understanding of modern data architectures, including data lakes, lakehouse architectures, streaming platforms, real-time processing, and event-driven ecosystems. Experience establishing data as a strategic product, enabling business growth, customer value, operational performance ...

track record in leading the architecture vision, design & implementation of Enterprise scale data applications, with specific focus on Distributed Data Processing systems, Data LakeHouse, Data Products, Streaming data, ML & AI platform capabilities Working knowledge of ML and Generative AI, including the leverage of Agentic AI based systems within ...

with the Program Office for planning deliveries, providing timelines, cost estimates, and status updates. Partner with Data Engineering to ensure data pipelines and lakehouse structures support AI delivery needs. Team Development: Support the Head of Data Science & AI Delivery in leading and developing a growing team of Data Scientists ...

highly skilled Databricks Data Engineer to join our Data & AI practice. The successful candidate will have deep expertise in building scalable data pipelines, optimizing Lakehouse architectures and enabling advanced analytics and AI use cases on the Databricks platform. This role is critical in building and optimizing modern data ecosystems … with Databricks Workflows and other orchestration tools.• Knowledge of data modelling methodologies (star schemas, Data Vault, Kimball, Inmon).• Familiarity with medallion architectures, data lakehouse principles and distributed data processing.• Experience with version control tools (GitHub, Bitbucket) and CI/CD pipelines.• Understanding of data governance, security, and compliance ...