51 to 75 of 89 Delta Lake Jobs in London

workflows and automated testing. Designing evaluation frameworks to benchmark, test and improve GenAI system performance and reliability. The Individual Strong expertise with Databricks, including Delta Lake, Unity Catalog, DLT and MLflow. Deep knowledge of Large Language Models including GPT, Llama, Claude and Mistral. Experience building and deploying GenAI ...

data governance frameworks, metadata management, and regulatory complianc It would be a bonus if you have: Familiarity with emerging technologies such as Apache Iceberg, Delta Lake, real-time/streaming architectures, or data observability tooling Experience leading architecture workshops with both technical and non-technical stakeholders A background ...

data governance frameworks, metadata management, and regulatory compliancIt would be a bonus if you have:Familiarity with emerging technologies such as Apache Iceberg, Delta Lake, real-time/streaming architectures, or data observability toolingExperience leading architecture workshops with both technical and non-technical stakeholdersA background providing technical mentorship ...

keyboard. Deep Spark expertise — architecture, performance tuning, streaming, debugging, the advanced stuff that separates architects from diagram-drawers. Lakehouse fluency — Medallion architecture, Delta Lake, Unity Catalog, governance, orchestration (Workflows, DLT/Lakeflow, Airflow, ADF); Microsoft Fabric exposure a bonus. Battle-tested in migrations — you've led large transformation ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. EEO Statement At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great ...

data science/AI projects. Deep understanding of LLM families (GPT, Llama,Claude, Mistral) and their reasoning capabilities. S trong experience with Databricks- DLT,Delta Lake concepts, UC governance. Solid understanding of streamingtechnologies (e.g., Spark Structured Streaming, Autoloader) Programming skills in Python, SQL, or Scala. Proficiency in data ...

discussions, including vendor conversations and the technical sections of proposals Desirable Experience with NHS or other routine healthcare data at patient level Unity Catalog, Delta Lake and medallion structure, bronze to silver to gold Exposure to dbt and dimensional modelling Experience contributing to vendor or partner relationships, such ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks ...

legacy operational platforms. Experience with regulatory, client or operational reporting. Experience supporting data migration, legacy system modernisation or platform replacement. Experience with Databricks, Delta Lake, Spark SQL or PySpark. Experience defining validation frameworks, data quality dashboards or metadata-driven rule engines. Experience working in consultancy or client-facing ...

deliver cloud-based data platforms in a UK-based remote/hybrid setting. You will build scalable data pipelines on Azure Databricks, implement Delta Lake architectures, and optimize Spark workloads for enterprise BI and analytics. The role requires 5+ years of data engineering experience, mastery of Python, PySpark ...

data platform and services using the below technologies: Python, pandas and SQL in Jupyter notebooks for analysis dbt and Databricks data platform with Delta Lake Lightdash as our BI tool and semantic layer Streamlit for interactive data applications Airflow for orchestration Kubernetes for application deployment CI/ ...

AI. the company is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow the company on Twitter, LinkedIn, and Facebook. Benefits At the company, we strive to provide comprehensive ...

creation of data domains that align with the banks underlying capabilities Data Engineering & Platforms Design data product schemas across Snowflake and Databricks, including Delta Lake structures and access patterns Define and enforce architectural guardrails for data product design, including performance, scalability, security, and cost efficiency Set design standards ...

control the creation of data domains that align with the banks underlying capabilitiesData Engineering & PlatformsDesign data product schemas across Snowflake and Databricks, including Delta Lake structures and access patternsDefine and enforce architectural guardrails for data product design, including performance, scalability, security, and cost efficiencySet design standards and review ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn, Facebook. At Databricks, we strive to provide comprehensive benefits and perks that meet ...

Spark SQL), including performance tuning (partitioning, shuffle optimization, caching), troubleshooting, and designing scalable batch/stream processing patterns.Deep lakehouse and data platform expertise (e.g., Delta Lake concepts, schema evolution, data quality frameworks, lineage/metadata, and governance patterns) applied in production environments.Strong DevSecOps and platform engineering capability, including ...

Experience owning delivery roadmaps, OKRs, and budgets for an architecture or engineering function. Strong technical foundation across the data platform stack: Databricks lakehouse architecture (Delta Lake, medallion patterns), Azure Synapse (star schemas, dedicated pools), and data pipeline orchestration (ADF or Databricks Workflows). Experience with data quality frameworks ...

matters? The future of cybersecurity starts with you.About the Team:The data engineering team is on a mission to create a hyper scale data lake, which helps find bad actors and stop breaches. The team builds and operates systems to centralize all of the data the falcon platform collects … from you This team would be responsible for driving an application-based, self-service Data Replay that would leverage data within our security data lake and ensure we provide complete Business Continuity and Resiliency for downstream services or peers that ingest and process data within the CrowdStike Cloud Platform.What ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn, and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks ...

platform adoption, performance, cost and standards-compliance metrics, using them to guide roadmap priorities and architecture governance decisions.PERSONAL PROFILEDeep expertise in Databricks (Unity Catalog, Delta Lake, Spark, Databricks SQL) or equivalent Lakehouse platforms, including administration, cost management, and performance optimisation.Strong understanding of cloud-native architecture principles, cost models ...

performance, cost and standards-compliance metrics, using them to guide roadmap priorities and architecture governance decisions. PERSONAL PROFILE Deep expertise in Databricks (Unity Catalog, Delta Lake, Spark, Databricks SQL) or equivalent Lakehouse platforms, including administration, cost management, and performance optimisation. Strong understanding of cloud-native architecture principles, cost ...

reviews.Must Haves (Hard Skills)Data Lakehouse Mastery: Proven experience building data infrastructure using Trino/Presto and open table formats like Apache Iceberg or Delta Lake.Advanced Data Modeling: Deep expertise in Medallion Architecture patterns, Star Schemas, and processing semi-structured financial data logs (JSON/Avro).Robust ETL/ ...

Must Haves (Hard Skills) Data Lakehouse Mastery: Proven experience building data infrastructure using Trino/Presto and open table formats like Apache Iceberg or Delta Lake. Advanced Data Modeling: Deep expertise in Medallion Architecture patterns, Star Schemas, and processing semi‐structured financial data logs (JSON/Avro). Robust ...

design, workshops and Proof of Concepts. What you'll bring: Proven experience designing enterprise data platforms using Microsoft Fabric. Strong knowledge of Spark, PySpark, Delta Lake, SQL and modern data engineering. Expertise with Microsoft Azure Excellent stakeholder management and consultancy experience. What's in it for you? 📍Remote ...