151 to 175 of 185 Delta Lake Jobs in England

Python, Data Modelling, Data Warehousing.Strong background in incident resolution, requests, changes and problem‐solving within SLAs.Hands‐on experience with Spark, Data Architecture, SQL and Delta Lake.Cloud development experience (Azure/Fabric).Working knowledge of Medallion Architecture.Demonstrated capability in implementing and supporting pipelines in demanding environments.Strong communication skills and confidence ...

only. Multi-cloud platform depth (AWS and GCP): hands-on experience with data services across one or both of AWS (Redshift, Glue, S3/Lake Formation, MSK, RDS) and GCP (BigQuery, Dataflow, Pub/Sub, Cloud Composer). Data flow mapping and optimisation: demonstrable experience producing current-state data … serving, and GenAI/RAG architectures grounded in proprietary content. Lakehouse and modern data platform design: strong knowledge of open table formats (Apache Iceberg, Delta Lake), zone architecture (landing, cleansed, curated), streaming and batch pipeline patterns, and data quality frameworks. Project engagement and design assurance: able to engage ...

tangible commercial outcomes for clients. Build — AI & automation solution development Design, build and maintain AI‐powered data and document pipelines on Microsoft Fabric (Lakehouse, Delta tables, notebooks, Dataflows Gen2, pipelines) supporting CPD service lines. Apply Large Language Models (LLMs) to real consulting workflow problems — including document extraction, classification, summarisation … with practical experience building data and AI pipelines end‐to‐end (ingestion → transformation → modelling → delivery). Working proficiency in Microsoft Fabric — Lakehouse, Delta Lake, notebooks, Dataflows Gen2 and pipelines — in line with ERM’s strategic adoption of the integrated Fabric Data Platform. Strong PowerBI skills, including semantic modelling ...

CPD. What You’ll Do Build — AI & automation solution development Design, build and maintain AI-powered data and document pipelines on Microsoft Fabric (Lakehouse, Delta tables, notebooks, Dataflows Gen2, pipelines) supporting CPD service lines. Apply Large Language Models (LLMs) to real consulting workflow problems — including document extraction, classification, summarisation … with practical experience building data and AI pipelines end-to-end (ingestion → transformation → modelling → delivery). Working proficiency in Microsoft Fabric — Lakehouse, Delta Lake, notebooks, Dataflows Gen2 and pipelines — in line with ERM's strategic adoption of the integrated Fabric Data Platform. Strong Power BI skills, including semantic ...

data/analytics platforms and/or MLOps capabilities in a complex enterprise environment. Hands-on experience operating Databricks (workspace administration, cluster policies, jobs, Delta Lake, Unity Catalog, access controls, and production support) Experience implementing MLOps practices across the model lifecycle (CI/CD, versioning, monitoring, reproducibility) Strong ...

patterns, standards and trade offsRequirements7 to 10+ years' experience in data platform architecture, data engineering or cloud data infrastructureDeep expertise in Databricks (Unity Catalog, Delta Lake, Spark, Databricks SQL) or an equivalent Lakehouse platform, including administration, cost management and performance optimisationStrong understanding of cloud native architecture principles, cost ...

managing data/analytics platforms and/or MLOps capabilities in a complex enterprise environment.Hands-on experience operating Databricks (workspace administration, cluster policies, jobs, Delta Lake, Unity Catalog, access controls, and production support)Experience implementing MLOps practices across the model lifecycle (CI/CD, versioning, monitoring, reproducibility) Strong ...

PySpark to build data products, collaborate across Product, Analytics, Security and Software, and help optimize ETL pipelines in a Lakehouse architecture using Databricks and Delta Lake. #J-18808-Ljbffr ...

scale, we regularly observe cloud hardware, network, and operating system faults, and our software must gracefully shield our customers from any of the above.The Delta DML team owns the core write-path operations for Delta Lake, the open-source storage layer behind the Databricks Lakehouse. Our mission … flowing through our platform. We drive performance innovations like Low Shuffle Merge and Deletion Vectors and actively contribute to open source efforts to unify Delta and Iceberg formats.We are seeking a highly skilled and experienced Senior Staff Software Engineer to join our backend team. In this role, you will ...

cross-cloud data engineering initiative, building scalable pipelines between Azure and Google Cloud. Key skills: Strong Python & SQL experience Hands-on Azure Databricks, Delta Lake & Unity Catalog Strong GCP/BigQuery/GCS experience Apache Airfl click apply for full job details ...

Events invites a Senior Data Engineer to lead the design and optimisation of our modern data platform on Azure, with a focus on Databricks, Delta Lake, and Medallion modelling. You will build scalable pipelines, drive data governance and collaborate with analysts and data scientists across global events ...

platform to a modern Azure-based data ecosystem. As a Data Engineer you will design, build and optimise scalable data pipelines on Databricks and Delta Lake, supporting Pricing, Underwriting and analytics. You will collaborate with Data Architects and Analysts to ensure data quality, governance and real-time/ ...

Somerset Bridge Group is modernising its data platform to a cloud-based ecosystem using Azure Databricks, Delta Lake and Power BI. You’ll join the Enterprise Data Team to design, build, and optimise scalable data solutions for Pricing, Underwriting, Claims, and more. The role focuses on building data ...

reporting and insights. The role requires 6+ years in data/analytics engineering and hands-on Databricks experience, plus strong Spark, SQL, Python, and Delta Lake skills. #J-18808-Ljbffr ...

cloud data environments Expertise in PySpark, SQL and data transformation practices Experience building production-grade data pipelines Knowledge of Microsoft Fabric Experience working with Delta Lake and Lakehouse architectures ...

Metaflow or similar workflow tools.Kafka, Pulsar, Redis Streams, RabbitMQ or other event-driven technologies.Triton Inference Server, Ray Serve, TorchServe, BentoML or Seldon Core.DVC, LakeFS, Delta Lake, Feast or other data-versioning and feature-store technologies.Terraform, Pulumi, CloudFormation or Ansible.GPU cluster management or high-performance computing.Aerial, satellite ...

consolidation.• Ensure efficient scheduling and orchestration of jobs using Databricks Workflows• Collaborate with data scientists and platform teams to improve query performance on Delta Lake.• Develop automated monitoring and alerting mechanisms using Databricks REST APIs, Prometheus, or Azure Monitor.• Maintain best practices for data engineering performance, testing, and documentation.Technical … Skills Required• Strong proficiency with Databricks, Apache Spark (SQL, PySpark, Scala), and Delta Lake.• Deep understanding of Spark execution plans, shuffle optimization, and data partitioning strategies.• Experience tuning job configurations (e.g., memory management, parallelism, caching, adaptive query execution).• Familiarity with orchestration tools: Databricks Workflows, Airflow, or Azure Data ...

experience. DLT with Expectations implementation. Modern ingestion with AutoLoader/Lakeflow Connect . Ability to articulate recent Databricks feature usage . Should Have Strong Delta Lake performance skills—MERGE/CDC, partitioning, OPTIMIZE/ZORDER, VACUUM. Cloud integration (Azure/AWS/GCP). Ability to standardise ...

analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the creators of Lakehouse, Apache Spark, Delta Lake and MLflow. Benefits Databricks strives to provide comprehensive benefits and perks. For specific details in your region, refer to the regional benefits ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. Benefits At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. Specific ...

cloud governance, security and data protection controls. A strong track record of integrating AWS architectures with modern data platforms such as Databricks Lakehouse or Delta Lake, and resolving complex cross-team architecture issues. Experience chairing or presenting at a Technical Design Authority or equivalent architecture governance forum, securing ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn, Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks that ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks ...

Experience building enterprise platforms and data architectures, including multi‐tenant systems, fine‐grained authorization, identity and access management, API‐first architectures, data lakehouse patterns, Delta Lake, vector databases, and RAG pipelines Strong understanding of model‐agnostic AI architectures and tool integration, including multi‐provider LLM integration, tool calling ...