76 to 89 of 89 Delta Lake Jobs in London

medallion architecture) Leading the design of cloud data platforms (AWS) - including services like Redshift, S3, Glue, Athena Evaluating and introducing new technologies (eg Iceberg, Delta Lake, observability tools) Driving data governance, standards, and best practice Acting as a trusted advisor to both technical and business stakeholders What ...

patterns, standards and trade offsRequirements7 to 10+ years' experience in data platform architecture, data engineering or cloud data infrastructureDeep expertise in Databricks (Unity Catalog, Delta Lake, Spark, Databricks SQL) or an equivalent Lakehouse platform, including administration, cost management and performance optimisationStrong understanding of cloud native architecture principles, cost ...

scale, we regularly observe cloud hardware, network, and operating system faults, and our software must gracefully shield our customers from any of the above.The Delta DML team owns the core write-path operations for Delta Lake, the open-source storage layer behind the Databricks Lakehouse. Our mission … flowing through our platform. We drive performance innovations like Low Shuffle Merge and Deletion Vectors and actively contribute to open source efforts to unify Delta and Iceberg formats.We are seeking a highly skilled and experienced Senior Staff Software Engineer to join our backend team. In this role, you will ...

consolidation.• Ensure efficient scheduling and orchestration of jobs using Databricks Workflows• Collaborate with data scientists and platform teams to improve query performance on Delta Lake.• Develop automated monitoring and alerting mechanisms using Databricks REST APIs, Prometheus, or Azure Monitor.• Maintain best practices for data engineering performance, testing, and documentation.Technical … Skills Required• Strong proficiency with Databricks, Apache Spark (SQL, PySpark, Scala), and Delta Lake.• Deep understanding of Spark execution plans, shuffle optimization, and data partitioning strategies.• Experience tuning job configurations (e.g., memory management, parallelism, caching, adaptive query execution).• Familiarity with orchestration tools: Databricks Workflows, Airflow, or Azure Data ...

with the Go Lang eco-system tools and librariesExperience with Pandas and PySpark libraries would be a plusTechnical experience with Databricks or any similar Delta Lake platforms.Experience working with large datasetsExperience with AWS cloud deployments and APIExperience with Docker and KubernetesFamiliarity with financial statements (e.g. balance sheets, income ...

Driven Design (DDD) Exceptional command of the English language Nice-to-Have We’d also love experience with: Version control for data and artefacts: DeltaLake DVC MLFlow Designing and operating cloud-based systems AWS and/or Databricks Messaging platforms Infrastructure as Code tools such as: Terraform CloudFormation Pulumi Kubernetes ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks ...

C++Experience optimising software performance or efficiencyDesirable:Experience with distributed software systemsExperience with data processing or data serving systemsExperience using Rust, C#, Python, Parquet, Arrow, Delta Lake or KubernetesWhy join us Highly competitive compensation plus annual discretionary bonusLunch provided (via Just Eat for Business) and dedicated barista bar35 days ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks ...

delivery. You will define data standards, drive end-to-end data solutions, and guide complex migration to cloud-native platforms, leveraging Azure, Parquet/Delta Lake and real-time #J-18808-Ljbffr ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. At Databricks, we strive to provide comprehensive benefits and perks that ...

AI. the company is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow the company on Twitter, LinkedIn and Facebook. Benefits At the company, we strive to provide comprehensive ...