226 to 245 of 245 Delta Lake Jobs in the UK

Driven Design (DDD) Exceptional command of the English language Nice-to-Have We’d also love experience with: Version control for data and artefacts: DeltaLake DVC MLFlow Designing and operating cloud-based systems AWS and/or Databricks Messaging platforms Infrastructure as Code tools such as: Terraform CloudFormation Pulumi Kubernetes ...

consolidation. Ensure efficient scheduling and orchestration of jobs using Databricks Workflows Collaborate with data scientists and platform teams to improve query performance on Delta Lake. Develop automated monitoring and alerting mechanisms using Databricks REST APIs, Prometheus, or Azure Monitor. Maintain best practices for data engineering performance, testing, and documentation. … Technical Skills Required Strong proficiency with Databricks, Apache Spark (SQL, PySpark, Scala), and Delta Lake. Deep understanding of Spark execution plans, shuffle optimization, and data partitioning strategies. Experience tuning job configurations (e.g., memory management, parallelism, caching, adaptive query execution). Familiarity with orchestration tools: Databricks Workflows, Airflow, or Azure ...

design and implement Lakehouse architectures, govern data access, and lead delivery with a focus on scale and governance. You will work with Unity Catalog, Delta Lake, and SQL/Python/Spark, collaborating with sellers and engineering teams to drive pre-sales and delivery. Hybrid work ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. Benefits At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks ...

driven culture. Description Design, develop, and maintain scalable data pipelines using Python and Databricks. Build and optimise ETL/ELT workflows using Spark and Delta Lake. Develop and maintain data models and lakehouse architectures. Ensure high levels of data quality, reliability, governance, and security. Optimise the performance of distributed … architecture. Profile 10+ years' experience in Data Engineering. Strong commercial experience with Python. Advanced hands-on knowledge of Databricks, including notebooks, workflows, jobs, and Delta Lake. Strong experience with Apache Spark/PySpark. Proven track record building and maintaining scalable ETL pipelines. Strong SQL and data modelling expertise. Experience ...

C++Experience optimising software performance or efficiencyDesirable: Experience with distributed software systemsExperience with data processing or data serving systemsExperience using Rust, C#, Python, Parquet, Arrow, Delta Lake or KubernetesWhy join us? Highly competitive compensation plus annual discretionary bonusLunch provided (via Just Eat for Business) and dedicated barista bar35 days ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. At Databricks, we strive to provide comprehensive benefits and perks that ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks ...

AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits and perks ...

London, the Data Engineer will own ingestion, transformation and governance across cloud, on-premise and datacentre environments. You will work with Databricks, Spark and Delta Lake to deliver reliable, traceable datasets and enable customer-facing applications while maintaining strict data security and lineage across teams. #J-18808-Ljbffr ...

data with fast APIs for access. Requirements include 2+ years in Python, Java or C++, Linux experience, and familiarity with Airflow or Dagster, Kafka, Delta Lake or Iceberg, and relational databases; a CS/Math/Engineering degree is #J-18808-Ljbffr ...

efficiency. Design, build and operationalise scalable ETL/ELT data pipelines using Databricks, Python and SQL. Develop and optimise solutions using Databricks Lakehouse and Delta Lake. Implement data governance, lineage, controls and audit frameworks within a regulated environment. Lead, mentor and upskill a team of Data Engineers, establishing technical … financial services. Strong experience within Insurance, Banking, Asset Management or FinTech. Advanced Python, PySpark and SQL skills. Deep knowledge of Databricks Lakehouse architecture and Delta Lake. Experience with at least one major cloud platform: AWS, Azure or GCP. Proven experience leading or mentoring Data Engineering teams. Strong stakeholder management ...

command-line and Unix/Linux skills. Experience working with cloud platforms, ideally Microsoft Azure. Experience using technologies such as Spark, Databricks and data lake architectures. Knowledge of data storage and transformation formats such as Apache Parquet and Delta Lake. Experience with containerisation and orchestration technologies, including Docker ...

command-line and Unix/Linux skills. Experience working with cloud platforms, ideally Microsoft Azure. Experience using technologies such as Spark, Databricks and data lake architectures. Knowledge of data storage and transformation formats such as Apache Parquet and Delta Lake. Experience with containerisation and orchestration technologies, including Docker ...

command-line and Unix/Linux skills. Experience working with cloud platforms, ideally Microsoft Azure. Experience using technologies such as Spark, Databricks and data lake architectures. Knowledge of data storage and transformation formats such as Apache Parquet and Delta Lake. Experience with containerisation and orchestration technologies, including Docker ...

command-line and Unix/Linux skills. Experience working with cloud platforms, ideally Microsoft Azure. Experience using technologies such as Spark, Databricks and data lake architectures. Knowledge of data storage and transformation formats such as Apache Parquet and Delta Lake. Experience with containerisation and orchestration technologies, including Docker ...

command-line and Unix/Linux skills. Experience working with cloud platforms, ideally Microsoft Azure. Experience using technologies such as Spark, Databricks and data lake architectures. Knowledge of data storage and transformation formats such as Apache Parquet and Delta Lake. Experience with containerisation and orchestration technologies, including Docker ...

command-line and Unix/Linux skills. Experience working with cloud platforms, ideally Microsoft Azure. Experience using technologies such as Spark, Databricks and data lake architectures. Knowledge of data storage and transformation formats such as Apache Parquet and Delta Lake. Experience with containerisation and orchestration technologies, including Docker ...

command-line and Unix/Linux skills. Experience working with cloud platforms, ideally Microsoft Azure. Experience using technologies such as Spark, Databricks and data lake architectures. Knowledge of data storage and transformation formats such as Apache Parquet and Delta Lake. Experience with containerisation and orchestration technologies, including Docker ...