26 to 40 of 40 Delta Lake Jobs in London

PySpark and experience optimising large-scale distributed processingBig data experience — designing and operating systems for datasets and workloads well beyond single-machine scaleApache Iceberg, Delta Lake, or similar open table formats and experience with lakehouse architectures, Databricks, Snowflake, or comparable data platformsCI/CD tooling such as GitLab ...

/CD.The ability to understand customer requirements and translate them into practical technical solutions. Excellent analytical, problem-solving and communication skills. Desirable experienceData-lake or lakehouse technologies such as Delta Lake, Apache Iceberg, Apache Hudi, Databricks, Snowflake or AWS Lake Formation. Image or video visualisation, enhancement ...

best practices. Skills & Experience Strong hands-on experience with Azure Databricks. Experience building data pipelines using Python and/or PySpark. Understanding of Delta Lake, lakehouse architectures and modern data platform design. Experience working with Unity Catalog for data governance and access management. Strong SQL development, optimisation ...

data governance frameworks, metadata management, and regulatory complianc It would be a bonus if you have: Familiarity with emerging technologies such as Apache Iceberg, Delta Lake, real-time/streaming architectures, or data observability tooling Experience leading architecture workshops with both technical and non-technical stakeholders A background ...

data governance frameworks, metadata management, and regulatory compliancIt would be a bonus if you have: Familiarity with emerging technologies such as Apache Iceberg, Delta Lake, real-time/streaming architectures, or data observability toolingExperience leading architecture workshops with both technical and non-technical stakeholdersA background providing technical mentorship ...

PySpark. You write reusable, parameterized functions and work comfortably with JSON, CSV, and Parquet. Platform knowledge Deep experience with Databricks (Declarative Pipelines, DABS, Delta Lake, Spark optimization, job orchestration). Familiarity with the Azure ecosystem. Working understanding of Unity Catalog. About you Around 6 or more years ...

personNice to have, not requiredDo not rule yourself out if you do not have these. They are a bonus, not a checklist. Experience with Delta Lake, Iceberg, Spark or Databricks, PalantirExperience optimising LLM serving with tools such as vLLM, TGI or TensorRT LLMSearch and ranking experience. For example ...

controls and records needed to support auditing, data traceability and compliance requirements. Performance and operational management Investigate and improve the performance of Spark workloads, Delta tables and SQL compute. Review resource consumption and identify ways to reduce unnecessary platform and cloud expenditure. Set up monitoring and alerting to identify … mentoring across the team. What we are looking for Practical experience managing Databricks in a production environment. A strong understanding of Apache Spark, Delta Lake and Unity Catalog. Experience working with one or more major cloud providers, including storage, networking and identity management. Confidence using Terraform ...

Must Haves (Hard Skills)Data Lakehouse Mastery: Proven experience building data infrastructure using Trino/Presto and open table formats like Apache Iceberg or Delta Lake. Advanced Data Modeling: Deep expertise in Medallion Architecture patterns, Star Schemas, and processing semi-structured financial data logs (JSON/Avro).Robust ...

patterns, standards and trade offsRequirements7 to 10+ years' experience in data platform architecture, data engineering or cloud data infrastructureDeep expertise in Databricks (Unity Catalog, Delta Lake, Spark, Databricks SQL) or an equivalent Lakehouse platform, including administration, cost management and performance optimisationStrong understanding of cloud native architecture principles, cost ...

transforming data between different formats. Knowledge of cloud platforms, ideally Azure, alongside Spark and Databricks. Familiarity with data storage technologies such as Parquet and Delta Lake. Experience with Docker, Kubernetes, Git/GitHub and Linux/Unix environments. Ability to contribute to shared codebases and collaborative development teams. ...

lookout for an experienced data consultant - supporting an existing specialist on the team with a key client. Skills needed: Azure Databricks (including Jobs & Workflows, Delta Lake, Unity Catalog, cluster management and Databricks APIs) Azure services such as ADLS Gen2, networking and Entra ID Strong Python experience ...

designs, data flows and integration specifications. Provide technical leadership across architecture and engineering teams. Essential Skills: Strong AWS and Databricks expertise, including Lakehouse and Delta Lake. Extensive data modelling and enterprise data architecture experience. Supply chain planning, demand forecasting and inventory optimisation. Knowledge of SCOR, data mesh and event ...

designs, data flows and integration specifications. Provide technical leadership across architecture and engineering teams. Essential Skills: Strong AWS and Databricks expertise, including Lakehouse and Delta Lake. Extensive data modelling and enterprise data architecture experience. Supply chain planning, demand forecasting and inventory optimisation. Knowledge of SCOR, data mesh and event ...

C++Experience optimising software performance or efficiencyDesirable: Experience with distributed software systemsExperience with data processing or data serving systemsExperience using Rust, C#, Python, Parquet, Arrow, Delta Lake or KubernetesWhy join us? Highly competitive compensation plus annual discretionary bonusLunch provided (via Just Eat for Business) and dedicated barista bar35 days ...