51 to 75 of 81 Delta Lake Jobs in the UK

data governance frameworks, metadata management, and regulatory compliancIt would be a bonus if you have:Familiarity with emerging technologies such as Apache Iceberg, Delta Lake, real-time/streaming architectures, or data observability toolingExperience leading architecture workshops with both technical and non-technical stakeholdersA background providing technical mentorship ...

PySpark. You write reusable, parameterized functions and work comfortably with JSON, CSV, and Parquet. Platform knowledge Deep experience with Databricks (Declarative Pipelines, DABS, Delta Lake, Spark optimization, job orchestration). Familiarity with the Azure ecosystem. Working understanding of Unity Catalog. About you Around 6 or more years ...

warehouse platforms (e.g., SAP BW, Progress, Snowflake, Synapse, or similar).Hands-on experience building and delivering solutions in Databricks, including working knowledge of Delta Lake, Databricks Workflows, Genie spaces, and Unity Catalog controls. Strong command of SQL, Spark, Python, and modern ELT/orchestration tooling, with an automation ...

modern engineering standards. Skills & Experience Strong hands-on experience with Azure Databricks. Experience building data pipelines using Python and/or PySpark. Understanding of Delta Lake, lakehouse architectures and modern data platform design. Experience working with Unity Catalog for data governance and access management. Strong SQL development ...

Advanced Python, PySpark and SQL Production experience with Kafka or Amazon MSK, including Spark Structured Streaming Hands-on experience with Apache Iceberg or Delta Lake Strong data modelling and lakehouse design (bronze, silver, gold) Terraform, CI/CD and pipeline orchestration A track record of setting standards ...

Advanced Python, PySpark and SQL Production experience with Kafka or Amazon MSK, including Spark Structured Streaming Hands-on experience with Apache Iceberg or Delta Lake Strong data modelling and lakehouse design (bronze, silver, gold) Terraform, CI/CD and pipeline orchestration A track record of setting standards ...

Scala/JVM microservices, and API-led architectures. Data and Analytics Delivery: Demonstrated track record delivering analytics solutionsspecifically Azure Databricks Lakehouse architecture (medallion/Delta Lake, Unity Catalog), ETL/ELT pipelines, MLOps workflows, and enterprise Power BI reporting. Rigor in SAFe Ceremonies and Tooling: Expert facilitation ...

Databricks and Fabric architecture, including Lakehouse patterns Ability to oversee ingestion, transformation and reporting layers across enterprise data flows Working knowledge of Databricks (Delta Lake, pipelines, orchestration) and Fabric (Power BI, semantic models) Experience in operating appropriate governance over data quality, lineage, access and cross-border data controls ...

Candidate can clearly articulate what modern features they used recently and why (platform evolution awareness is essential for this role).Should HaveStrong command of Delta Lake and performance patterns:MERGE/CDC strategies, partitioning/file sizing, OPTIMIZE/ZORDER, VACUUM, table maintenance automation.Production architecture practices:Environment separation ...

personNice to have, not requiredDo not rule yourself out if you do not have these. They are a bonus, not a checklist. Experience with Delta Lake, Iceberg, Spark or Databricks, PalantirExperience optimising LLM serving with tools such as vLLM, TGI or TensorRT LLMSearch and ranking experience. For example ...

contribute to delivery standards and best practices. Required Experience Strong experience with Microsoft Fabric, Azure Databricks and Azure Data Factory. Solid knowledge of Delta Lake, Medallion Architecture, PySpark and SQL. Expertise in dimensional modelling and star schema design. Advanced Power BI development, including DAX and semantic modelling. Experience ...

+ performance troubleshooting. Supporting + maintaining production data pipelines, including incident investigation, safe recovery, root cause analysis + permanent remediation. Experience of Spark SQL, Delta Lake, Parquet + Hive metastore tables, including schemas, partitions and the relationship between table metadata and underlying files. Hands-on AWS experience, particularly ...

+ performance troubleshooting. Supporting + maintaining production data pipelines, including incident investigation, safe recovery, root cause analysis + permanent remediation. Experience of Spark SQL, Delta Lake, Parquet + Hive metastore tables, schemas, partitions and the relationship between table metadata and underlying files. Hands-on AWS experience, particularly ...

reusable frameworks and accelerators. What You'll Be Doing Building production-grade data pipelines with Databricks, PySpark and SQL Developing Lakehouse architectures using Delta Lake, Unity Catalog and medallion frameworks Gathering requirements and providing technical guidance to client teams Embedding CI/CD, automated testing and Infrastructure ...

controls and records needed to support auditing, data traceability and compliance requirements. Performance and operational management Investigate and improve the performance of Spark workloads, Delta tables and SQL compute. Review resource consumption and identify ways to reduce unnecessary platform and cloud expenditure. Set up monitoring and alerting to identify … mentoring across the team. What we are looking for Practical experience managing Databricks in a production environment. A strong understanding of Apache Spark, Delta Lake and Unity Catalog. Experience working with one or more major cloud providers, including storage, networking and identity management. Confidence using Terraform ...

Data Warehousing . Strong background in incident resolution, requests, changes and problem-solving within SLAs. Hands-on experience with Spark, Data Architecture, SQL and Delta Lake. Cloud development experience (AWS, GCP or Azure). Working knowledge of Medallion Architecture. Demonstrated capability in implementing and supporting pipelines in demanding environments. ...

Must Haves (Hard Skills)Data Lakehouse Mastery: Proven experience building data infrastructure using Trino/Presto and open table formats like Apache Iceberg or Delta Lake. Advanced Data Modeling: Deep expertise in Medallion Architecture patterns, Star Schemas, and processing semi-structured financial data logs (JSON/Avro).Robust ...

highly beneficial Ability to quickly adapt to new tools and independently deliver scalable solutionsFamiliarity with data pipelines involving Kafka, Debezium, S3, Lambda, and Delta Lake is a plusApply now to find out more!Location:Newcastle upon Tyne Tyne and Wear Newcastle upon Tyne NE12 8BX Salary:50000 - 70000Sector ...

Strong hands-on experience with AWS data services covering data ingestion, storage, processing, orchestration, security, and monitoring. Advanced knowledge of Databricks , including Lakehouse architecture, Delta Lake, and large-scale data engineering practices. Expertise in conceptual, logical, and physical data modelling, including dimensional modelling, relational modelling, and modern warehouse ...

patterns, standards and trade offsRequirements7 to 10+ years' experience in data platform architecture, data engineering or cloud data infrastructureDeep expertise in Databricks (Unity Catalog, Delta Lake, Spark, Databricks SQL) or an equivalent Lakehouse platform, including administration, cost management and performance optimisationStrong understanding of cloud native architecture principles, cost ...

Experience: 6-10+ Years Key Skills: MDM, Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Data Quality, Data Governance Role Summary We are looking for an experienced MDM/Databricks Data Engineer to build scalable master data and integration solutions on a modern Databricks Lakehouse click apply ...

Skills: MDM, Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Data Quality, Data Governance Role Summary We are looking for an experienced MDM/Databricks Data Engineer to build scalable master data and integration solutions on a modern Databricks Lakehouse. The role will focus on common IDs, Golden Records ...

organisation. Your technical skills will contribute to the development and maintenance of robust data solutions hosted on Azure. Skills required: Strong experience within Databricks (Delta Lake, Unity catalogue) Strong proficiency with MS Business Intelligence tools such as Power BI Experience in data modelling, ETL processes, and database management ...

transforming data between different formats. Knowledge of cloud platforms, ideally Azure, alongside Spark and Databricks. Familiarity with data storage technologies such as Parquet and Delta Lake. Experience with Docker, Kubernetes, Git/GitHub and Linux/Unix environments. Ability to contribute to shared codebases and collaborative development teams. ...

lookout for an experienced data consultant - supporting an existing specialist on the team with a key client. Skills needed: Azure Databricks (including Jobs & Workflows, Delta Lake, Unity Catalog, cluster management and Databricks APIs) A click apply for full job details ...