26 to 45 of 45 Delta Lake Jobs in the UK excluding London

workflows and automated testing. Designing evaluation frameworks to benchmark, test and improve GenAI system performance and reliability. The Individual Strong expertise with Databricks, including Delta Lake, Unity Catalog, DLT and MLflow. Deep knowledge of Large Language Models including GPT, Llama, Claude and Mistral. Experience building and deploying GenAI ...

workflows and automated testing. Designing evaluation frameworks to benchmark, test and improve GenAI system performance and reliability. The Individual Strong expertise with Databricks, including Delta Lake, Unity Catalog, DLT and MLflow. Deep knowledge of Large Language Models including GPT, Llama, Claude and Mistral. Experience building and deploying GenAI ...

Lakehouse solutions Strong expertise across Microsoft Fabric, Azure Data Platform technologies, and modern cloud data architectures Hands-on experience with Databricks, Unity Catalog, and Delta Lake Advanced SQL and PySpark development skills Experience implementing Medallion Architecture principles Strong data modelling expertise, including Star Schema and Data Vault methodologies ...

cloud databases Proven track record with complex data migration projects (terabyte+ datasets, multiple legacy source systems, structures and unstructured data) Proficiency with Parquet/Delta Lake or other modern data storage formats Experience with streaming architectures using Kafka, Event Hubs, or Kinesis for real-time data processing Knowledge ...

cloud databases Proven track record with complex data migration projects (terabyte+ datasets, multiple legacy source systems, structures and unstructured data) Proficiency with Parquet/Delta Lake or other modern data storage formats Experience with streaming architectures using Kafka, Event Hubs, or Kinesis for real-time data processing Knowledge ...

ability to work effectively with both technical and non-technical stakeholders Desirable Experience Experience with any of the following would be highly beneficial Delta Lake Unity Catalog MLfow Databricks optimisation and performance tuning AI, Machine Learning or Generative AI initiatives AI-assisted development tools such as Claude, GitHub ...

ability to work effectively with both technical and non-technical stakeholders Desirable Experience Experience with any of the following would be highly beneficial Delta Lake Unity Catalog MLfow Databricks optimisation and performance tuning AI, Machine Learning or Generative AI initiatives AI-assisted development tools such as Claude, GitHub ...

continuous improvement initiatives. Key Skills & Experience Proven experience as a Data Engineer within production environments. Strong hands-on experience with Databricks, Apache Spark, Delta Lake, Python and SQL. Experience building and supporting scalable ETL/ELT pipelines. Strong understanding of distributed data processing and data modelling. Cloud platform ...

while remaining hands-on with delivery. Experience working across Architecture, Engineering, Product, and Business teams. Data Engineering & Platforms Strong hands-on experience with: Databricks Delta Lake Unity Catalog dbt Spark/PySpark Data pipeline development and optimisation Lakehouse architectures ETL/ELT frameworks Enterprise data platform implementation Cloud ...

peers on safe and effective usage within team practices. Preferred Qualifications, Capabilities, and Skills: Experience building data products on Databricks using lakehouse patterns, including Delta Lake and medallion architecture Familiarity with enterprise data platforms and data mesh principles, including domain-aligned datasets and well-defined data contracts Exposure ...

enterprise Data Warehouse architectures Expertise with Microsoft Fabric, Azure Data Platform technologies and modern Lakehouse architecture Hands-on experience with Databricks, Unity Catalog and Delta Lake Strong SQL and PySpark skills Experience implementing Medallion Architecture principles Knowledge of data modelling methodologies including Star Schema and Data Vault Strong ...

into technical solutions Requirements: Enterprise data warehouse architecture and design Microsoft Fabric, Azure Data Platform technologies and modern Lakehouse architectures Databricks, Unity Catalog and Delta Lake PySpark, Databricks, SQL Medallion Architecture implementation Data modelling approaches including Star Schema and Data Vault Data governance, security and access management ...

Databricks and Fabric architecture, including Lakehouse patterns Ability to oversee ingestion, transformation and reporting layers across enterprise data flows Working knowledge of Databricks (Delta Lake, pipelines, orchestration) and Fabric (Power BI, semantic models) Experience in operating appropriate governance over data quality, lineage, access and cross-border data controls ...

grade data pipelines, and strong experience with Python, Scala, or similar programming languages. Experience working with modern cloud data platforms such as Databricks (preferred), Delta Lake, Snowflake, or BigQuery. Proven experience driving complex cross-functional initiatives from concept through production. Experience leading technical architecture discussions and engineering design ...

data platform and services using the below technologies: Python, pandas and SQL in Jupyter notebooks for analysis dbt and Databricks data platform with Delta Lake Lightdash as our BI tool and semantic layer Streamlit for interactive data applications Airflow for orchestration Kubernetes for application deployment CI/ ...

Python, Data Modelling, Data Warehousing.Strong background in incident resolution, requests, changes and problem‐solving within SLAs.Hands‐on experience with Spark, Data Architecture, SQL and Delta Lake.Cloud development experience (Azure/Fabric).Working knowledge of Medallion Architecture.Demonstrated capability in implementing and supporting pipelines in demanding environments.Strong communication skills and confidence ...

Modelling, Data Warehousing. Strong background in incident resolution, requests, changes and problem-solving within SLAs. Hands-on experience with Spark, Data Architecture, SQL and Delta Lake. Cloud development experience (Azure/Fabric). Working knowledge of Medallion Architecture. Demonstrated capability in implementing and supporting pipelines in demanding environments. Strong ...

highly beneficial Ability to quickly adapt to new tools and independently deliver scalable solutionsFamiliarity with data pipelines involving Kafka, Debezium, S3, Lambda, and Delta Lake is a plusApply now to find out more!Location:Newcastle upon Tyne Tyne and Wear Newcastle upon Tyne NE12 8BX Salary:50000 - 70000Sector ...

cloud data environments Expertise in PySpark, SQL and data transformation practices Experience building production-grade data pipelines Knowledge of Microsoft Fabric Experience working with Delta Lake and Lakehouse architectures ...

pipelines and data products using strong SQL skills, modern data engineering patterns, cloud-native services, Spark and Databricks capabilities including notebooks, jobs, workflows and Delta Lake.Work confidently with common data formats and storage patterns such as Parquet, Delta, CSV, JSON and structured/semi-structured datasets, ensuring data ...