4 of 4 Delta Lake Jobs in Central London

accuracy, consistency, and reliability throughout the data life cycle. Azure Databricks Development Develop and support solutions within Azure Databricks. Work extensively with Unity Catalog, Delta Lake, Spark SQL, and related Databricks services. Apply Databricks best practices for development, deployment, and workload optimisation. Develop solutions using SQL, Python … experience. Strong expertise in Python, PySpark, and/or Scala. Extensive experience with: Azure Databricks Azure Data Factory Azure Blob Storage Azure SQL Database Delta Lake Spark SQL Strong understanding of: Data architecture Data modelling Data warehousing Data integration patterns Experience working with large-scale datasets and complex ...

management, coaching and building high-performing architecture teams. Excellent communication, stakeholder management and influencing You will have demonstrable skills in the following : Azure Databricks (Delta Lake) Azure Data Lake Storage Gen2 Azure Data Factory Power BI Microsoft Purview Unity Catalog GitLab CI/CD MLflow, MLOps ...

model lifecycle: data prep, experimentation, deployment, and monitoring. Build and optimize feature pipelines and scoring jobs using Python, Databricks, Spark, Delta Lake, and AWS. Use AWS services (S3, Redshift, Lambda) for data automation, orchestration, and scalable processing. Ensure data quality, observability, lineage, and documentation across data … with OpenAI APIs, LLM workflows, and prompt engineering. Solid machine learning fundamentals, including supervised learning, NLP, and feature engineering. Experience with Databricks, Spark, and Delta Lake. Strong SQL skills with experience working on large datasets. Experience with AWS, including S3 and Lambda. Familiarity with Redshift, Snowflake, or other cloud ...

data platform and services using the below technologies: Python, pandas and SQL in Jupyter notebooks for analysis dbt and Databricks data platform with Delta Lake Lightdash as our BI tool and semantic layer Streamlit for interactive data applications Airflow for orchestration Kubernetes for application deployment CI/ ...