3 of 3 Permanent Delta Lake Jobs in the City of London

ingest data from legacy systems and third-party sources. Develop and maintain the Bronze, Silver, and Gold layers of the lakehouse architecture using OneLake, Delta Lake, and Apache Spark within Fabric. Implement data transformation logic using PySpark, SQL, and Fabric Notebooks; ensure data quality, lineage, and cataloguing … Azure Data Factory (ADF) for orchestration and data movement Strong proficiency in PySpark, SQL, and Python for large-scale data transformation Strong experience with Delta Lake, Apache Spark, and OneLake architecture Good knowledge of Microsoft Purview for data governance, cataloguing, and lineage Good experience with Azure DevOps ...

understanding of cloud security, access control, and governance principles Strong software engineering fundamentals and automation mindset Nice-to-have: Enterprise-scale data platform experience Delta Lake, Delta Live Tables (DLT), and Databricks SQL Azure monitoring and observability tooling Event-driven or streaming architectures Experience working across platform ...

quant models Data lineage, entitlements, permissions and monitoring Must have: Strong Python and SQL Production ETL/ELT experience Cloud data stack: Azure, Databricks, Delta Lake, Snowflake or similar Time-series or complex-data experience Data quality, monitoring and audit awareness Ability to turn messy data into clean ...