5 of 5 Permanent Delta Lake Jobs in the City of London

Must Have At least 7 years as an Engineer in a Data Field Strong Azure data skills, including: Azure Data Factory V2 Azure Data Lake Storage V2 Azure Databricks Azure Function Apps& Logic Apps Azure Stream Analytics Azure Resource Manager skills (Terraform, Azure Portal, Az CLI and Az PowerShell … Strong PySpark, Delta Lake, Unity Catalog and Python skills. Includes ability to write unit and integration tests in Python with unittest, pytest, etc. Strong understanding of software development practices, such as SOLID principals, structuring code, testing, IOC, etc. Strong repositories, CI/CD skills. Strong knowledge of Kimball ...

skills – you communicate clearly with stakeholders as well as other engineers, fostering a collaborative, supportive working environment Experience in the financial markets, especially in delta one, store of value, and/or FICC options trading Experience with Linux‐based, concurrent, high‐throughput, low‐latency software systems Experience with pipeline … orchestration frameworks (e.g. Airflow, Dagster) Experience with streaming platforms (e.g. Kafka), data lake platforms (e.g. Delta Lake, Apache Iceberg), and relational databases Have a Bachelors or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering, or equivalent work experience For more information about DRW’s processing activities ...

Senior Data Engineer – Databricks & DLT (Delta Live Tables) Certain Advantage are recruiting on behalf of our trading client for a Senior Data Engineerwith strong analytical capabilities and hands‐on experience in building scalable data solutions using a programming language like Python or Scala as well as experience in Databricks … Delta Live Tables - This experience is essential. Suitable candidates will have expertise inDatabricks,streaming architectures, data ingestion frameworks, anddashboarding, along with experience working withSAP data sources. You will be responsible for designing and implementing scalable data pipelines and enabling real‐time and batch analytics across the organization. Your Responsibilities ...

PySpark. You write reusable, parameterized functions and work comfortably with JSON, CSV, and Parquet. Platform knowledge Deep experience with Databricks (Declarative Pipelines, DABS, Delta Lake, Spark optimization, job orchestration). Familiarity with the Azure ecosystem. Working understanding of Unity Catalog. About you Around 6 or more years ...

experience. DLT with Expectations implementation. Modern ingestion with AutoLoader/Lakeflow Connect . Ability to articulate recent Databricks feature usage . Should Have Strong Delta Lake performance skills—MERGE/CDC, partitioning, OPTIMIZE/ZORDER, VACUUM. Cloud integration (Azure/AWS/GCP). Ability to standardise ...