8 of 8 Remote/Hybrid Contract PySpark Jobs

methodology. Platforms & Tools Experience with Databricks (preferred) or similar platforms: Snowflake, BigQuery, Redshift, Synapse, or equivalent Strong proficiency with: SQL (advanced level) Spark/PySpark Data pipeline orchestration tools (e.g., Airflow, ADF, etc.) Data Modelling Extensive experience designing: Fact and dimension tables Star and snowflake schemas Aggregation layers ...

schema design Develop API connectors and ingestion pipelines using Python Implement integration services feeding into the Databricks environment Build data transformation logic using PySpark/Python (data cleansing, standardisation, validation) Configure monitoring, logging, and alerting Execute unit and integration testing across pipelines Core Skills: Azure Databricks Python Desirable ...

schema design Develop API connectors and ingestion pipelines using Python Implement integration services feeding into the Databricks environment Build data transformation logic using PySpark/Python (data cleansing, standardisation, validation) Configure monitoring, logging, and alerting Execute unit and integration testing across pipelines Core Skills: Azure Databricks Python Desirable ...

Declarative Pipelines with Expectations, including failure handling and observability Knowledge of Auto Loader, Lakeflow Connect and batch, streaming or incremental ingestion patterns Production-level PySpark and SQL development skills Strong knowledge of Delta Lake, including MERGE, schema evolution, OPTIMIZE, ZORDER and VACUUM Experience with Databricks Workflows, orchestration ...

including Expectations, data quality, failure handling and observability • Experience with Databricks-native ingestion approaches such as AutoLoader and/or Lakeflow Connect • Strong PySpark and SQL skills • Delta Lake experience, including MERGE, schema evolution, optimisation and performance tuning • Experience with Databricks Workflows and production pipeline orchestration • Strong understanding ...

skill further when working with non-technical audiences. Experience using at least one data-focused programming or analytical language, such as Python, R, SQL, PySpark or similar. Role is placed within the Advanced Analytics function, supporting the strategic Insights Engine programme. The project aims to move retail colleagues away ...

technology sprawl while improving security, supportability and delivery speed. 4. Data Engineering and Integration Design and build reliable ingestion and transformation pipelines using Python, PySpark, SQL and Delta Lake. Implement full and incremental ingestion, CDC where appropriate, schema evolution, reconciliation, error handling and data quality controls. Design reusable integration … Databricks Serverless and compute/workload optimisation Azure identity, networking, security, secrets, monitoring and private connectivity Databricks SQL, Delta Lake and performance optimisation Python, PySpark and SQL Jobs/workflows, incremental processing, CDC and data quality REST/API and external data integration patterns FinOps, cost attribution, tagging, budgets ...

Quant Developer Location: London Hybrid Contract Opportunity (Inside IR35) Visa: Only British/ILR Role Overview We are seeking a technically strong Quant Developer to support Credit & Capital Management and Group Risk Analytics. You will ...