4 of 4 PySpark Jobs in Northern Ireland

such as Databricks, Azure Data Factory, Snowflake, or similar Good programming skills in Python and SQL, with familiarity with data engineering libraries (e.g., pandas, PySpark, dbt) Solid understanding of data modelling, ETL/ELT processes, and Lakehouse concepts Experience with data quality frameworks, data governance, and compliance requirements. Familiarity ...

e.g., Hadoop), data streaming (e.g., Kafka), and cloud services (e.g., AWS, GCP, Azure).* Programming Skills: Programming skills in languages like Python (NumPy, pandas, PySpark), Java (Core Spark with Java, functional interface, collections), or Scala with experience in automation and scripting.* Infrastructure Tools: Experience with containerization and orchestration tools ...

calculations, including netting sets, supervisory factors and collateral/CSA logic. Design a modern Databricks architecture using Delta Lake, Unity Catalog and Spark/PySpark to support versioned, reproducible and regulator‐defensible exposure calculations. Develop high‐performance compute pipelines that support intraday recalculation, scenario testing and rapid exposure analytics … exposure methodology, netting sets, supervisory parameters and collateral/CSA design. Strong Databricks engineering capability , including Delta Lake versioning, Unity Catalog governance, Spark/PySpark optimisation and secure data architecture. Experience designing governed, audit‐ready systems , with a focus on lineage, reproducibility, evidence trails and internal/external audit ...

calculations, including netting sets, supervisory factors and collateral/CSA logic.* **Design a modern Databricks architecture** using Delta Lake, Unity Catalog and Spark/PySpark to support versioned, reproducible and regulator‐defensible exposure calculations.* **Develop high‐performance compute pipelines** that support intraday recalculation, scenario testing and rapid exposure analytics … exposure methodology, netting sets, supervisory parameters and collateral/CSA design.* **Strong Databricks engineering capability**, including Delta Lake versioning, Unity Catalog governance, Spark/PySpark optimisation and secure data architecture.* **Experience designing governed, audit‐ready systems**, with a focus on lineage, reproducibility, evidence trails and internal/external audit ...