4 of 4 PySpark Jobs in Lanarkshire

understanding of data strategy and management, including data governance, data quality, security and compliance Advanced SQL skills, with hands-on experience using Python and PySpark Broad, practical experience across Azure data services and supporting Azure infrastructure Experience with Infrastructure-as-Code (Terraform or Bicep) and CI/CD pipelines ...

services such as Synapse, Data Factory, Databricks or Fabric Strong SQL skills with experience building optimised, complex queries Proficiency in Python and/or PySpark for data transformation and automation Strong experience with Power BI and modern data modelling techniques Demonstrable experience leading data engineering initiatives or projects Excellent ...

Job Responsibilities: Payments and File Format Expertise Deep understanding of payment processing workflows, especially H2H and SWIFT. Hands-on experience with legacy formats (IDOC, EDIFACT) as well as ISO 20022 and GFF. Ability to interpret ...

improve performance, stability, and interoperability . Translate business requirements into robust data models through close collaboration with product management and SMEs. Develop and maintain PySpark notebooks and SQL scripts for data transformation and analytics. Build and optimise Synapse and Databricks pipelines for batch and streaming workloads. Manage GitHub branching … Personal Specification Strong experience with Azure Synapse , Databricks , and Delta Lake architecture . Proven ability to design scalable, cloud-native data solutions. Proficiency in PySpark , SQL , and distributed data processing. Experience mentoring engineering teams and leading architectural decisions. Strong analytical skills with the ability to assess and improve existing ...