2 of 2 Permanent PySpark Jobs in Leeds

technical architecture and detailed design Expertise in building scalable ingestion frameworks (batch/streaming) using ADF, Databricks or Fabric pipelines Strong programming skills in PySpark, SQL, Python Experience implementing medallion architecture, delta lakes, and metadata‐driven pipelines Hands‐on experience with DQ frameworks, validation rules and reconciliation logic Ability ...

qualification in Computer Science, AI, Data Science, or related fields. Strong knowledge of AI, machine learning, deep learning, and probabilistic modeling. Proficient in Python, PySpark, data modeling, and microservices. Experience in MLOps, AI lifecycle management, and LLM orchestration on cloud platforms (AWS, GCP, Azure). Familiar with DevOps tools ...