2 of 2 Permanent PySpark Jobs in Wales

deliver practical, value-driven data solutions. Drive continuous improvement across data engineering, reporting, and analytics capabilities. Essential Requirements Strong expertise in SQL and Python (PySpark desirable). Proven experience designing and building cloud-based data platforms from inception. Hands-on experience with Databricks, Spark, modern data lake/lakehouse ...

cause understandingMaintenance of accurate documentation, lineage and operational run books to support ongoing platform supportKey ResponsibilitiesDevelop and maintain data pipelines using Azure Databricks (Python, PySpark and SQL)Implement ingestion and transformation across Bronze, Silver and Gold layers using Delta LakeSupport and operate Azure Databricks and Azure Synapse platforms, including … standards, CI/CD pipelines and code reviewsWhat you'll need to succeedEssentialProven experience as a Data EngineerStrong hands-on experience with AzureDatabricks, Python, PySpark and SQLExperience supporting Azure data platforms in productionUnderstanding of medallion architecture and Delta LakeDesirableExperience with Azure Synapse AnalyticsExperience with Azure Data FactoryExperience in financial ...