3 of 3 PySpark Jobs in the North East

services such as Synapse, Data Factory, Databricks or Fabric Strong SQL skills with experience building optimised, complex queries Proficiency in Python and/or PySpark for data transformation and automation Strong experience with Power BI and modern data modelling techniques Demonstrable experience leading data engineering initiatives or projects Excellent ...

backgrounds. The technology stack is flexible, but experience in some of the following are nice to have: Data Engineering & Programming: • Python • SQL • Spark/PySpark • Scala • Data modelling and warehousing concepts Cloud & Platforms: • AWS (S3, Redshift, Glue, EMR, Lambda) • Other cloud platforms (Azure/GCP considered) • Data lake ...

structure data for analytics, reporting and downstream consumption. The ideal candidate will have a solid background in Spark-based engineering, particularly PySpark, and be confident working with Glue jobs, Glue Catalog, S3, and other AWS native services used within a data platform build. Location: Remote (client based in North ...