2 of 2 PySpark Jobs in the West Midlands

to store and process data. Document workflows, pipelines, and transformation logic for transparency. Key Skills & Experience: Strong hands-on experience in Python (Pandas, NumPy, PySpark). Experience building ETL/ELT processes. Familiarity with cloud platforms (AWS, Azure, GCP) and big data technologies (e.g., Snowflake, Databricks). Understanding of More ❯

complex data needs Developing and optimising data pipelines with Azure Data Factory and Azure Synapse Analytics Working with Spark notebooks in Microsoft Fabric, using PySpark, Spark SQL, and potentially some Scala Creating effective data models, reports, and dashboards in Power BI using DAX (and possibly M) Supporting data governance … structure is 90% SQL-based Basic familiarity with Python (we're all at beginner level, but it’s occasionally required) Openness to working with PySpark and potentially Scala (no prior Scala experience required, but a willingness to learn is appreciated) Comfortable working directly with clients and managing technical discussions More ❯