2 of 2 PySpark Jobs in Merseyside

using Azure Synapse, ensuring data integrity and security Build, deploy, and manage ETL processes to support real-time and batch data processing using tooling across the Azure estate, Databricks, PySpark, and SQL Oversee data storage across both relational and non-relational databases, ensuring efficient data retrieval Design and implement data security protocols to safeguard sensitive information Collaborate with DBAs … continuous learning and improvement What we are looking for: 5+ years of experience in data engineering Expertise in Azure DWH and AWS Databricks Strong programming skills in Python/PySpark or other relevant languages for data manipulation and ETL workflows Proficiency in SQL and experience with both relational (e.g., SQL Server, MySQL) and non-relational databases (e.g., MongoDB, Cassandra More ❯

outputs Contribute to strategy and best practice for the long-term development of the data science function Requirements Experience in a data science leadership position Expert use of Python, PySpark, and PyTorch Strong experience with AI and ML best practice and development Databricks and GCP experience Strong business and commercial acumen Excellent stakeholder management My client have already began More ❯