4 of 4 PySpark Jobs in Derbyshire

practices for data governance and security. Required Skills & Experience 5–10 years in data engineering roles, ideally within consultancy environments. Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice ...

applied data science. Hands-on experience with cloud data platforms, including AWS, Azure, GCP, and/or Databricks. Proficiency in Python (and ideally PySpark); experience with R beneficial but not essential. Experience building end-to-end data pipelines, feature engineering, and production ML workflows. Exposure to Generative AI, LLMs ...

processing, and analytics • Designing scalable, secure, and high performance architectures using Databricks and distributed data systems • Building and overseeing robust data ingestion pipelines using PySpark, with a strong focus on reliability and accuracy • Ensuring end to end data quality from raw ingestion through to curated datasets used for reporting … wider regulatory requirements • Evaluating and introducing new technologies where they add clear value to the data ecosystem What you will bring • Deep expertise in PySpark and distributed data processing at scale • Strong hands on experience designing, building, and optimising Databricks based platforms • Advanced SQL skills including performance optimisation ...

Senior Data Engineer Cambridge | Hybrid (1 day on site) Up to £90k + benefits Do you you enjoy working closely with a tight-knit team? Do you want to work in a business where making ...