4 of 4 Permanent Apache Spark Jobs in Bolton

experience in data engineering and 1+ experience as Lead Data Engineer Proven expertise with Microsoft Azure Strong proficiency in Databricks with hands-on Scala (Spark) and PySpark. Expertise in Databricks for large-scale data engineering and analytics workloads. Design and implement scalable data architectures using Databricks Unity Catalog, Delta … Lake, and Apache Spark Implement advanced Delta Lake features including time travel, vacuum operations, and Z-ordering. Desirable: certification in Databricks Data Engineer and/or Azure Data Engineer are a plus. ...

private/on-prem AI platforms (e.g. NVIDIA-based stacks, private AI platforms). • Solid understanding of data engineering concepts (ETL, data lakes, Spark or similar). • Experience designing scalable, distributed systems. • Familiarity with model lifecycle management and MLOps practices. • Proven ability to align AI initiatives to business outcomes ...

containerised workloads (Docker, Kubernetes, Kubeflow, etc.) and integrating with CI/CD tools (Jenkins, GitHub Actions, GitLab CI). Familiarity with distributed computing frameworks (Spark, Ray, TensorFlow Distributed, PyTorch Distributed). Strong understanding of monitoring, logging, and observability for large-scale ML systems. Experience in cost optimisation for compute ...

Deep expertise in search and recommendation systems (e.g., semantic embeddings, learning-to-rank, personalisation algorithms). Hands-on experience with modern ML toolchains — Python, Spark, and frameworks such as PyTorch or TensorFlow. Strong grounding in experimental design, A/B testing, and the use of offline/online metrics ...