2 of 2 Contract Apache Spark Jobs in the City of London

enterprise data systems. Migrate on-prem systems to Google Cloud Platform (GCP), leveraging Dataproc, BigQuery, and other GCP-native tooling. Use technologies such as Apache Spark, Hadoop, and Scala to process large-scale distributed datasets. Contribute to infrastructure automation (CI/CD) and hybrid cloud deployment pipelines using … to architecture and system design. Skills and Qualifications: Technical Essentials: Strong Scala development skills with experience in large-scale Big Data environments. Proficiency in Apache Spark; working knowledge of Hadoop. Familiarity with GCP (Dataproc, BigQuery) or other public cloud platforms (AWS, Azure). Experience with Kubernetes or OpenShift More ❯

architects to design scalable solutions. Ensure adherence to best practices in Databricks data engineering. Required Skills & Experience: Hands-on experience with Microsoft Databricks and Apache Spark. Strong knowledge of Git, DevOps integration, and CI/CD pipelines. Expertise in Unity Catalog for data governance and security. Proven ability to More ❯