4 of 4 Apache Spark Jobs in Surrey

workflows. Key Requirements Passion for building scalable, resilient cloud data platforms. Strong experience with Databricks or Snowflake on AWS. Proven Python skills, including Spark and Airflow expertise. Advanced SQL skills and end-to-end data modelling experience. Experience building batch and real-time data integrations. Hands-on CICD skills ...

partner management and ability to influence across teams and organisations. Continuous learning and improvement mentality. Desired Experience with big data technologies (e.g. Hadoop, Hive, Spark). Experience with generative AI, LLMs, or retrieval-augmented generation (RAG). Exposure to Agentic AI concepts, including autonomous agents, tool use, and orchestration ...

platforms (AWS, Azure, or GCP). Distributed Systems Mastery: Deep technical capability in structuring data platforms, data pipelines, and high‐throughput distributed systems (like Spark or Kafka) optimized for performance and scalability. Cross‐Functional Technical Leadership: Exceptional ability to bridge the gap between deep technical engineering and strategic business ...

Strong experience with MLOps, production ML systems, model lifecycle management, and monitoring. Experience working with large-scale data systems and distributed computing frameworks (e.g. Spark, Hadoop). Knowledge of experimental design, scientific methodology, and analysis. Strong partner management and confirmed ability to influence large organisations without direct authority. Demonstrated ...