5 of 5 Permanent Apache Spark Jobs in the City of Westminster

related disciplines within enterprise environments 4+ years of hands-on experience designing and implementing solutions on the Databricks Lakehouse Platform Strong expertise in Apache Spark, SQL, Python, Delta Lake, and modern data engineering practices Experience building and optimizing Extract, Transform, Load and Extract, Load, Transform data pipelines … solutions on the Databricks Lakehouse Platform. Design and implement scalable data and analytics solutions leveraging Databricks technologies Build, maintain, and optimize data pipelines using Apache Spark, SQL, Python, and Delta Lake Develop governed datasets and data products that support reporting, analytics, and artificial intelligence initiatives Partner with business ...

drift monitoring; versioning and release management. Cloud architecture (Azure/AWS/GCP), Kubernetes/Docker, serverless, IAM and network security. Data engineering depth (Spark/Databricks; ETL/ELT); cloud-native data + AI architectures. Enterprise integration and SRE principles (SLIs/SLOs, runbooks, rollback). Consulting leadership ...

startup, or equivalent experience navigating fast-paced startup lifecycles. Strong understanding of modern data warehouse architectures, real-time analytics, and data governance (e.g., BigQuery, Spark, Kafka). Deep technical expertise in Generative AI development (e.g., prompt engineering, model tuning, vector databases like Vertex AI Vector Search, and AI frameworks ...

programming, hardware-aware optimization, or FPGA-adjacent systems. Experience with ML/data tooling such as PyTorch, JAX, CUDA, GPU clusters, Ray, Kafka, Kubernetes, Spark, or comparable technologies. Understanding of market microstructure, backtesting pitfalls, transaction costs, and the operational needs of live quantitative strategies. Experience in environments operating real ...

Step into a role where your ideas spark innovation and your impact is felt every day. As a Services Account Executive in our Services Sales team, you put the customer at the centre of every decision, shaping how services create measurable value for UK Public Sector customers, with ...