2 of 2 Spark Streaming Jobs in England

gateway design, tenant isolation, and migration strategies for enterprise clients (parallel runs, phased cutovers). Modernize data architecture to support real-time streaming and graph-based modeling (Kafka, Flink) and unified analytics for operations and ML training. Transition release management from quarterly waterfall to continuous deployment with feature … multi-tenant isolation, Kubernetes/container orchestration, serverless patterns. Working knowledge of cloud data platforms (Snowflake, Databricks, BigQuery, Azure Synapse) and real-time streaming (Kafka, Flink, Spark Streaming). Familiarity with generative AI patterns (LLM fine-tuning, RAG, prompt engineering, function calling, agent frameworks ...

Lead Backend Software Engineer – Data Services Federated Data Services | Distributed Systems | Apache Spark | DataFusion | Python | Kubernetes Location: London (2 days per week onsite) Rate: £700–£800 per day (Outside IR35) Duration: Initial 6-month contract with likely extension Overview We're looking for an experienced Lead Backend Software … practices. Architect and develop federated data services capable of securely querying and processing data across multiple environments. Design high-performance data processing and streaming workflows using technologies such as Apache Spark, Apache DataFusion, or similar distributed query frameworks. Design and implement Kubernetes-based services and containerised ...