4 of 4 Apache Spark Jobs in the Thames Valley

Experience using Git/version control Strong communication skills with both technical and non-technical stakeholders Desirable Skills: Microsoft Fabric Azure Synapse Analytics Databricks Apache Spark/PySpark dbt Apache Airflow Power BI Azure DevOps CI/CD pipelines Terraform What's On Offer: £65k+ salary package ...

twin platforms. Experience with vector databases, embeddings, semantic search, or RAG. Experience with streaming data platforms such as Kafka, Pub/Sub, Flink, or Spark Streaming. Experience supporting closed-loop automation, predictive assurance, or self-healing network use cases. Experience working with OSS systems, inventory platforms, assurance systems ...

evolving platform stack — from data ingestion and event processing to REST services and internal tooling. Build and maintain streaming and batch processing systems (Flink, Spark, Kafka) that power real‐time and analytical workloads. Take responsibility for all aspects of software engineering: design, implementation, QA, and maintenance, with … Willingness and ability to take on new technologies as our stack evolves. Nice to Have Experience with stream processing frameworks such as Flink or Spark Streaming. Experience with task orchestration tools such as Apache Airflow or similar systems. Experience working with and designing infrastructures for large‐scale data ...

experimentation frameworks that support business decision-making. Data Engineering & Model Productionisation: Develop robust analytical datasets and machine learning pipelines using Databricks, Python, SQL and Spark, ensuring solutions are scalable, reliable and production-ready. Stakeholder Partnership & Commercial Impact: Partner with business stakeholders to define hypotheses, success measures and value metrics … analytics solutions within commercial environments. Python, SQL & Data Platform Expertise: Advanced Python and SQL skills, with experience building reproducible machine learning workflows using Databricks, Spark or similar large‐scale data processing technologies. Machine Learning & Statistical Expertise: Deep understanding of supervised and unsupervised machine learning, feature engineering, model evaluation, experimentation ...