Senior Algorithm Engineer (Python/Spark–Distributed Processing)
- Hiring Organisation
- Xcede
- Location
- Helston, England, United Kingdom
scale data processing Write production-grade Python workflows implementing complex, explainable business logic Work with Databricks for job execution, orchestration and optimisation Improve pipeline performance, reliability and cost efficiency across high-volume workloads Collaborate with engineers and domain specialists to translate requirements into scalable solutions Provide senior-level ownership …/NumPy + PySpark; Dask/Polars/DuckDB a bonus) build, schedule and optimise Spark/PySpark pipelines in Databricks (Jobs/workflows, performance tuning, production delivery) Hands-on experience with distributed systems and scalable data processing (Spark essential) Experience working with large-scale/high-frequency ...