3 of 3 Parquet Jobs in the Thames Valley

technical requirements, prioritise roadmaps, and drive measurable outcomes. Tech Environment You'll Influence Primary language: Python AWS stack: Redshift, Lambda, ECS, S3 Data workflows: Parquet, SQL, distributed data pipelines Scale: systems processing hundreds of millions to billions of rows Focus areas: performance tuning, reliability, cost optimisation, architectural clarity What ...

high-quality production code Strong foundation in operating systems and systems programming Proven track record in performance engineering Familiarity with tools like Apache Arrow, Parquet, DataFusion, Clickhouse, or DuckDB is a plus Understanding of cutting-edge ML infrastructure stack (e.g. PyTorch, CUDA) is also a plus Experience with Rust ...

data Develop resilient, well-structured Python/OOP solutions underpinning tick-data ingestion, normalisation, storage, and replay Design and evolve data-lake patterns using Parquet and related columnar formats; introduce Iceberg-style table modelling where beneficial Implement cloud-backed processing and storage patterns - leveraging services from AWS, Azure … development Demonstrable experience building or maintaining large-scale tick-data platforms or market-data ingestion systems Strong knowledge of data-lake architecture, columnar storage (Parquet essential), and modern table formats (Iceberg highly advantageous) Familiarity with cloud ecosystems (AWS, GCP, or Azure), including compute, storage, and workflow orchestration patterns Comfortable ...