3 of 3 Parquet Jobs in the Thames Valley

technical requirements, prioritise roadmaps, and drive measurable outcomes. Tech Environment You'll Influence Primary language: Python AWS stack: Redshift, Lambda, ECS, S3 Data workflows: Parquet, SQL, distributed data pipelines Scale: systems processing hundreds of millions to billions of rows Focus areas: performance tuning, reliability, cost optimisation, architectural clarity What ...

data Develop resilient, well-structured Python/OOP solutions underpinning tick-data ingestion, normalisation, storage, and replay Design and evolve data-lake patterns using Parquet and related columnar formats; introduce Iceberg-style table modelling where beneficial Implement cloud-backed processing and storage patterns - leveraging services from AWS, Azure … development Demonstrable experience building or maintaining large-scale tick-data platforms or market-data ingestion systems Strong knowledge of data-lake architecture, columnar storage (Parquet essential), and modern table formats (Iceberg highly advantageous) Familiarity with cloud ecosystems (AWS, GCP, or Azure), including compute, storage, and workflow orchestration patterns Comfortable ...

Review and assess technology decisions made by engineering and research teams, ensuring alignment with the target-state architecture. Recommend best-fit technologies (AWS S3, Parquet, Iceberg, Snowflake, Databricks, lineage tools) based on performance, scale, cost, and business needs. Validate architectural patterns for ingestion, historical data management, time-series storage … platforms, or cloud-native data engineering within financial services or capital markets. Strong experience reviewing and guiding solutions based on: AWS S3, Glue, IAM Parquet, Iceberg, Delta/columnar formats Snowflake, Databricks, or other cloud analytics platforms Expertise in data lineage, metadata, governance models, and platform security. Proven experience ...