3 of 3 Parquet Jobs in Central London

data Develop resilient, well-structured Python/OOP solutions underpinning tick-data ingestion, normalisation, storage, and replay Design and evolve data-lake patterns using Parquet and related columnar formats; introduce Iceberg-style table modelling where beneficial Implement cloud-backed processing and storage patterns - leveraging services from AWS, Azure … development Demonstrable experience building or maintaining large-scale tick-data platforms or market-data ingestion systems Strong knowledge of data-lake architecture, columnar storage (Parquet essential), and modern table formats (Iceberg highly advantageous) Familiarity with cloud ecosystems (AWS, GCP, or Azure), including compute, storage, and workflow orchestration patterns Comfortable ...

direction across Python services, distributed systems, and large-scale data processing. Work heavily with AWS — especially Redshift, Lambda, ECS, S3 , plus data formats like Parquet . Shape high-throughput data pipelines and SQL-based workflows , ensuring scalability and performance. Run technical design reviews , guide architecture decisions, and support engineers … technical requirements, prioritise roadmaps, and drive measurable outcomes. Tech Environment You’ll Influence Primary language: Python AWS stack: Redshift, Lambda, ECS, S3 Data workflows: Parquet, SQL, distributed data pipelines Scale: systems processing hundreds of millions to billions of rows Focus areas: performance tuning, reliability, cost optimisation, architectural clarity What ...

Review and assess technology decisions made by engineering and research teams, ensuring alignment with the target-state architecture. Recommend best-fit technologies (AWS S3, Parquet, Iceberg, Snowflake, Databricks, lineage tools) based on performance, scale, cost, and business needs. Validate architectural patterns for ingestion, historical data management, time-series storage … platforms, or cloud-native data engineering within financial services or capital markets. Strong experience reviewing and guiding solutions based on: AWS S3, Glue, IAM Parquet, Iceberg, Delta/columnar formats Snowflake, Databricks, or other cloud analytics platforms Expertise in data lineage, metadata, governance models, and platform security. Proven experience ...