7 of 7 Parquet Jobs in the UK

real-time data ingestion when needed. Architect and manage datasets in Azure Data Lake Storage (ADLS Gen2). Optimize data storage formats (Delta, Parquet, Avro, ORC) for performance and cost. Maintain and optimize Synapse SQL Pools, Dedicated SQL Pools, and Spark Pools. Implement and monitor data quality rules, validation ...

with analysts and AI engineers to deliver robust and reusable data products Manage data lakes and warehouses using formats such as Delta Lake and Parquet Implement best practices for data governance, performance, and security Continuously evaluate and adopt new technologies to evolve the organisation's data platform Provide technical ...

with analysts and AI engineers to deliver robust and reusable data products Manage data lakes and warehouses using formats such as Delta Lake and Parquet Implement best practices for data governance, performance, and security Continuously evaluate and adopt new technologies to evolve the organisation’s data platform Provide technical ...

workloads and the unified analytics environment. Strong proficiency in Python, SQL , and Spark-based processing frameworks. Solid understanding of lakehouse architecture , including Delta/Parquet formats and data modelling. Experience designing secure, compliant, and well-governed data platforms. Nice-to-have: MS Fabric certification Your characteristics as a Consultant ...

document metadata, lineage, catalogues and source-to-target mapping. Contribute to ETL design and data movement patterns across platforms. Work with JSON, XML, Parquet and other semi-structured formats used across financial systems. Engage senior stakeholders and guide best practice within multidisciplinary teams. Principal level: provide thought leadership, support ...

hosted ELK stack on ECS (Elasticsearch, Logstash, Kibana, Beats) -Managing log pipelines, cross‐account shipping & auto‐scaling -Enhancing a live data workflow: Aurora → S3 (Parquet) → Snowflake via AWS DMS -Making the platform more automated, more reliable & more scalable Who this role suits -Strong AWS engineer (not a manager ...

production) Ingest and normalise high-velocity, time-series datasets from multiple external sources Work heavily in Python with a modern columnar stack (Polars + Parquet/Arrow/PyArrow; DuckDB is a nice-to-have) Orchestrate workflows and improve reliability (they use Temporal — similar orchestration experience is fine … help drive delivery forward — including providing practical technical guidance to shape solutions What’s in it for you? Modern Python stack – Polars + Parquet/Arrow (DuckDB a plus) Ownership & impact – high visibility; you’ll influence performance and reliability directly Market/time-series exposure – complex financial datasets; learn ...