3 of 3 Contract Apache Avro Jobs in the UK

engineers. Your Profile Essential skills/knowledge/experience: Strong hands on experience with Kafka: Topics, partitions, consumer groups Kafka Streams, ksqlDB Schema Registry & Avro/JSON/Protobuf Kafka Connect connectors Deep expertise in AWS streaming & messaging: Amazon Kinesis Data Streams, Firehose EventBridge (rules, event buses, routing ...

real-time data ingestion when needed. Architect and manage datasets in Azure Data Lake Storage (ADLS Gen2). Optimize data storage formats (Delta, Parquet, Avro, ORC) for performance and cost. Maintain and optimize Synapse SQL Pools, Dedicated SQL Pools, and Spark Pools. Implement and monitor data quality rules, validation ...

Build and operate Python-based services that perform large-scale data transformations and calculations. Publish and distribute transaction and PnL data using Kafka, including AVRO-based schemas and streaming patterns. Required Skills Minimum of 6+ years of professional Python development experience, ideally in capital markets or a fintech firm. …/or P&L calculations is a strong plus. Experience with Kafka (or equivalent streaming/messaging platforms) and schema-based event publishing (eg, AVRO). Strong experience performing large-scale data calculations in Python using libraries like pandas, polars, and NumPy. Experience building REST services using frameworks such ...