14 of 14 Apache Avro Jobs in the UK

tenant isolation, row- and column-level security, and PII handling. Define the streaming and batch ingestion architecture, building on our investments in NATS JetStream, Apache Flink, and Debezium CDC patterns, and direct the engineering team on execution. Specify the catalog, lineage, and data-quality foundation and own the operational … streaming vs batch). Hands-on experience with: Dremio, Snowflake, or Databricks AWS data services (S3, Glue, Athena, Lake Formation, or equivalent) NATS/Apache Kafka or similar, and CDC patterns (Debezium or equivalent) Stream processing (Apache Flink, Spark Structured Streaming, or equivalent) SQL and query optimisation ...

Databases, and/or Data Integration (ETL) or API development. Knowledge of some Data Formats such as JSON, XML, and binary formats such as Avro or Google Protocol Buffers. Experience collaborating with business and technical teams to understand, translate, review, and playback requirements and collaborate to develop Model Engineering ...

Envoy) , gRPC/HTTP/2 , backpressure and circuit-breaking patterns. Streaming/eventing: Kafka/NATS/Pub-Sub , schema evolution (Protobuf/Avro), idempotency keys, and exactly-once vs at-least-once tradeoffs. Security: mTLS , OAuth/OIDC , JWT , x.509 , HSM/KMS , structured threat modeling ...

with data management technologies such as relational or columnar databases, data integration (ETL), or API development Familiarity with data formats such as JSON, XML, Avro, or Google Protocol Buffers Comfort engaging with the algorithms and mathematics behind languages, tooling, and data processing Academic background paired with hands‐on implementation ...

root‐cause analysis. Experience building or supporting production data pipelines in a collaborative engineering environment. Experience working with distributed data processing frameworks such as Apache Spark . Working knowledge of common data formats such as JSON , Avro and Parquet . Technology Environment The role will involve working with … should bring relevant experience and the ability to work across comparable technologies. Examples of technologies in scope include: Data processing and logic: ANSI SQL, Apache Spark, Kafka Platforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQ Engineering and deployment: CI/CD tooling, containerised ...

DevOps knowledge, including Linux/Unix, OpenShift/Kubernetes, and Ansible. Experience building and supporting reactive, event-sourced systems. Hands-on experience with Apache Spark and Apache Flink. Strong understanding of Apache HTTP, Envoy, and REST API design. Experience working with Protobuf, Avro, and Parquet data ...

/ML concepts, experience with LLMs, prompt engineering, or integrating AI capabilities into applications Data Technologies – Experience with Kafka, PySpark, Parquet and Avro data formats, Apache Airflow for workflow management, or Streamlit for building interactive data applications Advanced Data Management – Strong SQL design, query optimization, and database architecture ...

/ML concepts, experience with LLMs, prompt engineering, or integrating AI capabilities into applications • Data Technologies – Experience with Kafka, PySpark, Parquet and Avro data formats, Apache Airflow for workflow management, or Streamlit for building interactive data applications • Advanced Data Management – Strong SQL design, query optimization, and database architecture ...

/SpecFlow Microsoft Playwright WireMock Postman Newman Bruno CLI Development & Delivery Visual Studio Git Azure DevOps Repositories Azure DevOps YAML Pipelines Event Streaming & Messaging Apache Kafka (Aiven) Schema Registry Avro JSON Messaging RabbitMQ Data & Observability Microsoft SQL Server OpenTelemetry ClickStack/HyperDX ClickHouse ELK Stack (Elasticsearch, Logstash, Kibana ...

bash scripting. Experience with SQL databases and writing optimised queries. Experience with ClickHouse is a plus, but not required. Experience with Kafka (experience with Avro is a plus but not required). Experience with a wide range of enterprise Java and Spring components, including Spring Data JPA. Experience with … containerisation technologies such as Docker and Kubernetes. Experience with stream processing frameworks such as Apache Flink is a plus but not required. Familiarity with SSO mechanisms including OpenID is a plus but not required. A basic understanding of core microservice components such as service discovery, API gateway and service ...

hear from you! Advanced Stream Processing & Event-Driven Architecture: Proven track record building, deploying, and operating production‐grade, low-latency stream processing pipelines using Apache Kafka (or Kafka Streams, Flink, Spark Streaming). Idempotency & Event Reliability: Deep hands‐on experience handling duplicate events, out‐of‐order log processing, late … modeling data for both real‐time stream consumer patterns and downstream analytical stores (e.g., event schemas, state store schemas, schema evolution with Protobuf/Avro). Defensive Engineering & Failure Modes: You will instinctively design for dead‐letter queues, backpressure management, circuit breakers, and state‐store recovery. For everyone, everywhere. ...

C++ to make integrating with our APIs as simple as possible. Public Schema Registry: Implement a publicly accessible registry (e.g., Protobuf, JSON or Avro) that allow internal teams and partners to generate their own client software. Developer Collateral: Simplify Public Messaging: Partner with internal stakeholders to clearly communicate … code for public consumption. Technical Stack Environment: Google Cloud Platform (GCP), Apigee. Protocols: WebSockets, REST, GCS. Tooling: Python (Expert), OAuth 2.0, GitHub, Protobuf/Avro, SQL. Company Benefits Bonus Programme Equity Programme Employee Stock Purchase Plan (ESPP) Private Medical and Dental coverage Mental Health Benefit Programme Group Pension Plan ...

hear from you! Advanced Stream Processing & Event-Driven Architecture: Proven track record building, deploying, and operating production-grade, low-latency stream processing pipelines using Apache Kafka (or Kafka Streams, Flink, Spark Streaming). Idempotency & Event Reliability: Deep hands-on experience handling duplicate events, out-of-order log processing, late … modeling data for both real-time stream consumer patterns and downstream analytical stores (e.g., event schemas, state store schemas, schema evolution with Protobuf/Avro). Defensive Engineering & Failure Modes: You will instinctively design for dead-letter queues, backpressure management, circuit breakers, and state-store recovery. Additional Information Interested ...

scalable systems together. Key Experience Experience working with real-time streaming applications using Kafka Streams, including KStream and KTable concepts. Experience working with Apache Flink solutions, including stateful processing, checkpointing, and fault-tolerant approaches. Experience working with high-throughput, low-latency data pipelines that process and transform large volumes … implementing parsing solutions using libraries such as Prowide Core. Experience integrating distributed systems using Kafka Connect and working with schemas through AVRO and Confluent Schema Registry. Experience applying Flink SQL or Table API to support stream processing use cases. You may be assessed on the key critical skills relevant ...