18 of 18 Apache Avro Jobs in the UK

tenant isolation, row‐and‐column‐level security, and PII handling. Define the streaming and batch ingestion architecture, building on our investments in NATS JetStream, Apache Flink, and Debezium CDC patterns, and direct the engineering team on execution. Specify the catalog, lineage, and data‐quality foundation and own the operational … streaming vs batch). Hands‐on experience with: Dremio, Snowflake, or Databricks AWS data services (S3, Glue, Athena, Lake Formation, or equivalent) NATS/Apache Kafka or similar, and CDC patterns (Debezium or equivalent) Stream processing (Apache Flink, Spark Structured Streaming, or equivalent) SQL and query optimisation ...

Manager Data Modelling Skills Star Schema Snowflake Schema Dimensional Modeling Data Vault Data Warehouse Design Data Lake Architecture Data Formats Experience working with: Parquet Avro JSON CSV ORC CI/CD & DevOps Git GitHub GitLab Bitbucket Jenkins GitHub Actions GitLab CI/CD AWS DevOps Tools Domain Experience (Preferred ...

/TypeScript React Real‐time dashboards (REST/WebSocket) Modern UI state management Distributed systems experience Kafka/Chronicle PostgreSQL/KDB+ Caching strategies Avro/Protobuf DevOps skills Linux Docker/Kubernetes CI/CD (GitHub Actions/Jenkins) Infrastructure‐as‐Code Competencies Customer Focus Driving Change Driving ...

Manager Data Modelling Skills Star Schema Snowflake Schema Dimensional Modeling Data Vault Data Warehouse Design Data Lake Architecture Data Formats Experience working with: Parquet Avro JSON CSV ORC CI/CD & DevOps Git GitHub GitLab Bitbucket Jenkins GitHub Actions GitLab CI/CD AWS DevOps Tools Domain Experience (Preferred ...

tradeoffs between different technology and architectural choices and driving them to consensus. Experience with multiple data formats and serialization systems (e.g. Protobuf/gRPC, Avro, Thrift, JSON, etc.). Experience owning products end-to-end, from requirements through operations. Experience responding to, managing, and resolving incidents. Experience managing ...

fault-tolerant services Experience with data pipelines — ingestion, transformation, lineage, streaming and batch Solid API and structured-data fluency: REST/gRPC, JSON/Avro/Protobuf Sound CI/CD and testing discipline — correctness matters in high-assurance work Self-directing: able to take an ambiguous problem ...

Databases, and/or Data Integration (ETL) or API development. Knowledge of some Data Formats such as JSON, XML, and binary formats such as Avro or Google Protocol Buffers. Experience collaborating with business and technical teams to understand, translate, review, and playback requirements and collaborate to develop Model Engineering ...

Databases, and/or Data Integration (ETL) or API development. Knowledge of some Data Formats such as JSON, XML, and binary formats such as Avro or Google Protocol Buffers. Experience collaborating with business and technical teams to understand, translate, review, and playback requirements and collaborate to develop Model Engineering ...

with data management technologies such as relational or columnar databases, data integration (ETL), or API development Familiarity with data formats such as JSON, XML, Avro, or Google Protocol Buffers Comfort engaging with the algorithms and mathematics behind languages, tooling, and data processing Academic background paired with hands‐on implementation ...

with data management technologies such as relational or columnar databases, data integration (ETL), or API development Familiarity with data formats such as JSON, XML, Avro, or Google Protocol Buffers Comfort engaging with the algorithms and mathematics behind languages, tooling, and data processing Academic background paired with hands‐on implementation ...

accountable. Additional Exposure To the following is desired: Tech Stack you will learn Hadoop and Flink RUST, Javascript, React, Redux, Flow Linux, Jenkins Kafka, Avro, Kubernetes, Puppet Involvement in the Java community My client is based in London. #J-18808-Ljbffr ...

engineers and support code reviews, design reviews, and engineering best practices. Your Skills: Strong hands-on experience with Databricks on AWS. Strong experience with Apache Spark/PySpark. Excellent programming skills in Python. Strong SQL skills including complex queries, joins, CTEs, window functions, and query optimization. Experience with Spark … storage layer. Experience in building ETL/ELT pipelines for batch and near-real-time data processing. Experience with data formats such as Parquet, Avro, ORC, JSON, and CSV. Good understanding of data modelling, data warehousing, and dimensional modelling concepts. Experience with data validation, reconciliation, data quality, audit ...

root‐cause analysis. Experience building or supporting production data pipelines in a collaborative engineering environment. Experience working with distributed data processing frameworks such as Apache Spark . Working knowledge of common data formats such as JSON , Avro and Parquet . Technology Environment The role will involve working with … should bring relevant experience and the ability to work across comparable technologies. Examples of technologies in scope include: Data processing and logic: ANSI SQL, Apache Spark, Kafka Platforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQ Engineering and deployment: CI/CD tooling, containerised ...

root‐cause analysis. Experience building or supporting production data pipelines in a collaborative engineering environment. Experience working with distributed data processing frameworks such as Apache Spark . Working knowledge of common data formats such as JSON , Avro and Parquet . Technology Environment The role will involve working with … should bring relevant experience and the ability to work across comparable technologies. Examples of technologies in scope include: Data processing and logic: ANSI SQL, Apache Spark, Kafka Platforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQ Engineering and deployment: CI/CD tooling, containerised ...

/ML concepts, experience with LLMs, prompt engineering, or integrating AI capabilities into applications • Data Technologies – Experience with Kafka, PySpark, Parquet and Avro data formats, Apache Airflow for workflow management, or Streamlit for building interactive data applications • Advanced Data Management – Strong SQL design, query optimization, and database architecture ...

technical design reviews. Must Haves (Hard Skills) Data Lakehouse Mastery: Proven experience building data infrastructure using Trino/Presto and open table formats like Apache Iceberg or Delta Lake. Advanced Data Modeling: Deep expertise in Medallion Architecture patterns, Star Schemas, and processing semi‐structured financial data logs (JSON/… Avro). Robust ETL/ELT Orchestration: Expert proficiency in data transformation engines (such as dbt) and scheduling tools (such as Airflow). Stream/Message Queues: Solid understanding of event‐driven architectures and streaming processing via Apache Kafka. Strong Programming Foundations: Proficiency in Python ...

technical design reviews. Must Haves (Hard Skills) Data Lakehouse Mastery: Proven experience building data infrastructure using Trino/Presto and open table formats like Apache Iceberg or Delta Lake. Advanced Data Modeling: Deep expertise in Medallion Architecture patterns, Star Schemas, and processing semi-structured financial data logs (JSON/… Avro). Robust ETL/ELT Orchestration: Expert proficiency in data transformation engines (such as dbt) and scheduling tools (such as Airflow). Stream/Message Queues: Solid understanding of event-driven architectures and streaming processing via Apache Kafka. Strong Programming Foundations: Proficiency in Python ...

Python, C++), ensuring they provide a consistent developer experience for both external customers and internal users. Implement a public schema registry (Protobuf, JSON or Avro) to enable partner and internal teams to generate client software. Collaborate with stakeholders to craft clear messaging, technical documentation, and first‐class reference documentation … cloud‐native SDKs and APIs on Google Cloud Platform (GCP), Apigee, and related technologies. Familiarity with WebSockets, REST, GCS, OAuth 2.0, GitHub, Protobuf/Avro, and SQL. Polymathic ability to bridge business strategy, engineering, and technical writing. Demonstrated problem‐solving skills and the capacity to work independently ...