26 to 32 of 32 Apache Avro Jobs

technical design reviews.Must Haves (Hard Skills)Data Lakehouse Mastery: Proven experience building data infrastructure using Trino/Presto and open table formats like Apache Iceberg or Delta Lake.Advanced Data Modeling: Deep expertise in Medallion Architecture patterns, Star Schemas, and processing semi-structured financial data logs (JSON/Avro … engines (such as dbt) and scheduling tools (such as Airflow).Stream/Message Queues: Solid understanding of event-driven architectures and streaming processing via Apache Kafka.Strong Programming Foundations: Proficiency in Python, SQL, or an Object-Oriented language (Java/Scala).Nice to HavesExperience operating data assets within a regulated ...

technical design reviews. Must Haves (Hard Skills)Data Lakehouse Mastery: Proven experience building data infrastructure using Trino/Presto and open table formats like Apache Iceberg or Delta Lake. Advanced Data Modeling: Deep expertise in Medallion Architecture patterns, Star Schemas, and processing semi-structured financial data logs (JSON/… Avro).Robust ETL/ELT Orchestration: Expert proficiency in data transformation engines (such as dbt) and scheduling tools (such as Airflow).Stream/Message Queues: Solid understanding of event-driven architectures and streaming processing via Apache Kafka. Strong Programming Foundations: Proficiency in Python, SQL, or an Object-Oriented ...

root‐cause analysis Experience building or supporting production data pipelines in a collaborative engineering environment Experience with distributed data processing frameworks such as Apache Spark Working knowledge of JSON, Avro and Parquet Nice to have: technical design ownership across multiple datasets or pipeline domains, experience guiding implementation standards ...

Python and C++ to make integrating with our APIs as simple as possible.Public Schema Registry: Implement a publicly accessible registry (e.g., Protobuf, JSON or Avro) that allow internal teams and partners to generate their own client software.Developer CollateralSimplify Public Messaging: Partner with internal stakeholders to clearly communicate CME Group … clean, idiomatic, and robust code for public consumption.Technical StackEnvironment: Google Cloud Platform (GCP), Apigee.Protocols: WebSockets, REST, GCS.Tooling: Python (Expert), OAuth 2.0, GitHub, Protobuf/Avro, SQL.Company Benefits:Bonus ProgrammeEquity ProgrammeEmployee Stock Purchase Plan (ESPP)Private Medical and Dental coverageMental Health Benefit ProgrammeGroup Pension PlanIncome ProtectionLife AssuranceCycle To WorkEV ...

C++ to make integrating with our APIs as simple as possible. + Public Schema Registry: Implement a publicly accessible registry (e.g., Protobuf, JSON or Avro) that allow internal teams and partners to generate their own client software.* Developer Collateral + Simplify Public Messaging: Partner with internal stakeholders to clearly … code for public consumption.**Technical Stack*** Environment: Google Cloud Platform (GCP), Apigee.* Protocols: WebSockets, REST, GCS.* Tooling: Python (Expert), OAuth 2.0, GitHub, Protobuf/Avro, SQL.**Company Benefits:*** Bonus Programme* Equity Programme* Employee Stock Purchase Plan (ESPP)* Private Medical and Dental coverage* Mental Health Benefit Programme* Group Pension Plan ...

secure AWS data lake Designing secure integration patterns across multiple classifications and MOD operating environments Defining conceptual, logical and physical data models Specifying Apache NiFi architecture patterns, flow standards and reusable ingestion components Designing REST API, SOAP, file-based, batch, legacy and bespoke integrations Defining governance, metadata, lineage, auditability … experience designing secure AWS data platforms and data lake architectures Knowledge of AWS security, IAM, networking, storage and relevant data services Extensive experience with Apache NiFi architecture, flow design and governance Experience designing REST, SOAP, file, batch, legacy and bespoke integrations Knowledge of structured, semi-structured and unstructured data ...

bespoke integration approaches for source-system onboarding. Define conceptual, logical and physical data models, including data flows, data domains and data ownership considerations. Specify Apache NiFi architecture patterns, flow standards, interface contracts and reusable ingestion components. Define governance, metadata, lineage, auditability, security monitoring and data quality requirements. Produce High … lake architectures on AWS. Strong knowledge of AWS security, IAM, networking, storage and data platform services relevant to secure data engineering. Extensive experience with Apache NiFi architecture, flow design, governance and operational considerations. Experience designing integrations using REST APIs, SOAP services, file transfers, batch ingestion, legacy adapters and bespoke ...