1 to 25 of 48 Permanent Apache Avro Jobs

and understanding of secure development practices include OWASP guidelines/top 10, SOC 2, and NCSC cloud security principles. Experience in data and orchestration tools including some of dbt, Apache Airflow, Azure Data Factory. Experience in programming languages including some of Python, Typescript, Javascript, R, Java, C#, producing services, APIs, Function Apps or Lambdas. The use of various standard More ❯

requires handling classified data and building robust, scalable data processing solutions to support critical intelligence operations. Key Responsibilities Data Pipeline Development Design and implement automated data ingestion pipelines using Apache NiFi, Python, and other enterprise data tools Develop ETL/ELT processes for structured and unstructured classified datasets Build real-time and batch processing workflows to support analytical requirements … classification handling procedures Qualifications Required Qualifications: Active TS/SCI with CI poly Ability to work within JWICS and other classified networks Technical Skills 3+ years of experience with Apache NiFi for data flow automation Strong proficiency in Python for data processing and pipeline development Experience with SQL databases (PostgreSQL, Oracle, SQL Server) Knowledge of big data technologies (Hadoop … Spark, Kafka) Familiarity with cloud platforms and containerization (Docker, Kubernetes) Understanding of data formats (JSON, XML, Parquet, Avro) Professional Experience Bachelor's degree in Computer Science, Engineering, or related field 5+ years of experience in data engineering or related roles Experience working in classified or high-security environments preferred Knowledge of intelligence community data standards and protocols Desired Qualifications More ❯

Key Responsibilities Design and implement real-time data pipelines using tools like Apache Kafka, Apache Flink, or Spark Streaming. Develop and maintain event schemas using Avro, Protobuf, or JSON Schema. Collaborate with backend teams to integrate event-driven microservices. Ensure data quality, lineage, and observability across streaming systems. Optimize performance and scalability of streaming applications. Implement CI More ❯

Key Responsibilities Design and implement real-time data pipelines using tools like Apache Kafka, Apache Flink, or Spark Streaming. Develop and maintain event schemas using Avro, Protobuf, or JSON Schema. Collaborate with backend teams to integrate event-driven microservices. Ensure data quality, lineage, and observability across streaming systems. Optimize performance and scalability of streaming applications. Implement CI More ❯

Key Responsibilities Design and implement real-time data pipelines using tools like Apache Kafka, Apache Flink, or Spark Streaming. Develop and maintain event schemas using Avro, Protobuf, or JSON Schema. Collaborate with backend teams to integrate event-driven microservices. Ensure data quality, lineage, and observability across streaming systems. Optimize performance and scalability of streaming applications. Implement CI More ❯

Key Responsibilities Design and implement real-time data pipelines using tools like Apache Kafka, Apache Flink, or Spark Streaming. Develop and maintain event schemas using Avro, Protobuf, or JSON Schema. Collaborate with backend teams to integrate event-driven microservices. Ensure data quality, lineage, and observability across streaming systems. Optimize performance and scalability of streaming applications. Implement CI More ❯

Key Responsibilities Design and implement real-time data pipelines using tools like Apache Kafka, Apache Flink, or Spark Streaming. Develop and maintain event schemas using Avro, Protobuf, or JSON Schema. Collaborate with backend teams to integrate event-driven microservices. Ensure data quality, lineage, and observability across streaming systems. Optimize performance and scalability of streaming applications. Implement CI More ❯

Key Responsibilities Design and implement real-time data pipelines using tools like Apache Kafka, Apache Flink, or Spark Streaming. Develop and maintain event schemas using Avro, Protobuf, or JSON Schema. Collaborate with backend teams to integrate event-driven microservices. Ensure data quality, lineage, and observability across streaming systems. Optimize performance and scalability of streaming applications. Implement CI More ❯

Azure, AWS, GCP) Hands-on experience with SQL, Data Pipelines, Data Orchestration and Integration Tools Experience in data platforms on premises/cloud using technologies such as: Hadoop, Kafka, Apache Spark, Apache Flink, object, relational and NoSQL data stores. Hands-on experience with big data application development and cloud data warehousing (e.g. Hadoop, Spark, Redshift, Snowflake, GCP BigQuery … Expertise in building data architectures that support batch and streaming paradigms Experience with standards such as JSON, XML, YAML, Avro, Parquet Strong communication skills Open to learning new technologies, methodologies, and skills As the successful Data Engineering Manager you will be responsible for: Building and maintaining data pipelines Identifying and patching issues and bugs identified in the pipeline/ More ❯

Load (ETL) data engineering Experience with REST APIs Experience with Java Experience with full lifecycle agile software development projects Desired skills: Experience with Python. Experience building data products in Apache Avro and/or Parquet On-the-job experience with Java software development. Experience deploying the complete DevOps Lifecycle including integration of build pipelines, automated deployments, and compliance More ❯

and innovation. Mandatory Requirements: 9 - 12+ years building and scaling distributed systems in agile/DevOps organizations. Expert in Java, Spring Boot , RESTful microservices, and event-driven architectures ( Kafka , Avro). Strong frontend acumen with React, JavaScript/TypeScript , and API-first integration (OpenAPI). Deep familiarity with Kubernetes orchestration , container security, and infrastructure as code. English level: C1 More ❯

Knowledge of Data Management technologies such as Relational and Columnar Databases, Data Integration (ETL), or API development. Familiarity with data formats like JSON, XML, and binary formats such as Avro or Google Protocol Buffers. Experience working with business and technical teams to develop Model Engineering solutions. Proficiency with tools like SQL, JavaScript, or Python for data analysis. Strong communication More ❯

Engineers to guide teams in building and maintaining complex data pipelines. These pipelines ingest and transform data from diverse sources (e.g., email, CSV, ODBC/JDBC, JSON, XML, Excel, Avro, Parquet) using AWS technologies such as S3, Athena, Redshift, Glue, and programming languages like Python and Java (Docker/Spring) . What You’ll Do Lead the design and More ❯

Leeds (2days/week Onsite) Duration: 06+ Months Job Summary: We are looking for an experienced Kafka Architect to design and implement scalable, high-throughput data streaming solutions using Apache Kafka on Cloudera (on-premises). The ideal candidate will have a strong background in distributed systems, data pipelines, and real-time data processing. Key Responsibilities: -Design and implement … needs. -Automate deployment and configuration using tools like Ansible, Terraform, or Cloudera Manager. -Provide technical leadership and mentorship to junior team members. Required Skills: -Strong hands-on experience with Apache Kafka (including Kafka Connect, Kafka Streams). -Experience with Cloudera distribution for Kafka on on-premises environments. -Proficiency in designing high-volume, low-latency data pipelines. -Solid knowledge of … Kafka internals – topics, partitions, consumer groups, offset management, etc. -Experience with data serialization formats like Avro, JSON, Protobuf. -Proficient in Java, Scala, or Python for Kafka-based development. -Familiarity with monitoring tools (Prometheus, Grafana, Confluent Control Center, etc.). -Understanding of networking, security (SSL/SASL), and data governance. -Experience with CI/CD pipelines and containerization (Docker, Kubernetes More ❯

Are Some Things We’ve Worked On Recently That Might Give You a Better Sense Of What You’ll Be Doing Day To Day Improving systems integration performance, using Apache Ni-Fi, by balancing scaling and flow improvements through chunking Implementing AWS Security Control Policies to manage global access privileges. Validating and Converting data into a common data format … using Avro Schemas and JOLT Designing a proxy in-front of our Kubernetes cluster egress to whitelist traffic and mitigate any security risks Implementing Access/Role Based Access Control in ElasticSearch Writing a React UI using an ATDD approach with Cypress Right Now, We Are Particularly Looking For Core Skills: React, JavaScript, TypeScript, Kubernetes, AWS familiarity, Automated testing More ❯

upskill colleagues. Mandatory requirements: +5 years building and scaling distributed systems in agile/DevOps organizations . Expert in Java, Spring Boot, RESTful microservices, and event-driven architectures (Kafka, Avro). Strong frontend acumen with React, JavaScript/TypeScript, and API-first integration (OpenAPI). Deep familiarity with Kubernetes orchestration, container security, and infrastructure as code. Proven track record More ❯

What UST expects from you? +5 years building and scaling distributed systems in agile/DevOps organizations. Expert in Java , Spring Boot, RESTful microservices, and event-driven architectures (Kafka, Avro). Strong frontend acumen with React, JavaScript/TypeScript, and API-first integration (OpenAPI). Deep familiarity with Kubernetes orchestration, container security, and infrastructure as code. Proven track record More ❯

Engineers to guide teams in building and maintaining complex data pipelines. These pipelines ingest and transform data from diverse sources (e.g., email, CSV, ODBC/JDBC, JSON, XML, Excel, Avro, Parquet) using AWS technologies such as S3, Athena, Redshift, Glue, and programming languages like Python and Java (Docker/Spring) . What You’ll Do Lead the design and More ❯

are some things we’ve worked on recently that might give you a better sense of what you’ll be doing day to day: Improving systems integration performance, using Apache Ni-Fi, by balancing scaling and flow improvements through chunking Implementing AWS Security Control Policies to manage global access privileges. Validating and Converting data into a common data format … using Avro Schemas and JOLT Designing a proxy in-front of our Kubernetes cluster egress to whitelist traffic and mitigate any security risks Implementing Access/Role Based Access Control in ElasticSearch Writing a React UI using an ATDD approach with Cypress Right now, we are particularly looking for: Familiarity with: AWS, Other automated testing frameworks (e.g. Playwright, Cucumber More ❯

are some things we’ve worked on recently that might give you a better sense of what you’ll be doing day to day: Improving systems integration performance, using Apache Ni-Fi, by balancing scaling and flow improvements through chunking Implementing AWS Security Control Policies to manage global access privileges. Validating and Converting data into a common data format … using Avro Schemas and JOLT Designing a proxy in-front of our Kubernetes cluster egress to whitelist traffic and mitigate any security risks Implementing Access/Role Based Access Control in ElasticSearch Writing a React UI using an ATDD approach with Cypress Right now, we are particularly looking for: Familiarity with: AWS, Other automated testing frameworks (e.g. Playwright, Cucumber More ❯

are some things Naimuri have worked on recently that might give you a better sense of what you'll be doing day to day: Improving systems integration performance, using Apache Ni-Fi, by balancing scaling and flow improvements through chunking Implementing AWS Security Control Policies to manage global access privileges. Validating and Converting data into a common data format … using Avro Schemas and JOLT Designing a proxy in-front of our Kubernetes cluster egress to allowlist traffic and mitigate any security risks Implementing Access/Role Based Access Control in ElasticSearch Writing React UI using an ATDD approach with Cypress Improving docker-compose config and README instructions to improve Developer Experience About you We're looking for someone More ❯

systems in agile/DevOps organizations. BS/MS in Computer Science (or equivalent industry experience). Expert in Java, Spring Boot, RESTful microservices, and event-driven architectures (Kafka, Avro). Strong frontend acumen with React, JavaScript/TypeScript, and API-first integration (OpenAPI). Deep familiarity with Kubernetes orchestration, container security, and infrastructure as code. Technology Stack Backend … Java, Spring Boot, Entity Framework, REST Frontend: React , Angular, JavaScript/TypeScript Data & Messaging: Oracle, PostgreSQL, Kafka, Avro Infrastructure & DevOps: Kubernetes (PKS), Docker, Helm, Terraform APIs & Modeling: API-first (OpenAPI), UML Languages: English C1 What can we offer? ️ 23 days of Annual Leave plus the 24th and 31st of December as discretionary days! ️ Numerous benefits (Health Care Plan, teleworking More ❯

/DevOps organizations. o BS/MS in Computer Science (or equivalent industry experience). • Technical Mastery Expert in Java, Spring Boot, RESTful microservices, and event-driven architectures (Kafka, Avro). Strong frontend acumen with React, JavaScript/TypeScript, and API-first integration (OpenAPI). Deep familiarity with Kubernetes orchestration, container security, and infrastructure as code. • Architectural & Analytical Skills … continuous improvement and fostering a world-class engineering culture. Technology Stack Backend: Java, Spring Boot, Entity Framework, REST Frontend: React, Angular, JavaScript/TypeScript Data & Messaging: Oracle, PostgreSQL, Kafka, Avro Infrastructure & DevOps: Kubernetes (PKS), Docker, Helm, Terraform APIs & Modeling: API-first (OpenAPI), UML Languages: English C1 Spanish C2 What can we offer? 23 days of Annual Leave plus the More ❯

organizations. o o BS/MS in Computer Science (or equivalent industry experience). • Technical Mastery o Expert in Java, Spring Boot, RESTful microservices, and event-driven architectures (Kafka, Avro). o Strong frontend acumen with React, JavaScript/TypeScript, and API-first integration (OpenAPI). o Deep familiarity with Kubernetes orchestration, container security, and infrastructure as code. • Architectural … continuous improvement and fostering a world-class engineering culture. Technology Stack • Backend: Java, Spring Boot, Entity Framework, REST • Frontend: React, Angular, JavaScript/TypeScript • Data & Messaging: Oracle, PostgreSQL, Kafka, Avro • Infrastructure & DevOps: Kubernetes (PKS), Docker, Helm, Terraform • APIs & Modeling: API-first (OpenAPI), UML Languages: • English C1 • Spanish C2 What can we offer? ️ 23 days of Annual Leave plus the More ❯

/DevOps organizations. o BS/MS in Computer Science (or equivalent industry experience). • Technical Mastery Expert in Java, Spring Boot, RESTful microservices, and event-driven architectures (Kafka, Avro). Strong frontend acumen with React, JavaScript/TypeScript, and API-first integration (OpenAPI). Deep familiarity with Kubernetes orchestration, container security, and infrastructure as code. • Architectural & Analytical Skills … continuous improvement and fostering a world-class engineering culture. Technology Stack Backend: Java, Spring Boot, Entity Framework, REST Frontend: React, Angular, JavaScript/TypeScript Data & Messaging: Oracle, PostgreSQL, Kafka, Avro Infrastructure & DevOps: Kubernetes (PKS), Docker, Helm, Terraform APIs & Modeling: API-first (OpenAPI), UML Languages: English C1 Spanish C2 What can we offer? ️ 23 days of Annual Leave plus the More ❯