1 to 25 of 2,586 Kafka Jobs

computing engineers, and systems engineers, to ensure efficient data processing, secure storage, and insightful analysis. This position requires hands-on experience and expertise with Kafka, AWS, and MongoDB Responsibilities Upgrade and/or maintain Kafka clusters in an AWS/Kubernetes cloud environment Design, Develop, and Deploy Kafka clusters in an AWS/Kubernetes cloud environment Manage schema evolution and security using Kafka Schema Registry and Kafka Security Manager (KSM) Oversee the assessment, design, building, and maintenance of scalable platforms Requirements Kafka experience: Kafka Connect, Kafka Streams, and other Kafka ecosystem … tools Kafka knowledge of/with: Kafka Schema Security Manager, Kafka Schema Registry, and Kafka architecture and internals Experience with Apache NiFI Experience with AWS Experience with MongoDB, Redis Experience with agile development methodologies Data Pipeline Experience: You will be involved with acquiring and prepping data More ❯

Job Title: Kafka Architect- Cloudera Location: Leeds (2days/week Onsite) Duration: 06+ … Months Job Summary: We are looking for an experienced Kafka Architect to design and implement scalable, high-throughput data streaming solutions using Apache Kafka on Cloudera (on-premises). The ideal candidate will have a strong background in distributed systems, data pipelines, and real-time data processing. Key … tools like Ansible, Terraform, or Cloudera Manager. -Provide technical leadership and mentorship to junior team members. Required Skills: -Strong hands-on experience with Apache Kafka (including Kafka Connect, Kafka Streams). -Experience with Cloudera distribution for Kafka on on-premises environments. -Proficiency in designing high-volume More ❯

Job description As part of the CTO Data Ingestion Service, the incumbent will be required to: Designing and architecting scalable, real-time systems in Kafka, with a focus on on-premise Cloudera open source Kafka and disaster recovery aspects. Configuring, deploying, and maintaining Kafka clusters to ensure … high availability, resiliency, and scalability, including understanding and explaining features like KRAFT. Integrating Kafka with other data processing tools and platforms such as Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry, Flink, and Beam. Collaborating with cross-functional teams to understand data requirements and design solutions that … of Kafka resiliency and new features like KRAFT Experience with real-time technologies such as Spark Required Skills & Experience Extensive experience with Apache Kafka and real-time architecture including event-driven frameworks. Strong knowledge of Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry, Flink, and Beam. More ❯

We are seeking a highly experienced and skilled Senior Kafka Engineer to join our team. The ideal candidate will have a proven track record of designing, implementing, and maintaining large-scale Kafka deployments, with specific experience upgrading Kafka clusters. This role requires a deep understanding of Kafka … practices. The candidate must be comfortable working independently and collaboratively within a fast-paced environment. Responsibilities: Design, implement, and maintain high-throughput, low-latency Kafka clusters. Lead the upgrade of existing Kafka clusters from version 3.3.1 to the latest supported version, ensuring minimal downtime and data integrity. Experience … in confluent migration (link removed)> Develop and implement monitoring and alerting systems for Kafka. Troubleshoot and resolve Kafka-related issues. Participate in on-call rotation to ensure 24/7 system availability. Collaborate with other engineers to integrate Kafka into existing systems. Design and implement Kafka security More ❯

Join to apply for the Senior Kafka Platform Engineer role at TradingView 3 weeks ago Be among the first 25 applicants Join to apply for the Senior Kafka Platform Engineer role at TradingView Join TradingView, the world’s #1 platform and social network for traders and investors — 100M+ … an impact on millions every day, look no further. About your mission! - Make an impact We're seeking an experienced DevOps Engineer with strong Kafka expertise to join our growing team. This role will focus on managing and optimizing our Kafka infrastructure while also contributing to our internal … developer platform initiatives. As a Senior engineer, you will be expected to shape Kafka strategy, interact with developer teams, solve production issues and introduce best practices. How You’ll Drive Success Manage Kafka clusters running in Kubernetes environments Implement and maintain Kafka connectors and MirrorMaker2 Develop automation More ❯

into functional and intuitive applications. Develop and maintain robust Java applications using Spring Boot and microservices architecture. Implement real-time data streaming solutions using Kafka to ensure timely and accurate data delivery. Optimize application performance to handle large datasets and complex financial calculations. Ensure the reliability, scalability, and security More ❯

understanding of cloud technologies (AWS, GCP, Azure, etc.). Good understanding of security frameworks and standards. Good understanding of data streaming and messaging frameworks (Kafka, Spark, etc.). Good understanding of distributed tracing and monitoring (Zipkin, OpenTracing, Prometheus, ELK stack, Micrometer metrics, etc.). Good understanding of containers (Docker More ❯

including modules such as Spring Data, Security, and Cloud), Microservice Architecture, and SQL/NoSQL databases. Proficiency with ORM frameworks (e.g., Hibernate), messaging tools (Kafka, Kinesis, Redis), and cloud infrastructure technologies (AWS, Docker, Kubernetes, Terraform). Strong understanding of CI/CD pipelines, observability tools (e.g., DataDog), and Agile More ❯

to translate business and research needs into engineering roadmaps. Collaborative mindset, capable of interfacing with multi-disciplinary teams. Nice to Have: Experience with Redis, Kafka, or similar real-time streaming/data platforms. Familiarity with financial APIs, FIX protocol, or trading exchange integrations. Education: Bachelor’s or Master’s More ❯

to translate business and research needs into engineering roadmaps. Collaborative mindset, capable of interfacing with multi-disciplinary teams. Nice to Have: Experience with Redis, Kafka, or similar real-time streaming/data platforms. Familiarity with financial APIs, FIX protocol, or trading exchange integrations. Education: Bachelor’s or Master’s More ❯

to translate business and research needs into engineering roadmaps. Collaborative mindset, capable of interfacing with multi-disciplinary teams. Nice to Have: Experience with Redis, Kafka, or similar real-time streaming/data platforms. Familiarity with financial APIs, FIX protocol, or trading exchange integrations. Education: Bachelor’s or Master’s More ❯

engineers and stakeholders Understanding of the full software development lifecycle and agile approach Hands-on experience with event driven architecture and distributed messaging technologies ( Kafka ) Preferred qualifications, capabilities, and skills Hands on experience another statically compiled language like Golang, Rust or C++ Experience with gRPC and Google Protocol Buffers More ❯

years of experience managing software development projects through complete release cycles 4 years of experience in big data and event streaming technologies: Spark, Kafka, etc. 4 years of experience leading software engineering teams 4 years of experience with container and orchestration: Docker, Kubernetes, etc. 4 years of experience in More ❯

This job is brought to you by Jobs/Redefined, the UK's leading over-50s age inclusive jobs board. Job Description Be an integral part of an agile team that's constantly pushing the envelope to enhance, build, and More ❯

React , Angular , or Vue.js for full-stack development is a plus. Event-Driven Architecture: Experience with event-driven architectures or message queuing systems (e.g., Kafka , RabbitMQ ) is beneficial. Education: A degree in Computer Science , Engineering , or a related field is preferred but not required. #J-18808-Ljbffr More ❯

Strong understanding of distributed systems, microservices architectures, and the challenges of building high-throughput, low-latency systems. Hands-on experience with tools like Apache Kafka , RabbitMQ , Apache Pulsar , and other messaging systems for real-time data streaming. DevOps and Infrastructure Automation : Expertise in DevOps principles, infrastructure-as-code, and More ❯

critical projects. Familiarity with Infrastructure as Code (IaC) tools like Terraform , CloudFormation , or AWS CDK . Exposure to event-driven or reactive architectures (e.g., Kafka, Pub/Sub, or similar systems). We also offer: An employer pension scheme 25 days holiday + 8 bank holidays, with the option More ❯

little supervision. Basic Qualifications: Proficiency and/or knowledge of the following: Angular, JavaScript, CSS, & HTML, & Material UI, JAVA etc AWS Cloud, EKS, Kubernetes, Kafka, Jenkins, Ansible, Docker, GIT, Red Hat Enterprise Linux (RHEL) Oracle/MySQL/Postgres, microservices, Springboot, Java. KABANA or Dynatrace dashboard for monitoring and More ❯

Experience developing REST-based APIs Some experience with SQL is required, and exposure to SQL stored procedures and indexes is preferred. Experience with Apache Kafka, including designing, implementing, and managing distributed messaging systems for real-time data processing is beneficial. Experience with DevOps and CI/CD tools (such More ❯

Preferred (Nice to Have): Experience working in the banking or financial services domain Knowledge of cloud platforms like AWS , Azure , or GCP Exposure to Kafka or other messaging systems Experience with Frontend frameworks (Angular/React) is a plus More ❯

across functions. Desirable/Advantageous Skills Exposure to cloud technologies (AWS, GCP, or Azure) and containerization (Docker, Kubernetes). Familiarity with messaging systems like Kafka or RabbitMQ. Interest or academic exposure to financial services, especially payments and transaction banking. Experience working in a regulated environment or large-scale enterprise More ❯

TDD or BDD frameworks like Cucumber or Selenium to ensure code quality Experience with both relational and NoSQL databases such as Postgres and MongoDB, KAFKA or MQ, or any other event-driven framework Skills in using CI/CD tools, preferably GitLab or GitHub, and deploying on AWS Kubernetes More ❯

APIs, GraphQL, and microservices architecture. Proficiency with DevOps tools and CI/CD pipelines (Docker, Kubernetes, Jenkins, Bitbucket Pipelines). Experience in data processing (Kafka, Redis streams) & analytics (Superset, Elastic Search). Excellent problem-solving skills and ability to work in a fast-paced environment. Great communication skills to More ❯

Application Frameworks (ASP.NET MVC, SPA) Enterprise content management achieved through Sitecore RESTful Microservices – light-weight efficient, decoupled APIs that scale well. Event driven architectures (Kafka) Modern reactive JavaScript Frameworks (React, Next.js, Vue.js, Angular) Advanced web topologies (Headless, Jamstack) Storage technologies like SQL, Redis and SOLR Automated UI and API More ❯

you? +5 years building and scaling distributed systems in agile/DevOps organizations. Expert in Java , Spring Boot, RESTful microservices, and event-driven architectures (Kafka, Avro). Strong frontend acumen with React, JavaScript/TypeScript, and API-first integration (OpenAPI). Deep familiarity with Kubernetes orchestration, container security, and More ❯