1 to 25 of 345 Kafka Jobs

Job description As part of the CTO Data Ingestion Service, the incumbent will be required to: • Designing and architecting scalable, real-time systems in Kafka. • Configuring, deploying, and maintaining Kafka clusters to ensure high availability and scalability. • Integrating Kafka with other data processing tools and platforms such as Kafka Streams, Kafka Connect, Spark Streaming Schema Registry … Flink and Beam. • Collaborating with cross-functional teams to understand data requirements and design solutions that meet business needs. • Implementing security measures to protect Kafka clusters and data streams. • Monitoring Kafka performance and troubleshooting issues to ensure optimal performance. • Providing technical guidance and support to development operations teams. • Staying updated with the latest Kafka features, updates and … on Disaster Recovery aspects • Read up and explain new features like KRAFT • Kafka Resiliency • Any Real time tech experience like Spark Required Skills Experience • Extensive Experience with Apache Kafka and real-time architecture including event driven frameworks. • Strong Knowledge of Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry, Flink and Beam. • Experience with cloud platform such More ❯

Title: Devops Lead Location: Leeds, United Kingdom (Hybrid- 2 days/week) Job Type: Contract Inside IR35 Client: Wipro Mandatory Skills: Ansible Tower Experience: 8+ Years Detailed JD: A Kafka Real-Time Architect is responsible for designing and implementing scalable, real time data processing systems in Kafka. This role involves architecting Kafka cluster, ensuring high availability, and integrating … and platforms As part of the CTO Data Ingestion Service, the incumbent will be required to: Designing and architecting scalable, real-time systems in Kafka. Configuring, deploying, and maintaining Kafka clusters to ensure high availability and scalability. Integrating Kafka with other data processing tools and platforms such as Kafka Streams, Kafka Connect, Spark Streaming Schema Registry … performance. Providing technical guidance and support to development operations teams. Staying updated with the latest Kafka features, updates and industry practices. Required Skills Experience Extensive Experience with Apache Kafka and real-time architecture including event driven frameworks. Strong Knowledge of Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry, Flink and Beam. Experience with cloud platform such More ❯

systems. Ability to lead and collaborate in Agile development environments. Excellent problem-solving skills and communication abilities. Experience mentoring or managing developers. Preferred Qualifications Experience with event-driven architecture, Kafka, RabbitMQ, or messaging frameworks. Understanding of security best practices, identity management, and authentication. Exposure to automated testing frameworks such as JUnit, Mockito, Selenium, or Cypress. Prior experience in a More ❯

Java 17+) Spring Boot Spring Data JPA & Hibernate Spring Security (authentication, authorization, JWT) JUnit & Mockito for testing Relational databases: Azure SQL, Snowflake, Oracle Non-relational databases: Redis, MongoDB Messaging: Kafka Hands-on experience with Docker and Kubernetes Advanced Azure developer skills (knowledge of resources such as AKS, APIM, App Gateway, Front Door, Key Vaults, etc ReactJS for UI development More ❯

GitLab CI, GitHub Actions, etc.).Strong understanding of security principles and performance tuning.Excellent problem-solving, communication, and leadership skills. Nice to Have Experience with GraphQL and API Gateway.Exposure to Kafka, RabbitMQ, or other messaging frameworks.Familiarity with automated testing frameworks (JUnit, Jest, Cypress).Knowledge of DevOps practices and Infrastructure as Code (Terraform, Ansible). More ❯

Exposure to frontend frameworks like React, Angular, or Vue.js for full-stack development is a plus. Event-Driven Architecture: Experience with event-driven architectures or message queuing systems (e.g., Kafka, RabbitMQ) is beneficial. Education: A degree in Computer Science, Engineering, or a related field is preferred but not required. Our Commitment to Diversity, Equity, Inclusion and Belonging (DEIB) We More ❯

them successfully to production Nice to Have: Experience with NoSQL systems (e.g. mongodb, dynamodb, elasticsearch) Experience with front-end web development technologies (react, angular) Experience with data streaming technologies (kafka) Experience/awareness of data engineering technologies (apache iceberg, trino, flink, python) Key Behaviours Demonstrated leadership skills, including team mentoring and project ownership Strong collaborative ethos Strong creative and More ❯

a focus on delivery Required Skills: Agile Methodology Java, Reactive Programming, Spring Boot, Microservices and Web based development experience Must have experience in Spring WebFlux, JPA/ORM, JDBC, Kafka, JMS MQ/Solace, Redis, NoSQL framework Must have experience in MERN stack for developing User interfaces using modern web technologies and frameworks such as HTML5, CSS3, SCSS, Bootstrap More ❯

or analytical systems. API & Micro services Architecture: Comfortable working with REST APIs and micro services architectures. Real-time Stream Processing: Understanding of real-time stream processing frameworks (e.g., PubSub, Kafka, Flink, Spark Streaming). BI Tools & Visualisation Platforms: Experience supporting BI tools or visualization platforms (e.g. Looker, Grafana, PowerBI etc.). Data Pipelines & APIs: Experience in building and maintaining More ❯

leadership, communication, time management and mentoring skills, with the ability to influence technical direction Desirable Qualifications Experience in fintech, payments, or enterprise SaaS platforms Exposure to event-driven architecture (Kafka, RabbitMQ) Familiarity with infrastructure-as-code tools (Terraform, CloudFormation) Understanding of observability tools (Prometheus, Grafana, ELK stack) Apply now and Vibe with Us! (blob:)0:00/0:26We More ❯

data visualisation techniques and tools Understanding of structured and unstructured storage of data Experience with code repositories, branching strategies, pull requests, and merge processes Knowledge of MongoDB and Apache Kafka Experience with Infrastructure as Code (e.g., Terraform, Ansible) Benefits: Competitive salaries 25 days holiday plus statutory public holidays, with the option to buy and sell up to 5 days More ❯

and containerization tools (e.g., Docker, Kubernetes basics) Experience interacting with databases, both SQL (e.g., PostgreSQL, SQL Server) and NoSQL (e.g., MongoDB, DynamoDB) varieties Familiarity with event streaming (e.g., Apache Kafka) for building scalable, real-time data pipelines Preferred Qualifications: Healthcare Experience: Familiarity with healthcare industry standards (e.g., HIPAA, FHIR) and building secure, compliant applications Advanced GraphQL: Experience with Apollo More ❯

re excited if you have 7+ years of experience delivering multi tier, highly scalable, distributed web applications Experience working with Distributed computing frameworks knowledge: Hive/Hadoop, Apache Spark, Kafka, Airflow Working with programming languages Python , Java, SQL. Working on building ETL (Extraction Transformation and Loading) solution using PySpark Experience in SQL/NoSQL database design Deep understanding in More ❯

solutions using cloud providers, preferably Azure (AWS/GCP also valued). Experience with modern data lakehouse concepts and architectures. Experience ingesting and transforming data from sources such as Kafka, REST APIs, Hadoop, etc. Experience with data pipeline orchestration tools (Azure Data Factor or similar). Experience implementing ETL/ELT pipelines using modern data lakehouse solutions. Experience with More ❯

Job Title: Senior Engineer with Node.js and Python or Back End (Java and ideally Kafka) Max rate: £537/Day on Umbrella Location: Croydon (Hybrid) Clearance required: SC Transfer (Active SC only ) Contract Duration: 05 months Experience of Java Experience of Spring framework or equivalent. Knowledge of software design patterns and when to apply them Excellent knowledge of development More ❯

performance, scalability and security What you'll bring Strong hands-on experience with Java (23+) and Spring Boot Knowledge of RESTful API design, JSON and Web Services Experience of Kafka and Dockerised development Background in Test Driven Development using tools such as JUnit or Mockito Understanding of clean code principles, SOLID design and modern engineering practices Familiarity with Git More ❯

etc.). * Experience with cloud platforms such as AWS, Azure, or GCP. * Strong understanding of design patterns, SOLID principles, and domain-driven design. * Experience with message brokers such as Kafka or RabbitMQ, and event-driven architectures. * Excellent analytical skills and experience working in an Agile/Scrum environment. *Rates depend on experience and client requirements More ❯

and orchestration tools such as Docker and Kubernetes. Proficiency in CI/CD using tools such as Jenkins, GitLab, Maven, or Gradle. Experience working with message-driven systems like Kafka, RabbitMQ, or ActiveMQ. Strong knowledge of system design, distributed systems, and scalability principles. Solid understanding of secure coding practices, authentication, and authorization standards. Ability to lead teams, drive solutions More ❯

in backend architecture, API design, and distributed systems. What you'll need Typescript, HTML, CSS, JavaScript, Node.js, Microservices, containerisation and orchestration with Docker and Kubernetes, event driven architecture using Kafka, gRPC, Express; and responsive web design in addition to knowledge of RESTful APIs and web services; Strong commercial experience in the full software development lifecycle React and state management More ❯

Java frameworks like Spring Boot, RESTful API design, microservices architecture, and integration with databases (SQL/NoSQL) and working with at least one messaging platform (MQ/TIBCO/Kafka/Solace) Solid skills with RDBMS like Oracle or similar (e.g., MS-SQL, PostgreSQL) Camunda BPM for workflow orchestration and process automation, including BPMN 2.0 Ability to think strategically More ❯

on docker). Testing tools such as JUnit, Spock or Clojure.test. Scripting skills in Bash, Ruby, or Python. Some technologies and processes we use: Clojure, Go, Python Databricks, PySPark Kafka, Kafka Streams Relational DB, Document Stores (e.g. ElasticSearch) GCP, AWS Kubernetes, Cloud Native CI/CD, CircleCI, GitOps, FluxCD More ❯

other relational databases. CI/CD & Containerization - knowledge of Docker, Kubernetes, and GCP Cloud Build/Jenkins pipelines. Strong debugging and performance optimization skills. Good to Have: Exposure to Kafka, Terraform, or Infrastructure as Code (IaC). Experience in Agile/Scrum environments. Familiarity with monitoring/logging tools like Stackdriver, Prometheus, or ELK. Basic understanding of security and More ❯

branching strategies, and code collaboration. Monitor and analyze application and test execution logs using Splunk or ELK Stack . Validate event-driven systems, message brokers, and ledger processing with Kafka and RabbitMQ . Track, report, and manage defects using JIRA or Azure Boards . Participate in test planning, requirements review, and risk-based testing strategies. Continuously enhance automation coverage More ❯

Strong proficiency with Java and Java frameworks (e.g.: Spring, Springboot), SQL and NoSQL DBMS (e.g.: SQL Server, PostgreSQL, MySQL, Redis, MongoDB), procedural and object-oriented development Strong proficiency in Kafka message queue Good understanding of DevOps processes and CI/CD tools. Excellent communication, problem-solving, and project management skills More ❯

have Experience with containerization/orchestration: Docker , Kubernetes . Familiarity with Identity/Auth systems (OAuth2/OpenID Connect/JWT). Experience with messaging/eventing platforms (RabbitMQ, Kafka). Infrastructure as Code (Terraform, ARM templates). Front-end testing (Jest, React Testing Library) and TypeScript. Domain knowledge in fintech/healthcare/B2B SaaS (optional). Benefits More ❯