1 to 25 of 151 Kafka Jobs in West Yorkshire

Job description As part of the CTO Data Ingestion Service, the incumbent will be required to: Designing and architecting scalable, real-time systems in Kafka, with a focus on on-premise Cloudera open source Kafka and disaster recovery aspects. Configuring, deploying, and maintaining Kafka clusters to ensure … high availability, resiliency, and scalability, including understanding and explaining features like KRAFT. Integrating Kafka with other data processing tools and platforms such as Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry, Flink, and Beam. Collaborating with cross-functional teams to understand data requirements and design solutions that … of Kafka resiliency and new features like KRAFT Experience with real-time technologies such as Spark Required Skills & Experience Extensive experience with Apache Kafka and real-time architecture including event-driven frameworks. Strong knowledge of Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry, Flink, and Beam. More ❯

Job Title: Kafka Architect- Cloudera Location: Leeds (2days/week Onsite) Duration: 06+ … Months Job Summary: We are looking for an experienced Kafka Architect to design and implement scalable, high-throughput data streaming solutions using Apache Kafka on Cloudera (on-premises). The ideal candidate will have a strong background in distributed systems, data pipelines, and real-time data processing. Key … tools like Ansible, Terraform, or Cloudera Manager. -Provide technical leadership and mentorship to junior team members. Required Skills: -Strong hands-on experience with Apache Kafka (including Kafka Connect, Kafka Streams). -Experience with Cloudera distribution for Kafka on on-premises environments. -Proficiency in designing high-volume More ❯

Job Title: Kafka Architect- Cloudera Location: Leeds (2days/week Onsite) Duration: 06+ … Months Job Summary: We are looking for an experienced Kafka Architect to design and implement scalable, high-throughput data streaming solutions using Apache Kafka on Cloudera (on-premises). The ideal candidate will have a strong background in distributed systems, data pipelines, and real-time data processing. Key … tools like Ansible, Terraform, or Cloudera Manager. -Provide technical leadership and mentorship to junior team members. Required Skills: -Strong hands-on experience with Apache Kafka (including Kafka Connect, Kafka Streams). -Experience with Cloudera distribution for Kafka on on-premises environments. -Proficiency in designing high-volume More ❯

Social network you want to login/join with: Kafka Architect- Cloudera, leeds, west yorkshire col-narrow-left Client: Location: leeds, west yorkshire, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 1 Posted: 25.05.2025 Expiry Date: 09.07.2025 col-wide Job Description: Job … Months Job Summary: We are looking for an experienced Kafka Architect to design and implement scalable, high-throughput data streaming solutions using Apache Kafka on Cloudera (on-premises). The ideal candidate will have a strong background in distributed systems, data pipelines, and real-time data processing. Key … tools like Ansible, Terraform, or Cloudera Manager. -Provide technical leadership and mentorship to junior team members. Required Skills: -Strong hands-on experience with Apache Kafka (including Kafka Connect, Kafka Streams). -Experience with Cloudera distribution for Kafka on on-premises environments. -Solid knowledge of Kafka More ❯

Social network you want to login/join with: A Kafka Real-Time Architect is responsible for designing and implementing scalable, real time data processing systems in Kafka. This role involves architecting Kafka cluster, ensuring high availability, and integrating with other data processing tools and platforms. Designing and … architecting scalable, real-time systems in Kafka. Configuring, deploying, and maintaining Kafka clusters to ensure high availability and scalability. Integrating Kafka with other data processing tools and platforms such as Kafka Streams, Kafka Connect, Spark Streaming Schema Registry, Flink and Beam. Collaborating with cross-functional teams … support to development operations teams. Staying updated with the latest Kafka features, updates and industry practices. Required Skills Experience : Extensive Experience with Apache Kafka and real-time architecture including event driven frameworks. Strong Knowledge of Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry, Flink and Beam. More ❯

Social network you want to login/join with: A Kafka Real-Time Architect is responsible for designing and implementing scalable, real time data processing systems in Kafka. This role involves architecting Kafka cluster, ensuring high availability, and integrating with other data processing tools and platforms. Designing and … architecting scalable, real-time systems in Kafka. Configuring, deploying, and maintaining Kafka clusters to ensure high availability and scalability. Integrating Kafka with other data processing tools and platforms such as Kafka Streams, Kafka Connect, Spark Streaming Schema Registry, Flink and Beam. Collaborating with cross-functional teams … support to development operations teams. Staying updated with the latest Kafka features, updates and industry practices. Required Skills Experience : Extensive Experience with Apache Kafka and real-time architecture including event driven frameworks. Strong Knowledge of Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry, Flink and Beam. More ❯

/join with: We are looking for an experienced Kafka Architect to design and implement scalable, high-throughput data streaming solutions using Apache Kafka on Cloudera (on-premises). The ideal candidate will have a strong background in distributed systems, data pipelines, and real-time data processing. Key … Responsibilities: -Design and implement scalable Kafka-based architectures using open-source -Kafka on Cloudera on-premises infrastructure. -Lead the setup, configuration, and optimization of Kafka clusters. -Define standards and best practices for Kafka producers, consumers, and streaming applications. -Integrate Kafka with various data sources, storage … tools like Ansible, Terraform, or Cloudera Manager. -Provide technical leadership and mentorship to junior team members. Required Skills: -Strong hands-on experience with Apache Kafka (including Kafka Connect, Kafka Streams). -Experience with Cloudera distribution for Kafka on on-premises environments. -Solid knowledge of Kafka More ❯

critical projects. Familiarity with Infrastructure as Code (IaC) tools like Terraform , CloudFormation , or AWS CDK . Exposure to event-driven or reactive architectures (e.g., Kafka, Pub/Sub, or similar systems). #J-18808-Ljbffr More ❯

critical projects. Familiarity with Infrastructure as Code (IaC) tools like Terraform , CloudFormation , or AWS CDK . Exposure to event-driven or reactive architectures (e.g., Kafka, Pub/Sub, or similar systems). #J-18808-Ljbffr More ❯

to translate business and research needs into engineering roadmaps. Collaborative mindset, capable of interfacing with multi-disciplinary teams. Nice to Have: Experience with Redis, Kafka, or similar real-time streaming/data platforms. Familiarity with financial APIs, FIX protocol, or trading exchange integrations. Education: Bachelor’s or Master’s More ❯

to translate business and research needs into engineering roadmaps. Collaborative mindset, capable of interfacing with multi-disciplinary teams. Nice to Have: Experience with Redis, Kafka, or similar real-time streaming/data platforms. Familiarity with financial APIs, FIX protocol, or trading exchange integrations. Education: Bachelor’s or Master’s More ❯

to translate business and research needs into engineering roadmaps. Collaborative mindset, capable of interfacing with multi-disciplinary teams. Nice to Have: Experience with Redis, Kafka, or similar real-time streaming/data platforms. Familiarity with financial APIs, FIX protocol, or trading exchange integrations. Education: Bachelor’s or Master’s More ❯

The Tech You'll Use Languages & Frameworks: .NET 8, C#, JavaScript/React Cloud & Infrastructure: AWS (Lambda, ECS, DynamoDB, Aurora), Docker, Terraform Eventing & APIs: Kafka, GraphQL, REST CI/CD: GitHub Actions Data: PostgreSQL, DynamoDB, DocumentDB What We're Looking For Solid experience building modern, cloud-based systems using More ❯

.NET Core, and Web API Web Application Frameworks (ASP.NET MVC, SPA) Enterprise content management through Sitecore RESTful Microservices for scalable APIs Event-driven architectures (Kafka) Modern reactive JavaScript Frameworks (React, Next.js, Vue.js, Angular) Advanced web topologies (Headless, Jamstack) Storage technologies like SQL, Redis, and SOLR Automated UI and API More ❯

Application Frameworks (ASP.NET MVC, SPA) Enterprise content management achieved through Sitecore RESTful Microservices – light-weight efficient, decoupled APIs that scale well. Event driven architectures (Kafka) Modern reactive JavaScript Frameworks (React, Next.js, Vue.js, Angular) Advanced web topologies (Headless, Jamstack) Storage technologies like SQL, Redis and SOLR Automated UI and API More ❯

.NET Framework monolith to a microservices architecture in AWS. You’ll work with: Cloud : AWS (EKS, ECS, Lambda, Aurora, DynamoDB, DocumentDB) Frontend : React Messaging : Kafka, SNS/SQS, EventBridge CI/CD : GitHub Actions, GitHub Enterprise What You Bring Proven experience leading agile development teams. Deep expertise in .NET More ❯

knowledge of cloud services like AWS. Proficiency in Docker and Kubernetes for container orchestration. Strong knowledge of Git and version control practices. Experience with Kafka, RabbitMQ, or similar messaging technologies. Familiarity with monitoring tools (e.g., Prometheus, Grafana) and logging frameworks. Knowledge of DevOps principles and practices. Strong analytical and More ❯

of cloud services such as AWS. Proficiency in Docker and Kubernetes for container orchestration. Strong knowledge of Git and version control practices. Experience with Kafka, RabbitMQ, or similar messaging technologies. Familiarity with monitoring tools (e.g., Prometheus, Grafana) and logging frameworks. Knowledge of DevOps principles and practices. Strong analytical and More ❯

on cloud services such as AWS · Proficiency in Docker and Kubernetes for container orchestration. · Strong knowledge of Git and version control practices · Experience with Kafka, RabbitMQ, or similar technologies. · Familiarity with monitoring tools (eg - Prometheus, Grafana) and logging frameworks · Knowledge of DevOps principles and practices. · Strong analytical and problem More ❯

The Tech You'll Use Languages & Frameworks: .NET 8, C#, JavaScript/React Cloud & Infrastructure: AWS (Lambda, ECS, DynamoDB, Aurora), Docker, Terraform Eventing & APIs: Kafka, GraphQL, REST CI/CD: GitHub Actions Data: PostgreSQL, DynamoDB, DocumentDB What We're Looking For Solid experience building modern, cloud-based systems using More ❯

Machine Learning Development experience with VR frameworks such as Unity, Unreal Engine Experience with data streaming technologies such as Akka/Pekko, MQTT, Pulsar, Kafka, Azure Event Hubs Varied integration experience with RPC, REST, gRPC Experience/knowledge of Azure and Azure Resources or other SAAS/PAAS platforms More ❯

Machine Learning Development experience with VR frameworks such as Unity, Unreal Engine Experience with data streaming technologies such as Akka/Pekko, MQTT, Pulsar, Kafka, Azure Event Hubs Varied integration experience with RPC, REST, gRPC Experience/knowledge of Azure and Azure Resources or other SAAS/PAAS platforms More ❯

and the Humber, United Kingdom Posted today This advertiser has chosen not to accept applicants from your region. Full Job Description Job Description JobTitle: Kafka Architect- Cloudera Location:Leeds (2days/week Onsite) Duration: 06+Months Job Summary: We are looking for an experienced Kafka Architect to design andimplement … scalable, high-throughput data streaming solutions usingApache Kafka on Cloudera (on-premises). The ideal candidate will havea strong background in distributed systems, data pipelines, andreal-time data processing. KeyResponsibilities: -Design and implement scalableKafka-based architectures using open-source -Kafka on Clouderaon-premises infrastructure. -Lead the setup, configuration … andconfiguration using tools like Ansible, Terraform, or ClouderaManager. -Provide technical leadership and mentorship to juniorteam members. Required Skills: -Strong hands-on experience with Apache Kafka (including KafkaConnect, Kafka Streams). -Experience with Cloudera distributionfor Kafka on on-premises environments. -Proficiency indesigning high-volume, low-latency data pipelines. More ❯

.NET Framework monolith to a microservices architecture in AWS. You'll work with: Cloud : AWS (EKS, ECS, Lambda, Aurora, DynamoDB, DocumentDB) Frontend : React Messaging : Kafka, SNS/SQS, EventBridge CI/CD : GitHub Actions, GitHub Enterprise What You Bring Proven experience leading agile development teams. Deep expertise in .NET More ❯

handling of sensitive data (e.g. GDPR) Experience in event-driven architecture, ingesting data in real time in a commercial production environment with Spark Streaming, Kafka, DLT or Beam. Understanding of the challenges faced in the design and development of a streaming data pipeline and the different options for processing More ❯