1 to 25 of 42 Kafka Jobs in Sheffield

We are seeking a highly experienced and skilled Senior Kafka Engineer to join our team. The ideal candidate will have a proven track record of designing, implementing, and maintaining large-scale Kafka deployments, with specific experience upgrading Kafka clusters. This role requires a deep understanding of Kafka … practices. The candidate must be comfortable working independently and collaboratively within a fast-paced environment. Responsibilities: Design, implement, and maintain high-throughput, low-latency Kafka clusters. Lead the upgrade of existing Kafka clusters from version 3.3.1 to the latest supported version, ensuring minimal downtime and data integrity. Experience … in confluent migration (link removed)> Develop and implement monitoring and alerting systems for Kafka. Troubleshoot and resolve Kafka-related issues. Participate in on-call rotation to ensure 24/7 system availability. Collaborate with other engineers to integrate Kafka into existing systems. Design and implement Kafka security More ❯

to translate business and research needs into engineering roadmaps. Collaborative mindset, capable of interfacing with multi-disciplinary teams. Nice to Have: Experience with Redis, Kafka, or similar real-time streaming/data platforms. Familiarity with financial APIs, FIX protocol, or trading exchange integrations. Education: Bachelor’s or Master’s More ❯

critical projects. Familiarity with Infrastructure as Code (IaC) tools like Terraform , CloudFormation , or AWS CDK . Exposure to event-driven or reactive architectures (e.g., Kafka, Pub/Sub, or similar systems). #J-18808-Ljbffr More ❯

across functions. Desirable/Advantageous Skills Exposure to cloud technologies (AWS, GCP, or Azure) and containerization (Docker, Kubernetes). Familiarity with messaging systems like Kafka or RabbitMQ. Interest or academic exposure to financial services, especially payments and transaction banking. Experience working in a regulated environment or large-scale enterprise More ❯

across functions. Desirable/Advantageous Skills Exposure to cloud technologies (AWS, GCP, or Azure) and containerization (Docker, Kubernetes). Familiarity with messaging systems like Kafka or RabbitMQ. Interest or academic exposure to financial services, especially payments and transaction banking. Experience working in a regulated environment or large-scale enterprise More ❯

encompasses a multitude of vendors (Microsoft, AWS, ESRI, Snowflake, IBM and Apache Software Foundation) and services (Azure, Microsoft Fabric, Apache Airflow, dbt Cloud, watsonx, Kafka, Kubernetes (EKS and AKS), Red Hat Open Shift, plus others.) thus ensuring we can leverage data-driven insights based on rich industry-specific data More ❯

knowledge of cloud services like AWS Proficiency in Docker and Kubernetes for container orchestration Strong knowledge of Git and version control practices Experience with Kafka, RabbitMQ, or similar technologies Familiarity with monitoring tools (e.g., Prometheus, Grafana) and logging frameworks Knowledge of DevOps principles and practices Strong analytical and problem More ❯

resiliency, and security practices Solid understanding of key technologies such as cloud, AI/ML, or mobile platforms Backend expertise in Java, Spring Framework, Kafka, and NoSQL databases (e.g., MongoDB, Cassandra) Preferred Qualifications Exposure to cloud technologies and services Experience designing and developing microservices-based architecture Commitment to continuous More ❯

handling of sensitive data (e.g. GDPR) Experience in event-driven architecture, ingesting data in real time in a commercial production environment with Spark Streaming, Kafka, DLT or Beam. Understanding of the challenges faced in the design and development of a streaming data pipeline and the different options for processing More ❯

CI/CD: Experience with Jenkins or similar pipelines Collaboration: Agile working with cross-functional teams Desirable Skills: Frontend experience with React & TypeScript Messaging: Kafka Build tools: Gradle Database versioning: Liquibase API Design: Swagger/OpenAPI This role is ideal for engineers looking to build on their SC clearance More ❯

with JSON libraries like Gson and Jackson. Ability to create reusable, testable modules. Experience with Swing or AWT is a plus. Experience with Jetty, Kafka, or similar technologies. Exposure to SOAP is useful. Experience with Ivy, ANT, Maven, Spring, and Spring Boot. Significant experience with C# and ASP.Net Core More ❯

Backed Technologies: Highly experienced in developing Java code, along with deep expertise within Spring boot OR Quarkus/GraalVM, Hands on with Messaging Systems (Kafka, RabbitMQ, Google Pub/Sub), SQL Databases CI/CD Pipelines and Agile development: Knowledge of continuous integration and delivery tools/practices, Scrum More ❯

following is desirable: Postgres, Liquibase for database versioning Containerisation with Docker API design with Swagger/OpenAPI TDD (JUnit, Mockito), high code quality standards Kafka for event-driven architecture React, TypeScript Diversity & Inclusion: We are dedicated to fostering an inclusive and equitable workplace. Our commitment includes valuing diverse perspectives More ❯

for large organizations. Expect variety – you’ll work across cloud platforms like Azure, AWS, and GCP, leveraging tools such as Databricks, Data Factory, Synapse, Kafka, Glue, Redshift, BigQuery, and more. About You You’re an engineer at heart, with a passion for building efficient, scalable data systems. To succeed More ❯

Blazor) is advantageous. Experience with Azure DevOps, CI/CD pipelines, and Infrastructure as Code (Terraform) is a plus. Exposure to messaging patterns (RabbitMQ, Kafka) and authentication methods like OAuth2 is beneficial. A strong problem-solver who can work independently while effectively collaborating with cross-functional teams. Prior experience More ❯

goals Shape the future of AI by influencing architecture, research, and cross-team learning Skills and Experience Required Strong Python backend experience (e.g., Flask, Kafka, Docker, Kubernetes) 2+ years’ experience building or integrating AI (e.g., LLM, NLP) Passion for AI demonstrated through side projects, research, or professional experience Excellent More ❯

JUnit, Mockito CI/CD: Experience with Jenkins or similar pipelines Collaboration: Agile working with cross-functional teams Frontend experience with React & TypeScript Messaging: Kafka Build tools: Gradle API Design: Swagger/OpenAPI This role is ideal for engineers looking to build on their SC clearance and gain NPPV3 More ❯

Documentation Participating in team meetings and supporting colleagues Estimating work effort Writing and running SQL queries to inspect backend data Our technology stack includes Kafka, Kubernetes, Docker, Clickhouse, Git, and DevOps. Experience & Qualities The ideal candidate is interested in both front-end and back-end projects. Keen to learn More ❯

monitoring. Requirements include: Strong Ruby experience Solid CS fundamentals, design patterns Proficiency with PostgreSQL, understanding SQL vs NoSQL Experience with asynchronous messaging, RabbitMQ/Kafka/GCP PubSub Hands-on with Elasticsearch Knowledge of caching strategies, Redis experience Understanding of 12-factor app principles, cloud-native apps Experience with More ❯

Bring Deep expertise in .NET/C#, AWS, microservices, and distributed systems. Strong leadership and mentoring skills. Proficiency with messaging systems (SNS/SQS, Kafka), CI/CD, and container orchestration (EKS/Kubernetes). Passion for craftsmanship and engineering excellence. Bonus if you have experience in healthcare/ More ❯

experience w ith AWS EKS and containerized environments (Docker, Kubernetes). Proficiency with Postgr eS QL, R edis, and message queue systems (e.g., RabbitMQ, Kafka). Deep understanding of API design and best practices (REST, gRPC). Experience with CI/CD pipelines, monitoring tools (e.g., Prometheus, Grafana), and More ❯

SaaS, data lakes, apis, adtech, GDPR, CCPA, B2B, Sales Consultant, Account Manager, DataOps, CICD, DevOPs, CI/CD, GenAI, RAG, AWS, Azure, Apache, Spark, Kafka – UK Wide - £80,000-£95,000 + OTE Our large Microsoft Partner client requires a Senior Data Analytics Sales Consultant to help spearhead their More ❯

documentation. Familiarity with RESTful microservices & modern DevOps workflows. Skills in Azure (AKS, Functions), DDD, CQRS, Event Sourcing, Kubernetes/Docker, IaC (Terraform/Bicep), Kafka/RabbitMQ, ADR/C4 expertise, open-source or community contributions are desirable. Package Snapshot £50–55k salary + up to 10% bonus More ❯

experience in tools like Snowflake, DBT, SQL Server, and programming languages such as Python, Java, or Scala. Proficient in big data tools (e.g., Spark, Kafka), cloud platforms (AWS, Azure, GCP), and embedding AI/GenAI into scalable data infrastructures. Strong stakeholder engagement and the ability to translate technical solutions More ❯

understanding of CI/CD pipelines and Infrastructure as Code (IaC) Proficiency with relational databases and exposure to NoSQL Bonus points for experience with Kafka in an AWS environment This role offers a great blend of autonomy and collaboration in a hybrid setup – just two days a week in More ❯