25 of 25 Kafka Jobs in Yorkshire

hands-on backend engineering experience, with deep expertise in Java and modern backend ecosystems. Proven experience building microservices and event-driven systems (e.g., with Kafka , RabbitMQ , or NATS ). Strong relational database skills ( PostgreSQL ), including schema design and SQL optimisation. Experience with RESTful API design and implementation, ideally with ...

fast-paced environment. Preferred Qualifications Experience working with distributed systems and event-driven architectures. Exposure to data processing frameworks or background job systems (Celery, Kafka, etc.). Familiarity with testing frameworks and test-driven development (TDD). Understanding of security best practices in application development. Prior experience in leading ...

Jenkins/GitLab). Knowledge of cloud platforms (AWS/Azure/GCP). Strong database knowledge ( SQL & NoSQL ). Familiarity with messaging queues (Kafka/RabbitMQ). Good understanding of design patterns, best practices, and security principles . ...

attention to detail Nice-to-Haves Familiarity with containerization technologies (e.g., Docker, Kubernetes) Knowledge of CI/CD pipelines Experience with message brokers (e.g., Kafka, RabbitMQ) Exposure to event-driven architecture Experience contributing to system architecture and design decisions Understanding of DevOps practices Experience working in Agile/Scrum ...

engineering, RAG architectures, fine-tuning, Agentic AI frameworks (LangChain, LlamaIndex, AutoGen). Data Engineering : ETL/ELT patterns, data modeling, Snowflake, Databricks, dbt, Airflow, Kafka/streaming architectures. Cloud Platforms : AWS (SageMaker, Bedrock, Glue), Azure (OpenAI Service, Synapse), GCP (Vertex AI, BigQuery). MLOps : Model deployment, monitoring, versioning ...

region applications Experience with the following technologies: o AWS Serverless and serverless-supported languages o DB (ex, Postgresql, CocroachDB) o Streaming technologies (Amazon Kinesis, Kafka) o Message Queues (SQS, RabbitMQ, ActiveMQ) Experience working within an agile development Experience with containerization (Docker, Kubernetes, etc) Experience with Micro-Service and Service ...

scale, complex systems. Architecture & Design Expertise: In-depth understanding of architectural principles and patterns, particularly for distributed systems (e.g., microservices, event-driven architecture using Kafka). Resilience & Performance Optimisation: Skilled in applying resilience mechanisms and performance tuning practices to ensure system stability and efficiency at scale. Cloud Infrastructure & DevOps ...

Role – Confluent Consulting Engineer Technology – Apache Kafka, Confluent Platform, Stream Processing Location –(Remote) UK Job Description Your role: As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with … data engineers, architects, and DevOps teams to deliver robust streaming solutions. Required: · 5+ years of hands-on experience with Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) · Strong proficiency in Java, Python, or Scala · Solid understanding of event-driven architecture and data streaming patterns · Experience deploying ...

Python and PySpark coding skills You have experience in batch, distributed data processing and near real-time streaming data pipelines with technologies such as Kafka You have experience of Big Data Analytics platform integration with AWS You have a strong understanding of RDBMS, Data Warehousing, Data Modelling, SQL (Redshift ...

QlikView/Qlik sense, Power BI, SAP, Business Objects, MicroStrategy Experience of several of the following tools: NiFi, Hbase, Bash, Assist, Putty, Neo4J, Spark , Kafka, HDFS, Oozie, Git Hub, Unix, Hadoop, Impala, DoJo, Flume, Elastic, Logstash, Kibana, Airflow, Glue, Big Query, Athena, CML, Hive, Informatica, CuteFTP Ability to explain ...

GoLang, MySQL, Opentelemetry, Prometheus Experience with Cloud and DevOps technologies (AWS, Terraform, CI/CD etc.) Experience with specific technologies in our stack: Clickhouse, Kafka, Pulsar, Python Experience with networking and security concepts Interest or experience with marketing technologies Interest or experience with big data, data analytics ...

appropriate to the seniority of the role; JAVA programming experience as the core language, including Spring Boot. Fluent in writing JAVA coding. Experience with Kafka or a similar platform. Experience with Scala and Spark. Integrating with backing services, such as PostgreSQL, Redis or S3 Good engineering practices including continuous ...

growth of their technical expertise. Technical competencies: Proven experience writing highly maintainable, performant Python and JavaScript code; Experience building modern data pipelines using dbt, Kafka, Spark, AWS Kinesis, AWS Lambda, and Apache Airflow (or similar); Understanding of Data Modelling patterns; Deep knowledge of complex SQL, with emphasis on Common ...

design and shape modern, scalable architectures that support critical government services. Experience Cloud & architecture expertise - strong AWS architecture experience, including event-driven systems (e.g. Kafka) and RESTful API design. Data & public sector experience - experience with document-based databases (e.g. MongoDB) and a solid understanding of public sector governance ...

coding and software development best practices Desirable experience: Microservices, containers (Docker/Kubernetes) Front-end frameworks such as Vue.js Messaging systems (e.g. Service Bus, Kafka) NoSQL databases, REST APIs, CI/CD pipelines Benefits: 25 days holiday plus bank holidays and additional Christmas leave Flexible 37.5-hour week Hybrid ...

coding and software development best practices Desirable experience: Microservices, containers (Docker/Kubernetes) Front-end frameworks such as Vue.js Messaging systems (e.g. Service Bus, Kafka) NoSQL databases, REST APIs, CI/CD pipelines Benefits: 25 days holiday plus bank holidays and additional Christmas leave Flexible 37.5-hour week Hybrid ...

technologies, such as Docker and Kubernetes. - Comfortable/experienced with back-end micro-service architecture and communication, specifically REST and asynchronous messaging services (e.g., Kafka, RabbitMQ etc.) - Experience with relational and NoSQL databases, including PostgreSQL, Couchbase, or Cassandra is a plus. - Experience with continuous integration tools (Github Actions, Jenkins ...

debugging. Strong grasp of algorithmic thinking and performance optimisation. Proficiency with SQL and NoSQL databases such as PostgreSQL and Cassandra. Experience with systems like Kafka or RabbitMQ. Ability to build and manage ETL pipelines using tools like Airflow. This role is an urgent requirement. There are limited interview slots ...

tooling such as Co-Pilot, Claude, OpenCode, or Mistral Experience building agentic AI workflows in enterprise environments Kubernetes and event-driven architecture experience, including Kafka and Google Pub/Sub Public cloud agnostic engineering experience Strong stakeholder engagement and technical leadership capability Additional information available on successful application. ...

data practitioners, and AI agents worldwide from high-level data visualization plugins (Tableau, PowerBI, Superset, Metabase) to connectors for data frameworks (Apache Spark, Flink, Kafka Connect, Fivetran), orchestration platforms, and AI tooling. Our work directly shapes how companies process massive datasets: real-time analytics platforms ingesting millions of events ...

concepts of real time data streaming, batch data processing and data transformation processes Experience with core tools such as Data Factory, Databricks, Synapse, Kafka and Python Any exposure to data migration/ETL would be highly beneficial, with SQL/T-SQL, SSIS, SSRS and SSAS, as there ...

Boot , and microservices architecture . Build dynamic, responsive UIs using Angular , React , or Vue.js . Integrate Camunda workflows with REST APIs, databases, messaging systems (Kafka/RabbitMQ), and user interfaces. Configure and manage Camunda engine, external task workers, and job execution. Write unit and integration tests for both frontend … orchestration Frontend: Experience in Angular , React , or Vue.js HTML5, CSS3, JavaScript/TypeScript Other Technologies: Integration experience with Databases (PostgreSQL, MySQL, MongoDB) Familiarity with Kafka , RabbitMQ , or other messaging tools Experience with Git , Maven/Gradle , Jenkins/GitLab CI ➕ Nice to Have: Experience with Camunda 8/Zeebe ...

tools Required Experience 5+ years in professional Java backend development Core Tech Stack Java, Spring Boot, JPA/Hibernate, MySQL (or other RDBMS), Apache Kafka, Linux Preferred/Plus Tech Directed Acyclic Graphs, Graph Databases, FFmpeg, CI/CD systems, Spring Cloud, Swagger, Snowflake, Apache Doris, Debezium Application Materials … Management: Solid understanding of MySQL (or other major RDBMS) along with practical query‐tuning and optimisation experience. Data Streams: Hands‐on experience with Apache Kafka and building Change Data Capture (CDC) pipelines. Optimization: Proficient in Java performance profiling, memory management, and advanced debugging techniques. Environment: Comfortable working in Linux ...

Experience: Strong experience in test strategy for microservices environments Hands-on automation: Java, Selenium, Rest Assured API, contract, integration testing, including asynchronous messaging (e.g., Kafka) CI/CD pipelines, Spring Boot applications, performance testing fundamentals Experience with non-relational databases (e.g., MongoDB) Leadership experience at Lead/Principal level … able to influence stakeholders Tools & Technologies: AWS, Selenium, Serenity BDD, Playwright, Pactflow, Spring Cloud Contract, Kafka, MongoDB, GitHub/GitLab, Jenkins, Docker, Gatling, K6, Grafana, Prometheus, Splunk ...

enterprise customers. What We Look For: Proven impact architecting and operating large-scale data streaming systems. You have the scars from building and scaling Kafka systems in production. A builder's mindset for data and AI. You see beyond the event stream and can architect the connection between Kafka ...