21 of 21 Kafka Jobs in Shrewsbury

a strong focus on data accuracy, quality, and reliability Desirable (Nice to Have): Background in defence, government, or highly regulated sectors Familiarity with Apache Kafka, Spark, or Hadoop Experience with Docker and Kubernetes Use of monitoring/alerting tools such as Prometheus, Grafana, or ELK Understanding of machine learning More ❯

experience w ith AWS EKS and containerized environments (Docker, Kubernetes). Proficiency with Postgr eS QL, R edis, and message queue systems (e.g., RabbitMQ, Kafka). Deep understanding of API design and best practices (REST, gRPC). Experience with CI/CD pipelines, monitoring tools (e.g., Prometheus, Grafana), and More ❯

meetings and supporting colleagues and co-workers Estimation of work Write and run SQL queries to inspect backend-consumed data Our technology stack includes Kafka, Kubernetes, Docker, Clickhouse, Git, and DevOps. Experience & Qualities The ideal candidate wants to work on both front- and back-end projects. Keen to learn More ❯

microservices and modern DevOps workflows. Technical expertise in Azure (AKS, Functions), DDD, CQRS, Event Sourcing, Kubernetes/Docker, Infrastructure as Code (Terraform/Bicep), Kafka/RabbitMQ, ADR/C4 diagrams, open-source or community contributions. Package Snapshot £50–55k salary + up to 10% bonus, 25 days holiday More ❯

MuleSoft or Power Automate Deep knowledge of SQL, REST, JSON, XML Experience in Agile, API security, and cloud integrations Nice to Have MuleSoft CloudHub Kafka or similar pub-sub systems Finance industry experience Generous leave + private medical Enhanced parental policies Pension & bonuses Want to help shape smarter systems More ❯

experience with Node.js and Typescript on large scale microservices architectures Extensive work on extremely high-traffic, distributed systems Good knowledge of Kubernetes and either Kafka or RabbitMQ Deep understanding of AWS and related tools Strong Computer Science fundamentals Happy working fully remote in a B2B capacity -- We make an More ❯

experience with Azure-based development; AWS knowledge is a plus Familiarity with integration tools like Postman, API Management, and cloud messaging (e.g., Service Bus, Kafka) Solid grasp of testing strategies, design principles (SOLID, DRY), and microservice architecture Proactive mindset with excellent communication and time-management skills Why You'll More ❯

/reporting engines or OLAP stores Deep Ruby/Rails & ActiveRecord expertise Exposure to ClickHouse/Redshift/BigQuery Event-driven or stream processing (Kafka, Kinesis) Familiarity with data-viz pipelines (we use Highcharts.js) AWS production experience (EC2, RDS, IAM, VPC) Contributions to OSS or tech-blog posts on More ❯

will work alongside experienced developers who will be happy to support your growth Key requirements: Experience with Node.js Familiarity with message brokers like SNS, Kafka, or similar. AWS. Interest working with data would be a bonus. If you’re a Software Engineer who has a real interest in software More ❯

experience with the ELK Technology stack, technical delivery, and the ability to provide technical leadership to the build team. Experience with Splunk, Databases, MQ, Kafka, DevOps, CI/CD pipelines, and payments domain knowledge would be advantageous. #J-18808-Ljbffr More ❯

architecture, leveraging Infrastructure as Code (IaC) and designing for cost efficiency—experience in regulated domains Deep knowledge of distributed and event-driven systems, like Kafka, AWS SNS/SQS, and development in languages such as Java and Python. Strong understanding of data-centric architecture principles, including data governance, data More ❯

including data modeling, warehousing, real-time and batch processing, and big data frameworks. Proficiency with modern data tools and technologies such as Spark, Databricks, Kafka, or Snowflake (bonus). Knowledge of cloud security, networking, and cost optimization as it relates to data platforms. Experience in total cost of ownership More ❯

based Linux systems running in a private cloud environment. Monitor, troubleshoot, and improve performance across systems and services. Manage production databases (PostgreSQL, Cassandra, Redis, Kafka) with a focus on reliability and scalability. Work on network infrastructure — including WireGuard tunnels, BGP configuration, and general network troubleshooting. Contribute to internal tooling More ❯

new technologies Additionally, experience in at least three of the following areas is desirable: Infrastructure as Code (e.g., Ansible) LDAP integration Red Hat OpenShift Kafka Network and infrastructure security Agile methodologies and Scrum Regulatory environments (PCI, GDPR) Working with third-party vendors Our Customer First behaviours include: Say it More ❯

Optimization: Build efficient, high-performance systems by leveraging techniques like data denormalization , partitioning , caching , and parallel processing . Develop stream-processing applications using Apache Kafka and optimize performance for large-scale datasets . Enable data enrichment and correlation across primary, secondary, and tertiary sources. Cloud, Infrastructure, and Platform Engineering … for data manipulation and automation. Strong expertise in SQL/NoSQL databases such as PostgreSQL and MongoDB. Experience building stream processing systems using Apache Kafka . Proficiency with Docker and Kubernetes in deploying containerized data workflows. Good understanding of cloud services (AWS or Azure). Hands-on experience with More ❯

is useful but not essential: MOD Common Architectural Approach (CAA) ISR or ISTAR capability advantageous Integrated sensor architecture (ISA) advantageous MongoDB, VMWare technologies, APIs, KAFKA, and Systematic applications desirable ILS and Defence support models and DLODs advantageous Minorities, women, LGBTQ+ candidates, and individuals with disabilities are encouraged to apply. More ❯

We are looking for a Senior Software Engineer with expertise in front-end development and a strong understanding of data engineering principles to support a major UK Government programme. This role is offered on an inside IR35 contract with a More ❯

. In-depth knowledge on key technologies like Big Query/Redshift/Synapse/Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF etc. Excellent consulting experience and ability to design and build solutions, actively contribute to RfP response. Ability to be … Hyperscalers] GCP, AWS, Azure, Big data, Apache spark, beam on BigQuery/Redshift/Synapse, Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF Designing Databricks based solutions for Azure/AWS, Jenkins, Terraform, StackDriver or any other DevOps tools #J-18808-Ljbffr More ❯

with infrastructure as code (Terraform/CDK/CloudFormation). ● Lead incident response, system reliability efforts, and infrastructure scalability initiatives. ● Manage messaging queues (e.g., Kafka, RabbitMQ) and optimize for low-latency event handling and throughput. ● Contribute to evolving our security posture, including secrets management, access controls, and audit logging. … understanding of CI/CD best practices and hands-on experience with tools like GitHub Actions, CircleCI, or similar. ● Experience with messaging systems (RabbitMQ, Kafka, etc.) and event-driven ● Proficiency in infrastructure as code (Terraform preferred). ● Familiarity with monitoring stacks (Prometheus, Grafana, ELK, etc.) and system tuning. ● Security More ❯

data engineering function – overseeing architecture, platform operations, integration strategy, and team leadership. You’ll shape the roadmap for data engineering initiatives across Azure, Snowflake, Kafka, and modern Lakehouse architectures, ensuring resilience, scalability, governance, and performance. Key Responsibilities: Lead the Data Engineering Function : Define and implement the data engineering strategy … the enterprise. Platform Ownership : Own the full lifecycle of the data platform – ingestion, storage, transformation, governance, and access – with a focus on Azure, Snowflake, Kafka, and Data Lakes. Strategic Leadership : Shape the vision and roadmap for the data engineering function in line with business objectives, regulatory requirements, and technological … experience as a Head of Data Engineering , Principal Data Engineer , or Lead Data Architect , managing large-scale data platform initiatives. Expertise in Azure , Snowflake , Kafka , and Data Lake technologies, with a strong grasp of modern architectural patterns (Lakehouse, Lambda, Kappa). Strong knowledge of data governance , security , and regulatory More ❯

including design, development, and implementation. Reporting into an Engineering Manager, the Senior Backend Engineer will also leverage modern technologies like AWS, Kubernetes, Docker, and Kafka, whilst also architecting and implementing microservices-based solutions in collaboration with cross-functional teams. In addition, the Senior Backend Engineer will also be responsible … on complex, data-intensive applications A product-focused mindset and familiarity with working in technology-driven organisations or start-ups Hands-on skills in Kafka, Cassandra, gRPC, and microservices architecture will also be beneficial, as well as experience contributing to open-source projects If you're a passionate Senior More ❯