24 of 24 Permanent Kafka Jobs in the North of England

Airflow, AWS Step Functions or Apache NiFi. Cloud platform experience across AWS, Azure and/or GCP. Knowledge of messaging and streaming technologies including Kafka, AWS SQS or equivalent cloud-native services. Strong understanding of SQL and NoSQL databases. Experience with modern data storage technologies including HDFS, Iceberg, Elasticsearch ...

Machine Learning – Understanding of AI/ML concepts, experience with LLMs, prompt engineering, or integrating AI capabilities into applications • Data Technologies – Experience with Kafka, PySpark, Parquet and Avro data formats, Apache Airflow for workflow management, or Streamlit for building interactive data applications • Advanced Data Management – Strong SQL design, query ...

improve application performance Strong understanding of secure coding practices Exposure to the following would be advantageous but not essential: - Messaging/streaming technologies (Kafka, SQS) Serverless technologies (e.g., AWS Lambda) Monitoring/logging tools (ELK, Splunk, Dynatrace) ORM technologies (JPA, Hibernate) API documentation tools (e.g., Swagger/OpenAPI) Test ...

both systems and teams Confidence in collaborating with technical and non-technical stakeholders Additional experience (nice to have) Exposure to event-driven architectures (e.g. Kafka, RabbitMQ, SNS/SQS) Knowledge of Domain-Driven Design (DDD) Experience building resilient, scalable systems Familiarity with Infrastructure as Code tools such as Terraform ...

workflows. Nice to Haves: Web3 Infrastructure: Specific experience in blockchain or decentralised finance (DeFi). Event-Driven Systems: Knowledge of message brokers such as Kafka or NATS. Chaos Engineering: Experience with resilience testing and fault-injection practices. Edge Computing: Familiarity with CDN optimisation and edge-based service delivery. Ecosystem ...

solutions using MLflow or integrating with cloud ML services. Experience in BFSI, Retail, Telecom, or Healthcare data environments. Experience with real-time data processing (Kafka, EventHub, Kinesis). Soft Skills Excellent communication and stakeholder management skills. Strong problem-solving and solution-oriented mindset. Ability to lead in a fast ...

concepts (Prometheus, Grafana, ELK, etc.). Experience with test automation tools (JUnit, Cucumber, Selenium, Postman). Knowledge of messaging and streaming platforms (Kafka) and service mesh (Istio). Understanding of network protocols, security best practices, and compliance requirements for banking. Curiosity, adaptability, and a commitment to continuous improvement ...

environments. Hard Skills Experience in data engineering, ideally aerospace/defence or industrial sectors. ETL/ELT tools (Airflow, Azure, Microsoft SSIS), streaming (Spark, Kafka). Strong Python and SQL; C++, C#, or MATLAB a plus. Databases: PostgreSQL, SQL Server, Oracle, Snowflake, Iceberg, TimescaleDB. Data Platform Capabilities: Low-Code ...

software development background with hands‐on experience in platform, infrastructure, or data‐centric environments. Deep expertise in event‐driven architectures, streaming technologies (e.g., Apache Kafka, Flink, and/or Pulsar). Proficiency across full‐stack technologies (Java, .Net, React) with the ability to guide technical decisions. Knowledge of hybrid ...

software development background with hands‐on experience in platform, infrastructure, or data‐centric environments Deep expertise in event‐driven architectures, streaming technologies (e.g. Apache Kafka, Flink, and/or Pulsar) Proficiency across full stack technologies (Java, .Net, React) with the ability to guide technical decisions Knowledge of hybrid/ ...

speed in the below: Go to write our application code (there’s an excellent interactive Go tutorial here ) Cassandra for most persistent data storage Kafka for our asynchronous message queue Kubernetes and Docker to schedule and run our services Envoy Proxy for RPC AWS for most of our production ...

growth of their technical expertise. Technical competencies: Proven experience writing highly maintainable, performant Python and JavaScript code; Experiencebuilding modern data pipelines using dbt, Kafka, Spark, AWS Kinesis, AWS Lambda, and Apache Airflow (or similar); Understanding of Data Modelling patterns; Deepknowledge of complex SQL, with emphasis on Common Table Expressions ...

Skills Significant demonstrable experience in one or both of: modern software engineering for digital products (ideally Java, microservice architectures, Hexagonal software architecture, Mongo and Kafka); OR designing and implementing modern cloud infrastructure, DevOps, and automation (ideally AWS, Terraform, GitLab CI, Jenkins); Significant demonstrable experience of leading engineering teams providing ...

Experience Significant demonstrable experience in one or both of: Modern software engineering for digital products (ideally Java, microservice architectures, Hexagonal software architecture, Mongo and Kafka); OR designing and implementing modern cloud infrastructure, DevOps, and automation (ideally AWS, Terraform, GitLab CI, Jenkins) Lead engineering teams Collaborative Working and leading ...

speed in the below: Go to write our application code (there’s an excellent interactive Go tutorial here ) Cassandra for most persistent data storage Kafka for our asynchronous message queue Kubernetes and Docker to schedule and run our services Envoy Proxy for RPC AWS for most of our production ...

speed in the below: Go to write our application code (there’s an excellent interactive Go tutorial here ) Cassandra for most persistent data storage Kafka for our asynchronous message queue Kubernetes and Docker to schedule and run our services Envoy Proxy for RPC AWS for most of our production ...

Location: Hybrid Sheffield, Birmingham and London Duration: 3-Day Contract (Hybrid) Contract : 6-12 months Required Skills Strong hands-on experience with Apache Kafka Proficiency in Python and JavaScript Experience with Terraform for Infrastructure as Code Strong knowledge of Jenkins and GitHub Actions Experience with GitOps tools such ...

that power analytics and AI-driven decision making. What youll be doing Building and optimising scalable data pipelines using Java (primary) and technologies like Kafka, Flink, or Spark Developing real-time streaming solutions and event-driven architectures using AWS services (Kinesis, MSK, Lambda, Glue) Contributing to data architecture, modelling … Strong experience in data engineering or large-scale data platforms (3+ years) Proficiency in Java or Python Hands-on experience with streaming technologies (Kafka/Flink preferred) Good understanding of distributed systems and cloud platforms (AWS ideally) Experience with CI/CD, Docker, Kubernetes, and modern DevOps practices ...

pipelines using Git -based tooling. <\/li> Manage AWS infrastructure supporting a mix of React front -end applications, microservices, AWS Lambda functions, and Kafka event integrations. <\/li> Support integrations involving ETL processes and Robotic Process Automation (RPA) solutions. <\/li> Implement and manage secure networking patterns, including … Experience supporting modern application architectures, including: React front -end applications <\/li> Microservices <\/li> AWS Lambda functions <\/li> Event -driven architectures using Kafka <\/li><\/ul><\/li> Experience with Infrastructure as Code (Terraform, CloudFormation, or equivalent). <\/li> Strong understanding of AWS networking concepts ...

pipelines using Git -based tooling. <\/li> Manage AWS infrastructure supporting a mix of React front -end applications, microservices, AWS Lambda functions, and Kafka event integrations. <\/li> Support integrations involving ETL processes and Robotic Process Automation (RPA) solutions. <\/li> Implement and manage secure networking patterns, including … Experience supporting modern application architectures, including: React front -end applications <\/li> Microservices <\/li> AWS Lambda functions <\/li> Event -driven architectures using Kafka <\/li><\/ul><\/li> Experience with Infrastructure as Code (Terraform, CloudFormation, or equivalent). <\/li> Strong understanding of AWS networking concepts ...

managing telemetry collectors (OpenTelemetry/OTel, Beats, Prometheus). Experience in designing and scaling data pipelines for high-velocity telemetry. Essential expertise in Apache Kafka, Logstash, or streaming/orchestration frameworks (Airflow, Vector, Debezium). Hands-on experience architecting scalable, containerized solutions using Kubernetes (K8s), Docker, and infrastructure … following equivalent expertise: From Big Data/ETL to Telemetry Pipelines: If you have built high-throughput streaming pipelines using Apache Kafka, Airflow, NiFi, or Spark, you already know how to route and transform complex data feeds at scale. From Enterprise Search to System Observability: If you have engineered ...

tools Required Experience 5+ years in professional Java backend development Core Tech Stack Java, Spring Boot, JPA/Hibernate, MySQL (or other RDBMS), Apache Kafka, Linux Preferred/Plus Tech Directed Acyclic Graphs, Graph Databases, FFmpeg, CI/CD systems, Spring Cloud, Swagger, Snowflake, Apache Doris, Debezium Application Materials … Management: Solid understanding of MySQL (or other major RDBMS) along with practical query‐tuning and optimisation experience. Data Streams: Hands‐on experience with Apache Kafka and building Change Data Capture (CDC) pipelines. Optimization: Proficient in Java performance profiling, memory management, and advanced debugging techniques. Environment: Comfortable working in Linux ...

initiatives. This is an opportunity to work on large-scale projects, collaborate with international teams, and develop your expertise across MuleSoft, AWS, Kafka, APIs, and cloud technologies within a highly supportive environment that offers genuine long-term career progression. What You'll Be Doing Designing, developing, and supporting integrations … RESTful APIs Experience working with SQL and databases Exposure to AWS services such as S3, SNS, SQS, IAM, CloudWatch, or EventBridge Experience working with Kafka or similar messaging technologies Understanding of OAuth, JWT, and API security principles Strong communication skills and fluent English Desirable Experience Azure DevOps Integration certifications ...

Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Manchester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either apply … ENGINEERING/DEFENCE/NATIONAL SECURITY/DATA STRATEGY/DATA PIPELINES/DATA GOVERNANCE/SQL/NOSQL/APACHE/NIFI/KAFKA/ETL/MANCHESTER/DV/SECURITY CLEARED/DV CLEARANCE ...