1 to 25 of 26 Permanent Kafka Jobs in the North of England

Airflow, AWS Step Functions or Apache NiFi. Cloud platform experience across AWS, Azure and/or GCP. Knowledge of messaging and streaming technologies including Kafka, AWS SQS or equivalent cloud-native services. Strong understanding of SQL and NoSQL databases. Experience with modern data storage technologies including HDFS, Iceberg, Elasticsearch ...

Machine Learning – Understanding of AI/ML concepts, experience with LLMs, prompt engineering, or integrating AI capabilities into applications • Data Technologies – Experience with Kafka, PySpark, Parquet and Avro data formats, Apache Airflow for workflow management, or Streamlit for building interactive data applications • Advanced Data Management – Strong SQL design, query ...

improve application performance Strong understanding of secure coding practices Exposure to the following would be advantageous but not essential: - Messaging/streaming technologies (Kafka, SQS) Serverless technologies (e.g., AWS Lambda) Monitoring/logging tools (ELK, Splunk, Dynatrace) ORM technologies (JPA, Hibernate) API documentation tools (e.g., Swagger/OpenAPI) Test ...

making.\ N \nKey Responsibilities\ N \nDataPipeline Development\ N\n\nBuild, optimize, and maintain scalable data pipelines using Java (primary), plus exposure to Python, Flink, Kafka, or Spark.\ N\n\nDevelop and support real‐time streaming pipelines and event‐driven integrations.\ N\n\nIntegrate data from multiple sources (streaming, batch … nQualification\ N \nCore Data Engineering\ N\n\nStrong programming proficiency in Java (preferred) or Python.\ N\n\nHands-onexperience with at least one of: Kafka, Flink, Spark (Flink/Kafka preferred for streaming).\ N\n\nSolid understanding of stream processing concepts (e.G., event time, state, backpressure). ...

both systems and teams Confidence in collaborating with technical and non-technical stakeholders Additional experience (nice to have) Exposure to event-driven architectures (e.g. Kafka, RabbitMQ, SNS/SQS) Knowledge of Domain-Driven Design (DDD) Experience building resilient, scalable systems Familiarity with Infrastructure as Code tools such as Terraform ...

concepts (Prometheus, Grafana, ELK, etc.). Experience with test automation tools (JUnit, Cucumber, Selenium, Postman). Knowledge of messaging and streaming platforms (Kafka) and service mesh (Istio). Understanding of network protocols, security best practices, and compliance requirements for banking. Curiosity, adaptability, and a commitment to continuous improvement ...

solutions using MLflow or integrating with cloud ML services. Experience in BFSI, Retail, Telecom, or Healthcare data environments. Experience with real-time data processing (Kafka, EventHub, Kinesis). Soft Skills Excellent communication and stakeholder management skills. Strong problem-solving and solution-oriented mindset. Ability to lead in a fast ...

nStrong expertise with relational databases (Oracle) and data modelling expertise (canonical data models, JSON)\n \n \nDeep experience with enterprise messaging platforms (Kafka, IBM MQ)\n \n \nProven experience implementing AI/ML solutions ( using Python or other frameworks) to solve business problems\n \n \nFull-stack development experience ...

nStrong expertise with relational databases (Oracle) and data modelling expertise (canonical data models, JSON)\ N\n\nDeep experience with enterprise messaging platforms (Kafka, IBM MQ)\ N\n\nProven experience implementing AI/ML solutions ( using Python or other frameworks) to solve business problems\ N\n\nFull-stack development experience ...

environments. Hard Skills Experience in data engineering, ideally aerospace/defence or industrial sectors. ETL/ELT tools (Airflow, Azure, Microsoft SSIS), streaming (Spark, Kafka). Strong Python and SQL; C++, C#, or MATLAB a plus. Databases: PostgreSQL, SQL Server, Oracle, Snowflake, Iceberg, TimescaleDB. Data Platform Capabilities: Low-Code ...

Location: Hybrid Sheffield, Birmingham and London Duration: 3-Day Contract (Hybrid) Contract : 6-12 months Required Skills Strong hands-on experience with Apache Kafka Proficiency in Python and JavaScript Experience with Terraform for Infrastructure as Code Strong knowledge of Jenkins and GitHub Actions Experience with GitOps tools such ...

nData ETL(Apache Airflow, AWS Step Functions, Apache NiFi)\ N\n\nCloud services (AWS, Azure or GCP)\ N\n\nMessaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services)\ N\n\nSQL and NoSQL\ N\n\nStorage (HDFS, Iceberg, Elastic, S3, Data Lake)\ N\n\nContainerisation and orchestration ...

software development background with hands‐on experience in platform, infrastructure, or data‐centric environments Deep expertise in event‐driven architectures, streaming technologies (e.g. Apache Kafka, Flink, and/or Pulsar) Proficiency across full stack technologies (Java, .Net, React) with the ability to guide technical decisions Knowledge of hybrid/ ...

Skills Significant demonstrable experience in one or both of: modern software engineering for digital products (ideally Java, microservice architectures, Hexagonal software architecture, Mongo and Kafka); OR designing and implementing modern cloud infrastructure, DevOps, and automation (ideally AWS, Terraform, GitLab CI, Jenkins); Significant demonstrable experience of leading engineering teams providing ...

Experience Significant demonstrable experience in one or both of: Modern software engineering for digital products (ideally Java, microservice architectures, Hexagonal software architecture, Mongo and Kafka); OR designing and implementing modern cloud infrastructure, DevOps, and automation (ideally AWS, Terraform, GitLab CI, Jenkins) Lead engineering teams Collaborative Working and leading ...

Developer's Essential Skills & Experience Candidates must have a minimum of 5 years' proven commercial experience with: Oracle PL/SQL Java Spring Boot Kafka Hibernate Gradle A proven track record of delivering and supporting high-quality code Strong organisational skills, integrity, and self-motivation with a commitment ...

Location: Hybrid Sheffield, Birmingham and London Duration: 3-Day Contract (Hybrid) Contract : 6-12 months Required Skills Strong hands-on experience with Apache Kafka Proficiency in Python and JavaScript Experience with Terraform for Infrastructure as Code Strong knowledge of Jenkins and GitHub Actions Experience with GitOps tools such ...

that power analytics and AI-driven decision making. What youll be doing Building and optimising scalable data pipelines using Java (primary) and technologies like Kafka, Flink, or Spark Developing real-time streaming solutions and event-driven architectures using AWS services (Kinesis, MSK, Lambda, Glue) Contributing to data architecture, modelling … Strong experience in data engineering or large-scale data platforms (3+ years) Proficiency in Java or Python Hands-on experience with streaming technologies (Kafka/Flink preferred) Good understanding of distributed systems and cloud platforms (AWS ideally) Experience with CI/CD, Docker, Kubernetes, and modern DevOps practices ...

managing telemetry collectors (OpenTelemetry/OTel, Beats, Prometheus). Experience in designing and scaling data pipelines for high-velocity telemetry. Essential expertise in Apache Kafka, Logstash, or streaming/orchestration frameworks (Airflow, Vector, Debezium). Hands-on experience architecting scalable, containerized solutions using Kubernetes (K8s), Docker, and infrastructure … following equivalent expertise: From Big Data/ETL to Telemetry Pipelines: If you have built high-throughput streaming pipelines using Apache Kafka, Airflow, NiFi, or Spark, you already know how to route and transform complex data feeds at scale. From Enterprise Search to System Observability: If you have engineered ...

tools Required Experience 5+ years in professional Java backend development Core Tech Stack Java, Spring Boot, JPA/Hibernate, MySQL (or other RDBMS), Apache Kafka, Linux Preferred/Plus Tech Directed Acyclic Graphs, Graph Databases, FFmpeg, CI/CD systems, Spring Cloud, Swagger, Snowflake, Apache Doris, Debezium Application Materials … Management: Solid understanding of MySQL (or other major RDBMS) along with practical query‐tuning and optimisation experience. Data Streams: Hands‐on experience with Apache Kafka and building Change Data Capture (CDC) pipelines. Optimization: Proficient in Java performance profiling, memory management, and advanced debugging techniques. Environment: Comfortable working in Linux ...

initiatives. This is an opportunity to work on large-scale projects, collaborate with international teams, and develop your expertise across MuleSoft, AWS, Kafka, APIs, and cloud technologies within a highly supportive environment that offers genuine long-term career progression. What You'll Be Doing Designing, developing, and supporting integrations … RESTful APIs Experience working with SQL and databases Exposure to AWS services such as S3, SNS, SQS, IAM, CloudWatch, or EventBridge Experience working with Kafka or similar messaging technologies Understanding of OAuth, JWT, and API security principles Strong communication skills and fluent English Desirable Experience Azure DevOps Integration certifications ...

Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Manchester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either apply … ENGINEERING/DEFENCE/NATIONAL SECURITY/DATA STRATEGY/DATA PIPELINES/DATA GOVERNANCE/SQL/NOSQL/APACHE/NIFI/KAFKA/ETL/MANCHESTER/DV/SECURITY CLEARED/DV CLEARANCE ...

process of undertaking a ground up re-architecture into Golang, React and Cloud platforms. Core skills within the team are Kafka, SQL, .Net, Golang and Typescript.\ NIn this pivotal role,you will work alongside our Technical Leads to design and implement robust verification systems, while ensuring the highest quality … hybrid working from home policy.\ NQualifications\n\ NExcellent problem-solving skills and the ability to work in a fast-paced environment.\ NKnowledge of Kafka, SQL, .Net, Golang and Typescript, though expertise in similar or alternative technologies are welcome.\ NExperience in leading development teams and delivering technical projects to successful ...

Job Descriptionhackajob is collaborating with Bet365 to connect them with exceptional professionals for this role.\ NWorking within the trading and tools team, you will develop a diverse range of applications, including desktop solutions, such as ...

Job Descriptionhackajob is collaborating with Bet365 to connect them with exceptional professionals for this role.\ NCompany Description\ NAt bet365, we're one of the world's leading online gambling companies, revolutionising the industry since 2000. ...