1 to 25 of 45 Permanent Kafka Jobs in the North of England

track record with data governance, quality, lineage, and security practices. Experience with real-time/streaming data technologies, data Ingestion/ETL (e.g., Apache Kafka, Apache NiFi, Kinesis, Pub/Sub). Strong proficiency in relational and non-relational databases (e.g., PostgreSQL, MongoDB, Cassandra). Deep knowledge of data ...

fast-paced environment. Preferred Qualifications Experience working with distributed systems and event-driven architectures. Exposure to data processing frameworks or background job systems (Celery, Kafka, etc.). Familiarity with testing frameworks and test-driven development (TDD). Understanding of security best practices in application development. Prior experience in leading ...

pipeline orchestration tools Containerisation (Docker, EKS, AKS, Kubernetes) Proficiency in CI/CD principles and tools Familiarity with open-source data tools (e.g., Spark, Kafka, PostgreSQL) Infrastructure as Code (Terraform, Ansible) Air-gapped development Automation Client/stakeholder management Public sector domain understanding Technical architecture Experience: You will have ...

Airflow, AWS Step Functions or Apache NiFi. Cloud platform experience across AWS, Azure and/or GCP. Knowledge of messaging and streaming technologies including Kafka, AWS SQS or equivalent cloud-native services. Strong understanding of SQL and NoSQL databases. Experience with modern data storage technologies including HDFS, Iceberg, Elasticsearch ...

technical discussions. Support testing, deployment and operational activities. Follow secure software development and DevOps practices. Essential Skills & Experience (Must Have) Java Spring Boot Kafka MongoDB API development and integration Basic understanding of Docker images and containers Unit Testing/TDD Gherkin-style BDD testing, preferably using Cucumber CI/ ...

Infrastructure: Experience with CI/CD tooling (e.g., GitLab CI, GitHub Actions, Jenkins) and containerisation (Docker). Desirable Microservices and Event-Driven Architecture (e.g., Kafka, SNS/SQS, EventBridge). Cloud platforms, with a strong preference for AWS . Commercial experience with TypeScript . Familiarity with Node.js performance tuning ...

what they ship: every service running in production is the direct responsibility of the team behind it. Our Stack: AWS, PostgreSQL, Redis, Docker, Kafka, Temporal, Datadog, Terraform, gRPC, GraphQL, Kotlin You should apply if you: have strong demonstrable experience and passion for backend development like working together in multidisciplinary ...

what they ship: every service running in production is the direct responsibility of the team behind it. Our Stack: AWS, PostgreSQL, Redis, Docker, Kafka, Temporal, Datadog, Terraform, gRPC, GraphQL, Kotlin You should apply if you: have strong demonstrable experience and passion for backend development like working together in multidisciplinary ...

track record with data governance, quality, lineage, and security practices. Experience with real-time/streaming data technologies, data Ingestion/ETL (e.g., Apache Kafka, Apache NiFi, Kinesis, Pub/Sub). Experience in, or knowledge of, DevSecOps Tooling and Processes. Self-starter with the ability to appropriately prioritise ...

Machine Learning – Understanding of AI/ML concepts, experience with LLMs, prompt engineering, or integrating AI capabilities into applications • Data Technologies – Experience with Kafka, PySpark, Parquet and Avro data formats, Apache Airflow for workflow management, or Streamlit for building interactive data applications • Advanced Data Management – Strong SQL design, query ...

S3. API, Integration & Security: RESTful APIs, Apollo GraphQL; AWS IAM, token-based authentication, external identity providers. Data & Messaging: PostgreSQL, Apache Kafka, document stores. Engineering & Operations: CI/CD pipelines; ELK stack; Prometheus, Grafana. Additional Info Hybrid working : The places that you work from day to day will vary according ...

improve application performance Strong understanding of secure coding practices Exposure to the following would be advantageous but not essential: - Messaging/streaming technologies (Kafka, SQS) Serverless technologies (e.g., AWS Lambda) Monitoring/logging tools (ELK, Splunk, Dynatrace) ORM technologies (JPA, Hibernate) API documentation tools (e.g., Swagger/OpenAPI) Test ...

Responsibilities \n Data Pipeline Development \n \n Build, optimize, and maintain scalable data pipelines using Java (primary), plus exposure to Python, Flink, Kafka, or Spark. \n Develop and support real‐time streaming pipelines and event‐driven integrations. Integrate data from multiple sources (streaming, batch, APIs) using AWS managed services … Qualification \n Core Data Engineering \n \n Strong programming proficiency in Java (preferred) or Python. \n Hands-on experience with at least one of: Kafka, Flink, Spark (Flink/Kafka preferred for streaming). Solid understanding of stream processing concepts (e.g., event time, state, backpressure). Understanding ...

both systems and teams Confidence in collaborating with technical and non-technical stakeholders Additional experience (nice to have) Exposure to event-driven architectures (e.g. Kafka, RabbitMQ, SNS/SQS) Knowledge of Domain-Driven Design (DDD) Experience building resilient, scalable systems Familiarity with Infrastructure as Code tools such as Terraform ...

concepts (Prometheus, Grafana, ELK, etc.). Experience with test automation tools (JUnit, Cucumber, Selenium, Postman). Knowledge of messaging and streaming platforms (Kafka) and service mesh (Istio). Understanding of network protocols, security best practices, and compliance requirements for banking. Curiosity, adaptability, and a commitment to continuous improvement ...

Strong expertise with relational databases (Oracle) and data modelling expertise (canonical data models, JSON) \n \n Deep experience with enterprise messaging platforms (Kafka, IBM MQ) \n \n Proven experience implementing AI/ML solutions ( using Python or other frameworks) to solve business problems \n \n Full-stack development experience ...

engineering, RAG architectures, fine-tuning, Agentic AI frameworks (LangChain, LlamaIndex, AutoGen). Data Engineering : ETL/ELT patterns, data modeling, Snowflake, Databricks, dbt, Airflow, Kafka/streaming architectures. Cloud Platforms : AWS (SageMaker, Bedrock, Glue), Azure (OpenAI Service, Synapse), GCP (Vertex AI, BigQuery). MLOps : Model deployment, monitoring, versioning ...

solutions using MLflow or integrating with cloud ML services. Experience in BFSI, Retail, Telecom, or Healthcare data environments. Experience with real-time data processing (Kafka, EventHub, Kinesis). Soft Skills Excellent communication and stakeholder management skills. Strong problem-solving and solution-oriented mindset. Ability to lead in a fast ...

region applications Experience with the following technologies: o AWS Serverless and serverless-supported languages o DB (ex, Postgresql, CocroachDB) o Streaming technologies (Amazon Kinesis, Kafka) o Message Queues (SQS, RabbitMQ, ActiveMQ) Experience working within an agile development Experience with containerization (Docker, Kubernetes, etc) Experience with Micro-Service and Service ...

environments. Hard Skills Experience in data engineering, ideally aerospace/defence or industrial sectors. ETL/ELT tools (Airflow, Azure, Microsoft SSIS), streaming (Spark, Kafka). Strong Python and SQL; C++, C#, or MATLAB a plus. Databases: PostgreSQL, SQL Server, Oracle, Snowflake, Iceberg, TimescaleDB. Data Platform Capabilities: Low-Code ...

Role Confluent Consulting Engineer Technology Apache Kafka, Confluent Platform, Stream Processing Location (Remote) UK Job Description Your role: As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with … data engineers, architects, and DevOps teams to deliver robust streaming solutions. Required: 5+ years of hands-on experience with Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) Strong proficiency in Java, Python, or Scala Solid understanding of event-driven architecture and data streaming patterns Experience deploying ...

Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability tooling (OpenTelemetry) alongside automated cost‐control systems (such as Karpenter, Infracost, OpenCost ...

Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability tooling (OpenTelemetry) alongside automated cost‐control systems (such as Karpenter, Infracost, OpenCost ...

technologies, such as Docker and Kubernetes. - Comfortable/experienced with back-end micro-service architecture and communication, specifically REST and asynchronous messaging services (e.g., Kafka, RabbitMQ etc.) - Experience with relational and NoSQL databases, including PostgreSQL, Couchbase, or Cassandra is a plus. - Experience with continuous integration tools (Github Actions, Jenkins ...

technologies, such as Docker and Kubernetes. - Comfortable/experienced with back-end micro-service architecture and communication, specifically REST and asynchronous messaging services (e.g., Kafka, RabbitMQ etc.) - Experience with relational and NoSQL databases, including PostgreSQL, Couchbase, or Cassandra is a plus. - Experience with continuous integration tools (Github Actions, Jenkins ...