12 of 12 Kafka Jobs in Bristol

testing and version control. Data Engineering Stack Experience building pipelines using streaming frameworks, distributed processing engines and relational or analytical storage technologies. Examples include Kafka, Spark, PostgreSQL. Orchestration Experience defining and running data workflows using modern orchestration frameworks. Examples include Airflow, Dagster or Prefect. Data Quality and Lineage Familiarity ...

pipeline orchestration tools Containerisation (Docker, EKS, AKS, Kubernetes) Proficiency in CI/CD principles and tools Familiarity with open-source data tools (e.g., Spark, Kafka, PostgreSQL) Infrastructure as Code (Terraform, Ansible) Air-gapped development Automation Client/stakeholder management Public sector domain understanding Technical architecture Experience: You will have ...

tools such as Jenkins or Azure DevOps. Experience delivering scalable, high-quality digital solutions. Desirable Experience Consultancy, Government or NHS project experience. Knowledge of Kafka or other messaging systems. Knowledge of Helm. What's on Offer Competitive pension scheme. 25 days annual leave plus public holidays. Flexible benefits package ...

S3. API, Integration & Security: RESTful APIs, Apollo GraphQL; AWS IAM, token-based authentication, external identity providers. Data & Messaging: PostgreSQL, Apache Kafka, document stores. Engineering & Operations: CI/CD pipelines; ELK stack; Prometheus, Grafana. Additional Info Hybrid working : The places that you work from day to day will vary according ...

areas, please get in touch Spring Boot microservices React and Node.js frontend web application development Database technologies e.g. PostgreSQL Messaging technologies e.g. ActiveMQ or Kafka Continuous Integration and Continuous Deployment Cloud platforms, e.g. AWS, and Kubernetes platforms e.g. OpenShift Demonstrable use of AI tools to support ...

security. Proactive problem-solving mindset and ability to troubleshoot complex data pipeline issues. Experience with additional data processing and ETL tools like Apache Kafka, Spark, or Hadoop. Experience with monitoring and alerting tools such as Prometheus, Grafana, or ELK for data infrastructure. Understanding of ML algorithms, their development ...

working closely with engineers across the platform. Essential Skills & Experience Strong commercial experience with Node.js and TypeScript Experience building APIs and microservices Experience with Kafka, Kinesis, or similar streaming technologies Strong understanding of event-driven architectures Hands-on AWS experience Experience with SQL and/or NoSQL databases Familiarity ...

traditional data warehouses An understanding of machine learning model development lifecycle, feature engineering, training and testing Good understanding or hands‐on experience of Kafka Experience as a DBA or developer on RDBMS such as PostgreSQL, MySQL, Oracle or SQL Server Experience designing data applications to meet non‐functional requirements ...

telemetry implementation. Strong Java application troubleshooting skills, including JVM performance analysis, garbage collection and thread investigation. Experience supporting messaging technologies such as ActiveMQ, Kafka or RabbitMQ. Linux administration (CentOS/RHEL), including patching, package management, security remediation and system troubleshooting. Experience building deployment automation and configuration management solutions. Strong ...

Architecture: Event-driven systems and microservice development - we use Azure Service Bus, and welcome experience with similar messaging technologies such as Kafka or RabbitMQ Infrastructure: Kubernetes, Docker Observability: Prometheus, Grafana Engineering culture: DevOps, infrastructure as code, automated testing across all environments including production, continuous delivery Our Engineering Approach Full … providers Solid understanding of event-driven architecture and microservice development - we use Azure Service Bus, and welcome experience with similar messaging technologies such as Kafka or RabbitMQ Experience leading or mentoring engineers in a collaborative team environment Ability to set technical direction and provide architectural guidance Comfortable working with ...

Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time streaming (Kafka, Flink) RPA tooling (UiPath, Power Automate) dbt for data transformation Claude Code, Claude Cowork, or Claude Skills Experience with vector databases, real-time streaming (Kafka ...

Salary + Benefits – £60,000 to £71,000 + 10% bonus, 33 days holiday, pension, healthCareer Progression + Modern Tech StackPyspark | ML | AI | Databricks | Kafka | AWSAre you a Data Engineer with strong Python, SQL and PySpark skills who is looking for the opportunity to step up and accelerate your … Mathematics, Statistics or a related discipline would be advantageous Desirable SkillsExperience with any of the following would be beneficial but not essential: Databricks Apache Kafka Real-time streaming technologies AWS services ClickHouse Infrastructure as Code CI/CD practices Why Join This is more than just another Data Engineer ...