176 to 200 of 206 Kafka Jobs

Senior Software Engineer Salary: £75k-£110k (plus attractive bonus on top) Location: London or Leeds (relaxed about hybrid or remote working, if preferred) My client is a specialist provider of sports pricing and trading technology ...

results for products assigned to them. Key Skills needed: 4 years + Java Development Java 17/21 Spring boot Nexus, Artifactory, Sonar, Jacoco Kafka Kubernetes, Helm Databases - Hbase etc Nice to have: Kafka Streams, Data sinks OCP RabbitMQ Gatling, JMeter Datadog AWS These roles are based Hybrid ...

team, focusing on real-time data pipelines, streaming architectures, and AWS-based solutions. What You'll Do Build and scale real-time data pipelines (Kafka/Flink) Develop ELT workflows using Python/Java & SQL Work on AWS with IaC (Terraform/CloudFormation) Contribute to high-quality, production-grade … engineering What We're Looking For Strong Data Engineering experience Python or Java + SQL + AWS Experience with Kafka/streaming frameworks Exposure to PySpark/data transformation tools Why Apply? Work on high-impact fraud prevention systems Modern tech stack (AWS, streaming, real-time data) Strong engineering ...

Code across dev & prod Building robust observability and monitoring frameworks Supporting uptime/SLAs Designing and maintaining Kubernetes clusters (advanced configuration) Designing and maintaining Kafka clusters (including DR & scaling strategy) Building and optimising CI/CD pipelines Identifying infrastructure vulnerabilities and improving resilience What We're Looking For 3+ … years DevOps experience in a SaaS environment Strong AWS expertise Advanced Kubernetes administration Advanced Kafka administration (DR, topic scaling, performance tuning) Infrastructure as Code (Terraform essential) Config management (Ansible, Chef or Puppet) CI/CD tooling (Git, Jenkins or GitHub Actions) Distributed systems knowledge Strong networking knowledge (TCP/ ...

Design event-driven, data-centric architectures (pub-sub, API-led connectivity) Evaluate middleware, integration patterns, and architectural approaches Drive scalable, loosely coupled systems using Kafka and API ecosystems Align solutions with enterprise goals across business and technology stakeholders Provide governance and guidance to delivery teams Integration Architect - Key Requirements … Proven experience in enterprise Integration Architecture Expertise in event-driven architecture, pub-sub, and API-led design Hands-on experience with Kafka and integration frameworks Strong communication and architectural decision-making skills Experience across complex, multi-system environments Exposure to Endur is advantageous Database Architect - Key Responsibilities Define ...

workflows Ensuring secure and efficient use of registries (ACR/ECR), secrets, storage and ingress Supporting messaging and streaming components such as RabbitMQ and Kafka Managing cloud networking elements including Azure Application Gateway, CDN and SSO integrations What We're Looking For Strong experience with Kubernetes (high priority) Azure … Bash scripting Helm chart authoring/management ArgoCD Azure security & platform components: Key Vault, Blob Storage, CDN, Enterprise Apps/SSO Messaging & streaming: RabbitMQ, Kafka Experience with Azure Application Gateway If you're currently SC Cleared and are interested in this role, click 'apply now' to forward ...

Data Engineer Salary up to £60,000 + discretionary bonus Hybrid working model with collaborative office environment Work with Databricks, Spark Structured Streaming, Kafka (MSK), and AWS Apply online or contact Chelsea Hackett via chelsea.hackett@searchability.com ABOUT THE CLIENT Due to continued growth, we’re seeking a skilled Data … Lakehouse environment. You’ll work with both streaming and batch data pipelines using technologies such as Apache Spark Structured Streaming, Delta Live Tables, and Kafka, ensuring data flows efficiently and reliably across the organisation. Working closely with BI, product, and engineering teams, you will help deliver high-quality, governed ...

Engineer Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Gloucester when required. Required experience in the following: Apache Kafka Apache NiFI SQL and NoSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java Understand and interpret technical and business stakeholder … ENGINEERING/DEFENCE/NATIONAL SECURITY/DATA STRATEGY/DATA PIPELINES/DATA GOVERNANCE/SQL/NOSQL/APACHE/NIFI/KAFKA/ETL/GLOUCESTER/DV/SECURITY CLEARED/DV CLEARANCE ...

100M+ active series and beyond. Petabyte Logging: Operate high-performance ElasticSearch clusters holding 2000+TB of data. High-Throughput Pipelines: Grow data pipelines built on Kafka , handling hundreds of thousands of events per second. Engineering Autonomy: Write libraries and APIs (Ruby, Go) that provide engineers with self-service access … Scala . You prefer building tools to manual toil. Observability Specialist: Direct experience with Prometheus/Thanos/Cortex, ELK (Elasticsearch, Logstash, Kibana), Kafka, and Grafana. Automation Mindset: Strong proficiency in Terraform, Ansible, and Consul for infrastructure orchestration. Problem Solver: You are comfortable diving into unfamiliar codebases and have ...

Data Engineer (Pharma Background Essential) £550 per day - INSIDE IR35 6 Months Hybrid - 1 day per week in London Role Purpose We are currently looking for a Data Engineer to be responsible for designing, building ...

Lead GCP Data Engineer New Malden (Hybrid, approx. 4 days per month onsite) £85,000 to £90,000 plus up to 30 percent bonus This is an opportunity to take ownership of a brand-new ...

partners, and engineering teams.Operating autonomously while ensuring alignment and architectural integrity across teams. What you'll need to succeed Strong hands-on expertise in Kafka/Confluent Kafka, MongoDB, AWS, APIs, and Operational Data Stores (ODS).The ability to contribute with immediate productivity - prior experience delivering streaming ...

experience with asynchronous Rust and networked services Solid understanding of distributed systems and event-driven architecture Experience with messaging or streaming platforms such as Kafka Comfortable diagnosing issues across the full technical stack Technical Environment Rust with async frameworks (Tokio, Axum, Actix or similar) Distributed microservices architectures Event-driven … systems and Kafka gRPC and high-throughput APIs Large-scale backend systems supporting significant user or transaction volume Ideal Background Candidates often come from high-scale technology environments such as fintech, trading platforms, payments, or large consumer applications. Engineers with experience building complex distributed systems (in Rust) in other ...

professional experience with Golang Experience with gRPC, goroutines, and channels Hands-on knowledge of PostgreSQL performance tuning Familiarity with GORM, Prometheus, Grafana, and Kafka Exposure to Ruby on Rails, JavaScript, and TypeScript Practical experience applying design patterns such as Singleton and Factory DevOps experience in deployment and environment managemen … reliability through robust testing and performance monitoring using Prometheus and Grafana Participate in system architecture discussions, especially in migrating monoliths to microservices Work with Kafka and asynchronous communication systems Manage deployment pipelines and production environments Collaborate with cross-functional teams and contribute to code reviews and best practices ...

What you’ll work on Designing and improving high-volume data pipelines Optimising performance across ClickHouse and Postgres Working with streaming/event systems (Kafka-style architectures) Improving reliability and observability of data workflows Debugging real production data and performance issues Supporting data platform evolution and migration initiatives Contributing … fundamentals Experience operating data systems at scale Experience with at least two of: Columnar databases (ClickHouse, BigQuery, etc.) Relational databases (Postgres, MySQL) Streaming systems (Kafka, Kinesis, etc.) Strong performance debugging skills Experience in one or more of: TypeScript/Node, Go, Python Ability to reason about behaviour under load ...

scraper consolidation, and platform resilience improvements. Rationalise, deduplicate, and govern curves across systems. Architect and oversee a Medallion-style platform using Python, React, ClickHouse, Kafka/event streaming, Azure/AWS, and C#/.NET. Remain hands-on with design, prototyping, code reviews, and architecture decisions. Lead engineers, data … high-data environments. Hands-on Python experience and familiarity with modern frameworks; React for UI delivery. Experience with streaming/event-driven architectures (Kafka) and large-scale data processing; ClickHouse or similar highly desirable. C#/.NET experience beneficial for legacy systems. Knowledge of energy trading, commodities, or financial ...

container-related issues in production environments Implement and maintain monitoring, alerting, and logging solutions Support operational aspects of platforms such as: MongoDB, PostgreSQL, Apache Kafka, OpenSearch Required Skills & Experience Experience working in a DevOps or Platform Engineering role Strong knowledge of Linux and working knowledge of Windows Hands … PowerShell Familiarity with monitoring, alerting, and incident management practices Desirable Skills: Experience with GitOps tooling (Argo CD) Experience with Bamboo and Bitbucket Knowledge of Kafka, MongoDB, or PostgreSQL operations Experience operating OpenSearch or similar logging platforms Understanding of cloud security and access control (RBAC, secrets ...

Design, deploy and scale observability platforms Manage and scale Prometheus monitoring systems Deploy and maintain large Elasticsearch clusters Build and maintain data pipelines using Kafka Develop alerting and monitoring frameworks Automate infrastructure using Terraform and Ansible Develop tools and scripts using Python, Go, Ruby or Bash Work with Linux … years experience in Site Reliability Engineering/DevOps Strong Linux systems experience Observability and Monitoring tools experience Prometheus, Grafana, ELK Stack (Elasticsearch, Logstash, Kibana) Kafka Terraform/Infrastructure as Code Ansible/Configuration Management Programming experience (Python, Go, Ruby or Bash) Distributed systems and cloud infrastructure experience This ...

Streaming APIs, Reltio Connect/Hub, real-time sync, eventing) for CRM, ERP, Digital, MarTech, and Analytics platforms Collaborate on data pipelines (e.g., via Kafka, ETL tools) and define error handling, retries, DLQ, and monitoring Stakeholder Management & Delivery Facilitate workshops with Senior Customer MDM Architects and Reltio SMEs; present … consent/campaign preference management, multi-brand hierarchies) Exposure to cloud-native data platforms (AWS/Azure/GCP) and data integration tools (e.g., Kafka, Informatica IICS, Talend, MuleSoft, Boomi) Knowledge of Mastering for B2B/B2C, Location mastering, Reference data management, and Hierarchy management Understanding of privacy/ ...

Python Previously worked at a start up/smaller sized company 5 years+ experience Ability to build software which scales Building messaging queues e.g., Kafka (nice to have) This is entirely a Python back-end development role (Python 3), where the core framework used is FastAPI and Kafka ...

Solution Architect – Shape the Future of a High-Scale Platform Kafka, SQL, C#, .NET, Golang, TypeScript Are you ready to define and drive the architecture of a platform built to handle millions of transactions per second, powering international growth and long-term scalability? We’re embarking on a full … Define solution architecture and technical strategy for a complex, high-scale platform Own end-to-end design across distributed, event-driven systems (Kafka, SQL, cloud-native) Partner with product, engineering, and business stakeholders to translate vision into architecture Lead technical planning, standards, and best practices across multiple teams Provide ...

great fit. What You'll Do Develop, maintain, and optimise product and stock data feeds using tools like Athos Commerce and technologies such as Kafka and Snowflake. Manage real-time feed integrations with platforms including Meta, TikTok, Salesforce Marketing Cloud , and others. Support ETL processes to ensure accurate … data pipeline tools (Funnel, Datorama) or Snowflake. Experience in enterprise retail, ecommerce, or marketplace environments. Familiarity with real-time data architecture (e.g., Kafka). What You'll Bring Problem-solving mindset and ownership of tasks from start to finish. Ability to simplify complex problems and communicate clearly with stakeholders. ...

Marketing Technology Executive London, hybrid Salary up to £50,000 This is an excellent opportunity to join a growing digital marketing function and play a key role in shaping the technical capabilities that power product ...

Solution Architect - Applications, Open Source, Kafka, Biztalk, Angular Exciting career opportunity available for a proven Applications Solutions Architect who has depth and breadth in designing and building technical Open Source - Kafka, Biztalk, Angular solutions. Working for a global financial services organisation, you will get the opportunity to lead ...

automated metadata ingestion from: Data lakes ETL tools ( Glue, Informatica, Talend, IICS ) Data warehouses ( Redshift, Snowflake, BigQuery ) BI tools ( Power BI, Tableau ) Streaming sources ( Kafka ) Build lineage diagrams across ETL pipelines, APIs, datasets, and downstream consumption layers. Ensure metadata completeness, accuracy, and operational SLAs. Essential Skills & Experience: Expertise with … workflow implementation) Experience with: Data lakes ETL tools ( Glue, Informatica, Talend, IICS ) Data warehouses ( Redshift, Snowflake, BigQuery ) BI tools ( Power BI, Tableau ) Streaming sources ( Kafka ) Ability to build lineage diagrams across ETL pipelines, APIs, datasets, and consumption layers Strong knowledge of metadata management, data quality, and data governance frameworks ...