1 to 25 of 27 Contract Kafka Jobs in England

skills Ability to work effectively in distributed, multi-team environments Desirable Skills & Experience Experience with SaaS-based architectures Exposure to event-driven architecture (e.g. Kafka, JMS, or similar) Experience with system integration and enterprise messaging Knowledge of cloud platforms (GCP preferred) Familiarity with CI/CD pipelines and DevOps ...

Domain experience in BFSI (risk, pricing, regulatory reporting, underwriting, fraud, payments, or actuarial data). Experience with event-driven and near-real-time pipelines (Kafka/Kinesis, streaming ETL). Knowledge of data quality frameworks (Great Expectations, Deequ) and data lineage/catalog (Atlas, Alation, Collibra). Exposure ...

documentation abilities. Experience using Pyomo, AMPL, Gurobi, CPLEX, or similar optimization tools. Working knowledge of containerization and cloud-native deployment. Familiarity with RabbitMQ/Kafka, microservice architecture, and distributed systems. ...

integration solutions across distributed systems. This role requires deep expertise in event driven architecture (EDA), real time streaming, and cloud native integration patterns using Kafka and AWS messaging/streaming services such as EventBridge, SQS, SNS, Kinesis. The Integration Architect partners with engineering, product, and cloud teams to create … scalable, secure, and resilient integration landscapes. Your Responsibilities: Define enterprise integration architecture using event driven, microservices, and real time streaming patterns. Architect solutions using Kafka, AWS EventBridge, SQS/SNS, Kinesis Streams/Firehose, and Kafka Connect. Establish integration standards, best practices, reusable frameworks, and governance models. Design ...

cloud platforms (Azure/AWS/GCP) and data services Understanding of DevOps tools: Git, Jenkins, Docker, Kubernetes (optional) Familiar with messaging and streaming: Kafka, Event Hub, Kinesis Experience with monitoring tools (e.g., Grafana, Prometheus, CloudWatch) Soft Skills Strong analytical and problem solving abilities Excellent communication and stakeholder management … cloud platforms (Azure/AWS/GCP) and data services Understanding of DevOps tools: Git, Jenkins, Docker, Kubernetes (optional) Familiar with messaging and streaming: Kafka, Event Hub, Kinesis Experience with monitoring tools (e.g., Grafana, Prometheus, CloudWatch) Soft Skills Strong analytical and problem solving abilities Excellent communication and stakeholder management ...

automated metadata ingestion from: Data lakes ETL tools ( Glue, Informatica, Talend, IICS ) Data warehouses ( Redshift, Snowflake, BigQuery ) BI tools ( Power BI, Tableau ) Streaming sources ( Kafka ) Build lineage diagrams across ETL pipelines, APIs, datasets, and downstream consumption layers. Ensure metadata completeness, accuracy, and operational SLAs. Essential Skills & Experience: Expertise with … workflow implementation) Experience with: Data lakes ETL tools ( Glue, Informatica, Talend, IICS ) Data warehouses ( Redshift, Snowflake, BigQuery ) BI tools ( Power BI, Tableau ) Streaming sources ( Kafka ) Ability to build lineage diagrams across ETL pipelines, APIs, datasets, and consumption layers Strong knowledge of metadata management, data quality, and data governance frameworks ...

with frequent CIO-level technical interactions. Your Responsibilities Architecture & Blueprint Design Define end-to-end architecture blueprints covering: OTEL collectors and agents OPAM agents Kafka-based data ingestion pipelines Time-series and telemetry data storage layers Create reference architectures, patterns, and guardrails. Solution Design & POC Leadership Design and review … 10+ years of experience in enterprise architecture or principal technical roles. Strong background in distributed systems and data platforms. Hands-on experience with OpenTelemetry, Kafka, and time-series data platforms. Technical Expertise Architecture of high-volume telemetry and event-driven systems. Deep understanding of stream processing and data ingestion ...

Principal will own the end-to-end product and platform strategy for an observability and telemetry ecosystem, covering OTEL collectors, OTEL/OPAM agents, Kafka-based data pipelines, and time-series data platforms. This role acts as the bridge between CIO-level stakeholders, architecture, and engineering, ensuring business requirements … product vision and platform roadmap for observability and telemetry platforms. Lead blueprint and target-state architecture for OTEL-based data collection, Kafka ingestion, and time-series data storage. Drive tool finalization and POC execution, ensuring alignment with enterprise standards and non-functional requirements. Observability & Data Platform Leadership Own platform ...

secure engineering, and agile delivery , we continue to build innovative digital services that truly matter. Preferred Technical ExpertiseCloud Infrastructure AWS (EKS, RDS, Aurora, ElastiCache, Kafka, IAM) Secure Hosting Experience working within air-gapped or government-secure environments Container & Cluster Management Docker, Kubernetes, Rancher Helm Jenkins Monitoring & Observability … Prometheus Grafana ELK Stack Dynatrace Secrets & Identity Management HashiCorp Vault Keycloak CI/CD & DevOps Tooling Jenkins Git ServiceNow Trivy Terraform Streaming & Messaging Apache Kafka (including Kafka Replication) Data Technologies PostgreSQL Redis RDLs Automation & Scripting Infrastructure as Code (IaC) Pipeline automation Event relay tooling Bash, Python, Groovy ...

Hedge Fund - Python Developer (Equities) - Trade life cycle - PnL - Kafka - Contract Our Hedge Fund client is looking for a Python Developer/Engineer Contract role This team is responsible for the firms equity transaction data platform, including trade life cycle event processing, enrichment, and PnL calculations. The role … trade events. Build and operate Python-based services that perform large-scale data transformations and calculations. Publish and distribute transaction and PnL data using Kafka, including AVRO-based schemas and streaming patterns. Required Skills Minimum of 6+ years of professional Python development experience, ideally in capital markets ...

other integrations 2. Data Engineering skill set to design and develop pipelines to ingest data into Elastic. 3. Logstash pipeline Scripting knowledge. 4. Cloud & Kafka aware 5. Kubernetes Candidate will be responsible for: -Building all the required pipeline for data ingestion -Setting up ELK stack -Analyzing and sharing insight ...

Systems: Hands-on experience with Functional Reactive Programming (RxJava, Java 9 Flow API, or similar). Low Latency Messaging: Deep understanding of 60East AMPS , Kafka, or Solace. You should be comfortable with Pub/Sub, Point-to-Point, and durable subscriptions. Middleware & Networking: Expertise in socket programming and optimizing ...

Tool & Platform Management Experience with cloud storage solutions. Desirable: Exposure to Azure, Databricks Exposure to AQR Reporting for ECB Exposure to Middleware technologies (IIB, Kafka, Message Queue) Skills and aptitudes required: Problem Solving and analytical skills, ability to analyse complex data issues, identify root causes and develop effective solutions ...

other integrations 2. Data Engineering skill set to design and develop pipelines to ingest data into Elastic. 3. Logstash pipeline Scripting knowledge. 4. Cloud & Kafka aware 5. Kubernetes Candidate will be responsible for: -Building all the required pipeline for data ingestion -Setting up ELK stack -Analyzing and sharing insight ...

version control, and automated delivery practices. Experienced with monitoring and observability tooling such as Prometheus and Grafana. Knowledge of data and streaming technologies including Kafka, MongoDB, MySQL, and PostgreSQL, plus PKI, secrets management, and IAM. Excellent communication skills. Nice to have: Puppet, KeyCloak, Vault, and experience supporting microservice architectures. ...

Optimization Group (AOG) and Supply Desk automation to source external Inventory Mandatory Skills Strong Python development experience interacting with both data in motion (Amps, Kafka) and data in rest (SQL server/Sybase/Oracle) experience Good understanding of Agile and Lean software development practices and associated tools Strong ...

workflows Ensuring secure and efficient use of registries (ACR/ECR), secrets, storage and ingress Supporting messaging and streaming components such as RabbitMQ and Kafka Managing cloud networking elements including Azure Application Gateway, CDN and SSO integrations What We're Looking For Strong experience with Kubernetes (high priority) Azure … Bash scripting Helm chart authoring/management ArgoCD Azure security & platform components: Key Vault, Blob Storage, CDN, Enterprise Apps/SSO Messaging & streaming: RabbitMQ, Kafka Experience with Azure Application Gateway If you're currently SC Cleared and are interested in this role, click 'apply now' to forward ...

Design, deploy and scale observability platforms Manage and scale Prometheus monitoring systems Deploy and maintain large Elasticsearch clusters Build and maintain data pipelines using Kafka Develop alerting and monitoring frameworks Automate infrastructure using Terraform and Ansible Develop tools and scripts using Python, Go, Ruby or Bash Work with Linux … years experience in Site Reliability Engineering/DevOps Strong Linux systems experience Observability and Monitoring tools experience Prometheus, Grafana, ELK Stack (Elasticsearch, Logstash, Kibana) Kafka Terraform/Infrastructure as Code Ansible/Configuration Management Programming experience (Python, Go, Ruby or Bash) Distributed systems and cloud infrastructure experience This ...

releases. Drive continual improvement in release processes, collaborating with agile delivery teams and leveraging knowledge of tools like Swagger/OpenAPI, Gradle, Liquibase, Kafka, React and Typescript. Nice to have: Immediate availability Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business ...

/MLOps tooling such as SageMaker, MLflow, or TFServing * Experience with Spark, Databricks, CI/CD tools, and streaming or orchestration systems like Kafka or Airflow How to Apply If you are interested in this Machine Learning Engineer position, please apply with your CV. ...

controls (RBAC, retention, PII handling, TLS, token governance, index and role mapping) Integrate telemetry pipelines including OpenTelemetry, Prometheus, Fluentd/Fluent Bit/Vector, Kafka, CMDB and AIOps/ML solutions Drive SLO/KPI alignment, golden signal monitoring, rollout/rollback health validation, and executive reporting What … events, logs, workload correlation, and capacity management Hands-on experience with telemetry pipelines (OpenTelemetry/OTLP, Prometheus exporters, Fluentd/Fluent Bit/Vector, Kafka with TLS, HEC/UF/DS onboarding) Strong understanding of reliability engineering principles (golden signals, SLO design, namespace/application KPI mapping) Experience ...

Data Engineer (Pharma Background Essential) £550 per day - INSIDE IR35 6 Months Hybrid - 1 day per week in London Role Purpose We are currently looking for a Data Engineer to be responsible for designing, building ...

Desirable Skills/Experience Although not essential, the following skills are desired by the client: 1.Experience with microservices architecture and event-driven design (e.g., Kafka, messaging systems) 2.Knowledge of DevOps practices and CI/CD pipelines (e.g., Jenkins, GitHub Actions, Azure DevOps) 3.Familiarity with containerization and orchestration tools (Docker ...

infrastructure teams Technical Skills Architecture & Design: Microservices, event-driven architecture, domain-driven design (DDD), layered architecture Integration: RESTful APIs, OpenAPI specs, messaging systems (Kafka, MQ), asynchronous processing Cloud & Infrastructure: Cloud-native design, containerisation (Docker, Kubernetes), CI/CD pipelines Data: Distributed data systems, RDBMS/NoSQL, data modelling, data ...

DevOps/Platform Engineering roles Strong problem-solving and incident triage skills Desirable Skills Experience with Amazon Kinesis or other streaming platforms (e.g. Kafka) Exposure to monitoring and alerting tools Experience working in complex, integrated environments Awareness of performance optimisation (e.g. latency improvements) Working Pattern 2 days per week ...