1,126 to 1,150 of 1,215 Kafka Jobs

systems. What you will be doing: Own the design, implementation, and operation of shared Resource Plane services used across the organization Operate and evolve Kafka, RabbitMQ, Redis, and Elasticsearch platforms in production Apply SRE principles to ensure availability, scalability, reliability, and safe upgrades of stateful systems Build and maintain … degree in Computer Science, Software Engineering, or Information Technology Senior-level experience operating production-grade, stateful distributed systems Strong hands-on experience with Kafka, RabbitMQ, Redis, and Elasticsearch Proven experience running infrastructure primarily in on-prem environments Strong understanding of Linux systems, networking, and storage fundamentals Deep experience with ...

diligence. Technical security & architecture: Define and enforce the security architecture across our Azure-native, Kubernetes-based platform. Govern security controls across the full stack: Kafka, .NET/C#, Vue.js, Kong API Gateway, Auth0, and Salesforce. Lead threat modelling, penetration testing, and vulnerability management programmes. Own identity and access management … software engineering — understanding of SDLC security, threat modelling, and DevSecOps. Experience managing a security team and developing talent toward senior positions. Familiarity with Kafka-backed event architectures and the security considerations they introduce. Awareness of AI and machine-learning security risks and emerging AI governance frameworks (e.g. NIST ...

directly affects care delivery at scale. We are rebuilding the technology platform to be event-based, multi-tenant, and agent-ready using .NET on Kafka and Postgres for the new estate. The legacy platform remains active while domains migrate. Our small, senior team works closely with the business. … systems into the right boundaries, reducing complexity and increasing maintainability and business collaboration. Event sourcing, CQRS, and event streaming in production. Akka.NET, EventStore, Marten, Kafka, or similar. You understand event-sourced systems beyond the marketing, where you apply and where you don’t. Postgres at scale. Schema design, performance ...

problems and the chance to shape an important company while its foundations are still forming. What You’ll Work On Event-driven architecture and Kafka-based workflows , including long-running processes that behave correctly under retries, replay and partial failure Core data models spanning clients, households, firms, assets, products … TypeScript , or comparable depth in another language and the appetite to work in both Distributed and event-driven systems. Strong understanding of Kafka or an equivalent, including ordering, replay, idempotency and partial failure Data modelling judgement. Experience modelling complex or data-critical systems across SQL and NoSQL, with ...

environment designed for both product delivery and AI integration: TypeScriptNode.js for backend and banking applicationsReact on the frontendPostgreSQL for data storage; Redis, SQS, and Kafka for jobs, queues, and event streamingTerraform to define infrastructure as codeKubernetes, Lambdas, and Step Functions to run our applicationsAWS as our cloud provider, including … reliability. Practical experience, or strong interest, in integrating predictive models, LLM APIs, or other AI capabilities into product backends. Familiarity with technologies such as Kafka, SQS, Step Functions, PostgreSQL, and modern observability practices. Leadership & collaborationYou are: Highly autonomous and comfortable owning backend systems from design to production. Product-minded ...

Join a team of Google Cloud experts, using your knowledge of data to thrive in a fast paced and innovative environment. You'd drive out the cloud transformation, taking a lead on all things data ...

The Company You'll JoinCarta is the connected platform and AI-native ecosystem for private capital. Built to replace fragmented tools with a single system of record, Carta brings together the software, services, and legal ...

Software Engineer - Data Infrastructure - Kafka Canonical · London Licensed sponsor London On-Site Likely to sponsor About the role Canonical is building a comprehensive automation suite to provide multi-cloud and on-premise data solutions for the enterprise. The data platform team is a collaborative team that develops a managed … looking for candidates from junior to senior level with interests, experience and willingness to learn around Big Data technologies, such as distributed event-stores (Kafka) and parallel computing frameworks (Spark). Engineers who thrive at Canonical are mindful of open-source community dynamics and equally aware of the needs ...

Solution Architect/Senior Solution Architect/Technical Solution Architect - Java/Kafka - Hands on £600 Pay - Outside IR35 - 4 Days per week on site in London Bridge 6 month initial contract We've partnered with a genuinely exciting organisation who are building a greenfield Bank, as part … whole host of new platforms and technologies. For this role, we're looking for a hands on/technical Solution Architect with Java and Kafka to drive forward the end-to-end architecture for s RTL & Payments Transformation, ensuring cohesive design across Payments, Reconciliation, KYC, Cash Management, Monitoring ...

design through to production‐grade integration testing — using modern Java and Spring technologies. You will design REST APIs, implement event-driven solutions with Kafka, and collaborate with cross-functional teams. #J-18808-Ljbffr ...

financial services sector. You will design, build, test and deploy robust Java-based applications, working with event-driven architectures and large-scale data using Kafka and related technologies. You will take ownership of key technical projects and ensure data quality and auditability across critical systems. #J-18808-Ljbffr ...

PostgreSQL database solutions Manage Elasticsearch deployments and optimisation Implement workflow automation using Azure Data Factory Develop and support Real Time event streaming solutions using Kafka and NATS Support security, authentication and access management using technologies such as Keycloak Collaborate with technical teams to deliver resilient, secure and scalable data … platforms Skills: Strong commercial Python development experience Experience developing ETL/ELT solutions within enterprise environments Azure Data Factory expertise Experience with Kafka and/or NATS event streaming technologies PostgreSQL administration and development experience Elasticsearch experience Strong understanding of data security, access controls and platform governance Experience operating ...

/Test Engineer READ THIS BEFORE YOU APPLY You will be testing Kafka-based streaming data pipelines at genuinely enormous scale, and you will be writing the test strategy for the whole programme from a blank page. There is nothing in place today. If that sounds like … Streaming, continuous, and at a scale where millions to potentially billions of rows a day is the normal operating picture, not the stress test. Kafka, high-volume ETL and ELT pipelines, and a blank page where the test strategy should be. That is the job. WHAT YOU WILL ACTUALLY ...

/Test Engineer READ THIS BEFORE YOU APPLY You will be testing Kafka-based streaming data pipelines at genuinely enormous scale, and you will be writing the test strategy for the whole programme from a blank page. There is nothing in place today. If that sounds like … Streaming, continuous, and at a scale where millions to potentially billions of rows a day is the normal operating picture, not the stress test. Kafka, high-volume ETL and ELT pipelines, and a blank page where the test strategy should be. That is the job. WHAT YOU WILL ACTUALLY ...

# Sr Data Engineer at N Consulting LtdWork mode: Hybrid - 2 days a week WFO Contract duration: 6 months Location: Northampton, UK --------------------------------------- JOB DETAILS Role Title: Sr Data Engineer • Minimum 6-8 years of experience ...

Employ tools such as Azure Data Factory to automate data flows and manage complex workflows within hybrid environments. Utilise event‐driven technologies such as Kafka and NATS to handle real‐time data streams effectively. Manage security setups and access controls, incorporating tools like Keycloak to protect data integrity … hybrid (on‐premises and Azure) environments. Practical experience with Azure Data Factory in environments. Proven ability in managing and deploying event streaming platforms like Kafka and NATS. Experience with implementing security practices and tools, including Keycloak, across multiple platforms. Strong background in managing Elasticsearch and PostgreSQL in environments that ...

Tech: Core Java, JDBC, Kafka, HDFS, Docker, SQL, MultithreadingChallenge: Greenfield Big Data Analysis Platform Development in FSFirm: Well-known Financial Data fintech50 business, City of London, 10 man flat Dev TeamPay: 85k, Options, training budget, Pension, Life/Health, Some Work from HomeNO FINANCE EXPERIENCE NEEDEDCore Java Developer … technology and the possibility of making serious money doing something you are passionate about. My client is based in LondonCore Java, JDBC, Kafka, HDFS, Docker, SQL, Multithreading ...

Data Flow Define integration needs across Workforce, Customer Comms, SMS, Web Outage Maps, Regulatory Reporting and analytics platforms. Review SOAP, DB links, API gateway, Kafka and event‐driven integration options for resilience during storm‐event bursts. Support DERMS‐to‐ADMS interface discovery where included in scope. Testing and Operational … management skills. Preferred Experience ADMS upgrade or version migration experience, preferably GE PowerOn Advantage (ADMS S6). SOAP/XML integration, Oracle, DB links, Kafka, API gateway or durable messaging patterns. PowerOn Mobile, DERMS integration, AMI, GIS, Workforce Management or customer communications integration. UK DNO/DSO operations, outage ...

Compliance, Risk, and Finance teams, driving features from initial concept through production deployment and iteration. Stack Languages: Rust, Go, TypeScript/Node, Python Messaging: Kafka/Redpanda, NATS API/IPC: gRPC/REST Infra: AWS (EKS, RDS, KMS), Terraform Requirements You are a backend and onramp specialist with … TypeScript/Node/Python. Database Mastery: Expert‐level knowledge of Postgres (transactions, indexing, locking), with familiarity in Redis and event/OLAP stores (Kafka/Redpanda, ClickHouse). API Craftsmanship: Mastery of gRPC/REST best practices, including versioning, pagination, authN/Z, idempotency keys, and building rock ...

elevate our current data pipelines and streaming architectures. Establish best practices for monitoring, reliability, and scale across our data ecosystem (using Python, dbt, Airflow, Kafka, and Trino/Iceberg). Build the Unified Customer View: Productionize PoCs into scalable Airflow/dbt data workflows to lay the groundwork … Python & Big Data Expertise: Advanced proficiency in Python and proven experience architecting, deploying, and maintaining Big Data and streaming/batch pipelines (e.g., Kafka Streams, Event Streaming, Trino, Iceberg). dbt & Airflow Proficiency: Hands-on experience using dbt for scalable data transformations and Airflow for workflow orchestration. Data Architecture ...

Cards and Product Enablement. We care deeply about great engineering, which is why our core stack is Kotlin, running on a modern platform with Kafka, Kubernetes, Docker and AWS Aurora Postgres. But great engineers aren't defined by a single language which is why we are agnostic with … accountability Mentoring engineers and strengthening overall team capability Driving continuous improvement in how we build and operate systemsYour toolkit: You'll work with C#, Kafka, Kubernetes, Docker, AWS Aurora Postgres, and other modern technologies. If you haven't worked with all of these, we value skilled engineers with ...

similar platforms for application develop ment and data integration Experience with distributed data and compute, such as Spark or Databricks, Hadoop or Hive, Kafka, or AWS EMR, and cloud environments used by the IC Experience with geospatial analysis tools, such as ArcGIS or ArcPro, and GEOINT collection systems … similar platforms for application develop ment and data integration Experience with distributed data and compute, such as Spark or Databricks, Hadoop or Hive, Kafka, or AWS EMR, and cloud environments used by the IC Experience with geospatial analysis tools, such as ArcGIS or ArcPro, and GEOINT collection systems ...

data technologies. Support adoption and optimisation of platforms such as KDB+/q, QuestDB, OneTick, InfluxDB, TimeBase, Bloomberg B-PIPE, Refinitiv RMDS/TREP, Kafka, Solace, Ultra Messaging, and equivalent technologies. Drive automation of feed onboarding, monitoring, reconciliation, entitlement management, operational support, and data quality controls. Promote API-first … execution performance measurement. Strong proficiency in real-time market data and time-series technologies such as Bloomberg B-PIPE, Refinitiv RMDS/TREP, Kafka, Solace, Ultra Messaging, KDB+/q, QuestDB, OneTick, InfluxDB, TimeBase, or equivalent platforms, with the ability to partner with technology teams to shape architecture ...

from sports to political markets, to delivering the sharpest prices and the fairest odds. Our stack is designed for scale, reliability, and speed: Linux, Kafka, Postgres, Kubernetes, with Python 3, C++, Rust and React powering our platform. We build infrastructure that institutions trust while keeping trading accessible to everyone. … service to other engineering teams in a Flask API; Team Tech Stack Our current technology stack primarily includes Linux, Docker, Kubernetes, Jenkins, Kafka, Python, Flask/FastAPI, Postgres, AWS Redshift, dbt, Google Bigquery, Prometheus, Grafana, Elastic Search, Kibana, Lightdash. About the Role: You will work very closely with ...

named, described in business terms, and safe for something to query without a person checking the output Own streaming and near‐real‐time pipelines (Kafka or similar) alongside batch transformation, keeping real‐time flows reliable and cost‐efficient before they become a bottleneck Establish and enforce coding and agentic … they differ. This is the requirement we weight most heavily. Streaming ownership. You have built and owned streaming or near‐real‐time pipeline infrastructure (Kafka or similar), and can talk about what broke as readily as what worked. Strong SQL, Python and warehouse fundamentals , with Snowflake or Databricks experience ...