1,126 to 1,150 of 1,222 Kafka Jobs

Kraken's real-time streaming infrastructureOwn the architecture and roadmap for high-volume low-frequency data systems, with focus on data stack like Spark, Kafka, Iceberg, RisingWave, Apache FlinkDesign and operate scalable data architecture that serve trading, risk, compliance, analytics and many product teams. Drive adoption of AI automation … Presto), including data modeling, data quality best practices, and self-service tooling. Strong expertise in building and operating real-time data at scale including Kafka, Spark Streaming, Debezium, and CDC pipelines. Proven ability to manage competing priorities across multiple stakeholder groups — aligning platform investments with the needs of product ...

experience, with at least 2 years in a customer-facing, embedded, or solutions engineering capacityStrong hands-on experience with streaming and event-driven architectures — Kafka, Flink, Kinesis, Spark Streaming, or equivalent (DynamoDB and MemoryDB/Redis)AWS Cloud Fluency - understand how to design scalable end-to-end architectures … pipelines on large volumes of data (think Kafka/Flink for streaming + AWS Lambda + Kinesis)Solid data engineering fundamentals: pipeline design, SQL, Python, schema modeling, data qualityExperience building or integrating with CDP, marketing automation, or behavioral data-management platformsProven ability to go from ambiguous problem to working ...

platform, designed to be able to handle all aspects of the Loyalty and Benefits customer experience, globally. Built using modern tools such as Golang, Kafka and Docker, there is ample opportunity to drive innovation and grow knowledge and skills as an Engineer. As a Software Engineer on an Scrum … other experience can be considered) Comfortable/experienced with back-end micro-service architecture and communication, specifically REST and asynchronous messaging services (e.g., Kafka, RabbitMQ etc.) Comfortable/experience within a Scrum framework working with as part of a team to deliver business functions and customer journeys that ...

Skills: Golang, Microservices, Agile, Kafka, Docker, REST Web Services, CI/CD Work Mode: Full Time Job Status: Open Follow Us On: We are looking for Golang Developer to join our team, who will work closely with development team to develop new system capabilities as defined within the technical … other experience can be considered) Comfortable/experienced with back-end micro-service architecture and communication, specifically REST and asynchronous messaging services (e.g., Kafka, RabbitMQ etc.) Comfortable/experience within a Scrum framework working with as part of a team to deliver business functions and customer journeys that ...

owned data products. Primary Skills Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures. Hands‐on experience with streaming technologies, especially Kafka/Confluent Kafka. Experience integrating legacy data sources such as DB2 (mainframe) and SQL Server. Working knowledge of AWS data services, especially S3. Understanding … data pipelines from legacy mainframe DB2 and on‐prem SQL Server systems into an AWS‐based data lake. Implement real‐time ingestion using Confluent Kafka and land data in Amazon S3. Develop data transformations and analytics pipelines in Databricks using the medallion architecture (Bronze, Silver, Gold). Design ...

Billing within an event-driven architecture.Key ResponsibilitiesOwn end-to-end solution architecture and HLD across all workstreamsDefine and govern event-driven architecture patterns (Kafka/event streaming, async processing)Manage cross-domain dependencies and ensure integration consistencyProvide architecture governance, design approvals, and CAB stakeholder engagementPartner with Integration Architect, Data … multiple domains: Payments, KYC, Billing, Treasury, OperationsExperience working in onshore leadership roles with offshore delivery teamsTechnical & Domain SkillsStrong experience in event-driven architecture (Kafka, event bus, streaming platforms)Expertise in microservices, APIs, cloud-native architecture (Azure/AWS)Understanding of payment ecosystems (SEPA, SWIFT, Faster Payments, ISO 20022)Familiarity ...

logistics systems). Work with Fogsphere’s API‐driven platform for automation, reporting, and integrations. Configure workflows for publish/subscribe messaging (MQTT, Kafka, or similar). IoT & Sensors Integrate with IoT infrastructure for command and event‐based automation. Configure LoRaWAN networks and sensors (preferred). Customer & Partner Enablement … third‐party system APIs in enterprise environments. Solid understanding of computer vision AI parameters and workflow optimization. Knowledge of publish/subscribe architectures (MQTT, Kafka). Excellent verbal and written communication skills in English. Empathy and patience when supporting and training partners/customers. Preferred Experience Working knowledge ...

systems. What you will be doing: Own the design, implementation, and operation of shared Resource Plane services used across the organization Operate and evolve Kafka, RabbitMQ, Redis, and Elasticsearch platforms in production Apply SRE principles to ensure availability, scalability, reliability, and safe upgrades of stateful systems Build and maintain … degree in Computer Science, Software Engineering, or Information Technology Senior-level experience operating production-grade, stateful distributed systems Strong hands-on experience with Kafka, RabbitMQ, Redis, and Elasticsearch Proven experience running infrastructure primarily in on-prem environments Strong understanding of Linux systems, networking, and storage fundamentals Deep experience with ...

diligence. Technical security & architecture: Define and enforce the security architecture across our Azure-native, Kubernetes-based platform. Govern security controls across the full stack: Kafka, .NET/C#, Vue.js, Kong API Gateway, Auth0, and Salesforce. Lead threat modelling, penetration testing, and vulnerability management programmes. Own identity and access management … software engineering — understanding of SDLC security, threat modelling, and DevSecOps. Experience managing a security team and developing talent toward senior positions. Familiarity with Kafka-backed event architectures and the security considerations they introduce. Awareness of AI and machine-learning security risks and emerging AI governance frameworks (e.g. NIST ...

directly affects care delivery at scale. We are rebuilding the technology platform to be event-based, multi-tenant, and agent-ready using .NET on Kafka and Postgres for the new estate. The legacy platform remains active while domains migrate. Our small, senior team works closely with the business. … systems into the right boundaries, reducing complexity and increasing maintainability and business collaboration. Event sourcing, CQRS, and event streaming in production. Akka.NET, EventStore, Marten, Kafka, or similar. You understand event-sourced systems beyond the marketing, where you apply and where you don’t. Postgres at scale. Schema design, performance ...

problems and the chance to shape an important company while its foundations are still forming. What You’ll Work On Event-driven architecture and Kafka-based workflows , including long-running processes that behave correctly under retries, replay and partial failure Core data models spanning clients, households, firms, assets, products … TypeScript , or comparable depth in another language and the appetite to work in both Distributed and event-driven systems. Strong understanding of Kafka or an equivalent, including ordering, replay, idempotency and partial failure Data modelling judgement. Experience modelling complex or data-critical systems across SQL and NoSQL, with ...

environment designed for both product delivery and AI integration: TypeScriptNode.js for backend and banking applicationsReact on the frontendPostgreSQL for data storage; Redis, SQS, and Kafka for jobs, queues, and event streamingTerraform to define infrastructure as codeKubernetes, Lambdas, and Step Functions to run our applicationsAWS as our cloud provider, including … reliability. Practical experience, or strong interest, in integrating predictive models, LLM APIs, or other AI capabilities into product backends. Familiarity with technologies such as Kafka, SQS, Step Functions, PostgreSQL, and modern observability practices. Leadership & collaborationYou are: Highly autonomous and comfortable owning backend systems from design to production. Product-minded ...

Join a team of Google Cloud experts, using your knowledge of data to thrive in a fast paced and innovative environment. You'd drive out the cloud transformation, taking a lead on all things data ...

The Company You'll JoinCarta is the connected platform and AI-native ecosystem for private capital. Built to replace fragmented tools with a single system of record, Carta brings together the software, services, and legal ...

Software Engineer - Data Infrastructure - Kafka Canonical · London Licensed sponsor London On-Site Likely to sponsor About the role Canonical is building a comprehensive automation suite to provide multi-cloud and on-premise data solutions for the enterprise. The data platform team is a collaborative team that develops a managed … looking for candidates from junior to senior level with interests, experience and willingness to learn around Big Data technologies, such as distributed event-stores (Kafka) and parallel computing frameworks (Spark). Engineers who thrive at Canonical are mindful of open-source community dynamics and equally aware of the needs ...

Solution Architect/Senior Solution Architect/Technical Solution Architect - Java/Kafka - Hands on £600 Pay - Outside IR35 - 4 Days per week on site in London Bridge 6 month initial contract We've partnered with a genuinely exciting organisation who are building a greenfield Bank, as part … whole host of new platforms and technologies. For this role, we're looking for a hands on/technical Solution Architect with Java and Kafka to drive forward the end-to-end architecture for s RTL & Payments Transformation, ensuring cohesive design across Payments, Reconciliation, KYC, Cash Management, Monitoring ...

design through to production‐grade integration testing — using modern Java and Spring technologies. You will design REST APIs, implement event-driven solutions with Kafka, and collaborate with cross-functional teams. #J-18808-Ljbffr ...

financial services sector. You will design, build, test and deploy robust Java-based applications, working with event-driven architectures and large-scale data using Kafka and related technologies. You will take ownership of key technical projects and ensure data quality and auditability across critical systems. #J-18808-Ljbffr ...

PostgreSQL database solutions Manage Elasticsearch deployments and optimisation Implement workflow automation using Azure Data Factory Develop and support Real Time event streaming solutions using Kafka and NATS Support security, authentication and access management using technologies such as Keycloak Collaborate with technical teams to deliver resilient, secure and scalable data … platforms Skills: Strong commercial Python development experience Experience developing ETL/ELT solutions within enterprise environments Azure Data Factory expertise Experience with Kafka and/or NATS event streaming technologies PostgreSQL administration and development experience Elasticsearch experience Strong understanding of data security, access controls and platform governance Experience operating ...

/Test Engineer READ THIS BEFORE YOU APPLY You will be testing Kafka-based streaming data pipelines at genuinely enormous scale, and you will be writing the test strategy for the whole programme from a blank page. There is nothing in place today. If that sounds like … Streaming, continuous, and at a scale where millions to potentially billions of rows a day is the normal operating picture, not the stress test. Kafka, high-volume ETL and ELT pipelines, and a blank page where the test strategy should be. That is the job. WHAT YOU WILL ACTUALLY ...

/Test Engineer READ THIS BEFORE YOU APPLY You will be testing Kafka-based streaming data pipelines at genuinely enormous scale, and you will be writing the test strategy for the whole programme from a blank page. There is nothing in place today. If that sounds like … Streaming, continuous, and at a scale where millions to potentially billions of rows a day is the normal operating picture, not the stress test. Kafka, high-volume ETL and ELT pipelines, and a blank page where the test strategy should be. That is the job. WHAT YOU WILL ACTUALLY ...

# Sr Data Engineer at N Consulting LtdWork mode: Hybrid - 2 days a week WFO Contract duration: 6 months Location: Northampton, UK --------------------------------------- JOB DETAILS Role Title: Sr Data Engineer • Minimum 6-8 years of experience ...

Employ tools such as Azure Data Factory to automate data flows and manage complex workflows within hybrid environments. Utilise event‐driven technologies such as Kafka and NATS to handle real‐time data streams effectively. Manage security setups and access controls, incorporating tools like Keycloak to protect data integrity … hybrid (on‐premises and Azure) environments. Practical experience with Azure Data Factory in environments. Proven ability in managing and deploying event streaming platforms like Kafka and NATS. Experience with implementing security practices and tools, including Keycloak, across multiple platforms. Strong background in managing Elasticsearch and PostgreSQL in environments that ...

Tech: Core Java, JDBC, Kafka, HDFS, Docker, SQL, MultithreadingChallenge: Greenfield Big Data Analysis Platform Development in FSFirm: Well-known Financial Data fintech50 business, City of London, 10 man flat Dev TeamPay: 85k, Options, training budget, Pension, Life/Health, Some Work from HomeNO FINANCE EXPERIENCE NEEDEDCore Java Developer … technology and the possibility of making serious money doing something you are passionate about. My client is based in LondonCore Java, JDBC, Kafka, HDFS, Docker, SQL, Multithreading ...

Data Flow Define integration needs across Workforce, Customer Comms, SMS, Web Outage Maps, Regulatory Reporting and analytics platforms. Review SOAP, DB links, API gateway, Kafka and event‐driven integration options for resilience during storm‐event bursts. Support DERMS‐to‐ADMS interface discovery where included in scope. Testing and Operational … management skills. Preferred Experience ADMS upgrade or version migration experience, preferably GE PowerOn Advantage (ADMS S6). SOAP/XML integration, Oracle, DB links, Kafka, API gateway or durable messaging patterns. PowerOn Mobile, DERMS integration, AMI, GIS, Workforce Management or customer communications integration. UK DNO/DSO operations, outage ...