126 to 150 of 202 Kafka Jobs

testing data platforms such as Snowflake, BigQuery, Redshift, Databricks, Azure Synapse Experience of testing pipelines in things like Airflow, Azure Data Factory, AWS Glue, Kafka Data Concepts ETL/ELT, data modelling, data warehousing, data governance The role is 100% remote, however you must be based ...

readability, and reliability. Key Skills: Strong Java and Spring Boot development experience in high-throughput systems Deep understanding of event-driven and messaging architectures (Kafka, JMS, AMQP or similar) Experience engineering reliability and observability at scale (monitoring, tracing, SLIs/SLOs) Desirable Skills: Experience building notification delivery infrastructure (webhooks ...

Candidates will be asked to rate their knowledge of: Languages: Python, Java, Scala Compute/Distributed: RAY , Spark, Databricks, Hadoop Orchestration/Cloud: Kafka, Airflow, Prefect, AWS Storage/Warehouse: Clickhouse, Snowflake, Redshift, Greenplum Note: Experience with Petabyte/Exabyte scale is a strong signal for this role. Randstad ...

lakes and data warehousing solutions Collaborate with stakeholders to deliver scalable and insight-driven data platforms Contribute to projects involving various other tools like Kafka, Snowflake, Azure Data Factory, Synapse or Microsoft Fabric Skills and Experience Strong experience with Databricks with either Azure or AWS Strong SQL, Python ...

building something, not just how Nice to Have Experience building developer tools, IDE extensions, or CLI tooling Experience with message brokers (Kafka, RabbitMQ) Familiarity with LLM APIs and prompt engineering in production contexts Experience at an early-stage startup Why Kerno Hard problems: You'll work on code analysis ...

Mindset: A strong philosophy on what makes a "good" SLO and a passion for eliminating toil through automation. Technical Breadth: Experience with message brokers (Kafka, ActiveMQ), containerization (Nomad/Docker), and troubleshooting distributed systems. Systems Thinking: A passion for both software development and reliability engineering, applying discipline to solve ...

with real time analytics systems • Experience building benchmarking or BI platforms • Experience working with very large datasets • Familiarity with orchestration tools such as Airflow, Kafka or AWS Glue • Knowledge of partitioning and sorting strategies for large datasets • Experience in startup or high growth environments • Understanding of data science concepts ...

base systems). Distributed systems: Expert-level knowledge of Python, REST, GraphQL, gRPC, protobuf, Docker, Ansible and message buses (NATS, Kafka or RabbitMQ). Architectural judgement: The ability to make principled trade-offs between performance, safety, maintainability, and scalability. Collaborative leadership: You can align chemists, mechanical engineers, and software ...

Science etc.) Experience in data modeling (relational databases and Apache Hadoop) Know-how of core technologies such as SQL (MS SQL Server), Apache Hadoop (Kafka, NiFi, Flink, Scala and/or Java, Python) and Linux Showing interest in working with high-frequency data processing in a near-realtime environment ...

scaling of the platform globally. The right engineer should bring experience with Neo4j, production grade LLM/AI capabilities (RAG, embeddings, inference pipelines), Kafka, Java/JVM and API-first architecture. The position offers a rare modernisation opportunity, you'd be transitioning from a third-party engineering team ...

building data pipelines and platforms end-to-end. Hands on engineering across ingestion, transformation and data centralisation. Experience with tools such as Glue, Fivetran, Kafka, Dataflow, ADF or Kinesis. Transformation experience using dbt, Spark or Databricks. Confidence working directly with clients and engaging in technical discussions. Exposure to dashboards ...

building data pipelines and platforms end-to-end. Hands on engineering across ingestion, transformation and data centralisation. Experience with tools such as Glue, Fivetran, Kafka, Dataflow, ADF or Kinesis. Transformation experience using dbt, Spark or Databricks. Confidence working directly with clients and engaging in technical discussions. Exposure to dashboards ...

building data pipelines and platforms end-to-end. Hands on engineering across ingestion, transformation and data centralisation. Experience with tools such as Glue, Fivetran, Kafka, Dataflow, ADF or Kinesis. Transformation experience using dbt, Spark or Databricks. Confidence working directly with clients and engaging in technical discussions. Exposure to dashboards ...

Interest in financial data (experience helpful but not required) Nice to have: DuckDB experience Time-series experience (market data, telemetry, pricing, events) Streaming exposure (Kafka/Event Hubs/Kinesis) Experience with Temporal (or similar orchestrators like Airflow/Dagster/Prefect) Any exposure to AI agents/automation ...

multithreading and performance optimisation • Experience working with large scale distributed systems and high volume market or trade data • Familiarity with messaging technologies such as Kafka, AMPS or QPID • Python or bash for tooling and automation, with exposure to Q or KDB considered valuable If you enjoy solving challenging engineering ...

depending on the project Tools like Databricks, Snowflake and Synapse Spark and distributed processing frameworks for large-scale data Streaming technologies such as Kafka or Kinesis You will use your expertise to choose the right tools for the problem, rather than just defaulting to a single stack. What they ...

Azure and GCP depending on the project Databricks, Snowflake and Synapse Spark and distributed processing frameworks for large-scale data Streaming technologies such as Kafka or Kinesis You're expected to pick the right tools for the problem, not just default to whatever you know best. What they ...

Implement solutions for ISO 20022 message formats , transformations (XML/JSON), validations, and routing. Build integrations using Mule ESB (or similar), messaging patterns, and Kafka/event streams . Write performant SQL/PL‐SQL queries for Oracle‐based transactional systems. Contribute to system designs, code reviews, and technical … volume systems. Solid understanding of XML/JSON structures and message mapping/transformation. Experience with Mule ESB or equivalent middleware , messaging tools, and Kafka . Strong understanding of Agile delivery, CI/CD pipelines, and DevOps practices. Skilled in unit/integration testing frameworks (JUnit, Cucumber/Litmus ...

data migration and Legacy system decommissioning Experience working with CRM platforms (Siebel experience highly beneficial) Solid understanding of modern integration architectures, including: AWS APIs Kafka integrations Experience integrating cloud services with Legacy/on-prem Oracle environments Automotive experience ideally Rate: £550 per day Inside IR35 Duration: 3 months ...

planning and data archiving/housekeeping Familiarity with Cloud platforms and serverless architectures Understanding of software design patterns and their practical application Exposure to Kafka (advantageous) Experience working in Agile/DevOps environments Ability to mentor junior team members Experience supporting live production environments ...

Need? 5+ years of backend engineering experience using Node.js, TypeScript, and PostgreSQL. Deep experience with event-driven systems and real-time data processing (Kafka, RabbitMQ, webhooks). Strong grasp of distributed system architecture and messaging infrastructure. Bonus points if you've worked with LLMs or in AI-integrated environments. ...

Collaborate with SRE and Platform teams to ensure resilient and observable systems Streaming, Messaging & Distributed Systems * Build and support real-time pipelines using Apache Kafka (producers, consumers, schema evolution, partitioning, offsets) * Ensure reliability, ordering guarantees, and performance optimisation across distributed services Distributed SQL & Data Platforms * Work with Starburst/… developer environments * Experience building scalable production applications (not scripting/automation-only backgrounds) * Hands-on OpenShift production deployment and support * Practical experience with Apache Kafka * Professional Git workflows and code review processes * Starburst/Trino for distributed query processing * Advanced SQL (joins, CTEs, window functions, performance tuning) * Experience integrating ...

Senior Java Software Engineer – Java 11+, Spring, Spring Boot, Microservices, Kafka, Akka, Docker/Kubernetes, Real-time, TDD/BDD, Reactive Programming, MongoDB Payments A Senior Java Engineer with a background in finance/payments and experience working on distributed real-time systems is sought after by a global … usage of Spring/Spring Boot Experience developing distributed, real-time applications with deep knowledge of Reactive Programming Principles and tools like Akka, Kafka, WebFlux, RXJava Hands-on experience of both MongoDB and AWS cloud Industry experience within Financial Services, preferably within the Payments arena or at the very ...

andcloudplatforms Ensuringdataquality,reliability,andoperationalexcellence Leadingthedesignanddeliveryofnewdataproductsandpipelines Collaboratingcloselywithstakeholdersandtechnicalteams Providingtechnicalleadershipandmentoringwithindeliveryteams Whattherelookingfor: Strongexperienceindataengineeringroles Provenleadershiporlinemanagementexperience Hands-onexperiencewithcloudplatforms(AWSorAzure;GCPbeneficial) StrongSQLskillsandexperiencewithrelationaldatabases Pythondevelopmentexperienceandfamiliaritywithframeworks(e.g.Flask,Django) ExperiencebuildingandorchestratingETLpipelines(e.g.Airflow,Luigi,Argo) Exposuretobigdatatechnologies(e.g.Spark,Kafka,Hadoop) ExperienceworkinginAgileenvironments Solidunderstandingofdataarchitectureanddataqualitybestpractices ...

stability, trading outcomes). Nice to have Derivatives experience (traditional or crypto), and familiarity with funding, liquidation flows, and margining models. Event-driven architectures (Kafka-style), Redis, distributed systems patterns, high-throughput data pipelines. Protocols/feeds: FIX, binary feeds, ITCH/OUCH, SBE/Aeron-style IPC, shared ...