651 to 675 of 1,223 Permanent Kafka Jobs

technical details around implementation, deployment, and monitoring of their solutions. The core tech stack we use is based on AWS and GCP, using: Kafka as our message transport Flink for (near) real time processing Datahub as our catalog BigQuery as our warehouse Airflow (GCP Composer) for scheduling ...

processing systems handling large-scale (big data) volumes in near real time. Hands-on exposure to technologies such as HDFS/S3, Snowflake, SingleStore, Kafka (or similar streaming systems), Flink (or similar distributed processing frameworks), and Java/Scala (Python optional). Excellent communication skills, with the ability ...

Architectures and modular design principles. Experience working closely and directly within a team environment. Experience with tools such as Confluence, Eclipse, Jira, Jenkins, Junit, Kafka, and Spring Boot. Knowledge of common skills for software application development What We Offer: Our values drive our actions, behaviors, and performance with ...

Lambda, API Gateway, S3, DynamoDB, RDS)* **Database Architecture**: Experience with Snowflake, relational databases, NoSQL; understanding of data modeling best practices* **Event-Driven Architectures**: Kafka or Kinesis; exactly-once processing; schema registries (Confluent, AWS Glue)* **API & Service Design**: REST, gRPC, GraphQL; versioning and backward compatibility at scale* **Distributed Systems**: Microservices ...

understanding of software development fundamentals, data structures, design patterns, object-oriented programming, and algorithms complexity analysis. Demonstrated experience with messaging technologies such as Solace, Kafka, etc. Practical experience with Chronicle and/or Aeron. Experience with distributed caching techniques. Proven track record in implementing and supporting market data processing ...

people, head to our tech blog. What you'll be doing Designing and building new features and enhancements using Java 17+, Spring Boot, Elasticsearch, Kafka, Gradle, Hibernate, Couchbase, SQL, and Docker. Collaborating with cross‐functional teams and stakeholders to shape solutions and align on priorities. Taking ownership ...

processing systems handling large‐scale (big data) volumes in near real time. Hands‐on exposure to technologies such as HDFS/S3, Snowflake, SingleStore, Kafka (or similar streaming systems), Flink (or similar distributed processing frameworks), and Java/Scala (Python optional). Excellent communication skills, with the ability ...

legacy source systems, structures and unstructured data) Proficiency with Parquet/Delta Lake or other modern data storage formats Experience with streaming architectures using Kafka, Event Hubs, or Kinesis for real-time data processing Knowledge of data architectures supporting AI/ML workloads, including vector databases, feature stores ...

legacy source systems, structures and unstructured data) Proficiency with Parquet/Delta Lake or other modern data storage formats Experience with streaming architectures using Kafka, Event Hubs, or Kinesis for real-time data processing Knowledge of data architectures supporting AI/ML workloads, including vector databases, feature stores ...

legacy source systems, structures and unstructured data) Proficiency with Parquet/Delta Lake or other modern data storage formats Experience with streaming architectures using Kafka, Event Hubs, or Kinesis for real-time data processing Knowledge of data architectures supporting AI/ML workloads, including vector databases, feature stores ...

language — Python is required . Proficiency in at least one object-oriented language. Experience with big data technologies such as HDFS, YARN, MapReduce, Hive, Kafka, Spark, Airflow, or Presto. Experience with AWS, GCP, or Looker (advantageous but not essential). Solid background in data modelling, including the design, implementation ...

language — Python is required . Proficiency in at least one object-oriented language. Experience with big data technologies such as HDFS, YARN, MapReduce, Hive, Kafka, Spark, Airflow, or Presto. Experience with AWS, GCP, or Looker (advantageous but not essential). Solid background in data modelling, including the design, implementation ...

processing systems handling large-scale (big data) volumes in near real time. Hands-on exposure to technologies such as HDFS/S3, Snowflake, SingleStore, Kafka (or similar streaming systems), Flink (or similar distributed processing frameworks), and Java/Scala (Python optional). Excellent communication skills, with the ability ...

developing and testing agent build in Google ADK Working with Model Context Protocol (MCP) and creating servers. Other technology we use includes Neo4j, Postgres, Kafka and libraries such as FAST API. Build and maintain CI/CD pipelines to support reliable, repeatable deployments. Collaborate with teammates on shared components ...

delivery of secure, full stack features — turning requirements into solid designs, shipping clean Java code, and improving services built on microservices, Kafka/event-driven patterns, and CI/CD pipelines. You will troubleshoot complex production issues, drive performance and resiliency improvements, and automate recurring problems to strengthen operational … services, including testing strategy, release execution, and operational support Strong proficiency in Java and common frameworks such as Spring Boot, Hibernate, JPA, and Spring Kafka, including performance tuning and troubleshooting patterns Working knowledge of microservices and Kafka/event-driven architectures, including reliability patterns such as idempotency, retries ...

reliable data services by designing and developing scalable, high-performance pipelines and APIs in Java and Micronaut, integrating with event-streaming platforms such as Kafka to ensure accurate and timely data delivery. Own features end-to-end, from design and development through testing, deployment and production support, balancing delivery … such as GitHub Actions and Infrastructure as Code technologies like Terraform. Strong knowledge of cloud platforms, preferably Azure, alongside modern data integration technologies including Kafka, SFTP, relational databases, MongoDB and SaaS integrations. Experience designing data models, data contracts and schema evolution strategies, with a strong understanding of domain-driven ...

systems that ensure accurate, scalable, and efficient accounting across global operations. - Expanding into data analytics and pipeline initiatives using Snowflake, Redis, and Kafka to manage high-volume, real-time data. - Collaborates closely with Product, Operations, and other Engineering teams to deliver business-critical capabilities. - Agile and collaborative environment that … expertise in SQL Server, including stored procedures, performance tuning, and data modeling. - Experience with Redis for caching or data persistence. - Hands-on exposure to Kafka or similar publish-subscribe systems for real-time event processing. - Familiarity with Snowflake and data pipeline concepts (ETL, batch vs. streaming). - Experience with ...

e.g., technical designs, diagrams, architecture decision records) ensuring implementation aligns with design constraints and architecture standards Contribute to event-driven and streaming architectures using Kafka, including topic design, schema/contract strategy, and resilient producer/consumer patterns Support containerized service delivery and operational readiness using Kubernetes, and contribute … Hands-on experience in system design, application development, testing, and operational stability in a large corporate environment, including event-driven architectures and streaming patterns (Kafka) Proficiency in Java and building services with Spring Boot, and strong expertise in React with TypeScript to build robust, maintainable frontend applications; strong ...

Job Type: Permanent (Hybrid – 2 Days Office and 3 Days work from Home) Location: London, United Kingdom Number of hours: 40 hours per week – full time Ready to utilize your experience and expertise in Java ...

teams. Ensure data quality, optimize performance, and enhance data accessibility. What you bring: Expert proficiency in Data Engineering & Java. Advanced skills in AWS, Apache Kafka, and Kubernetes. Solid experience in Big Data Engineering. Proven ability to lead, mentor, and provide technical solutions across teams. If interested, kindly share ...

batch). Hands-on experience with: Dremio, Snowflake, or Databricks AWS data services (S3, Glue, Athena, Lake Formation, or equivalent) NATS/Apache Kafka or similar, and CDC patterns (Debezium or equivalent) Stream processing (Apache Flink, Spark Structured Streaming, or equivalent) SQL and query optimisation at scale Data ...

Experience with Linux-based, concurrent, high-throughput, low-latency software systems Experience with pipeline orchestration frameworks (e.g. Airflow, Dagster) Experience with streaming platforms (e.g. Kafka), data lake platforms (e.g. Delta Lake, Apache Iceberg), and relational databases Have a Bachelor or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering ...

with PostgreSQL and Snowflake Preferred: Familiarity with Web Frameworks such as Django, Flask or FastAPI Preferred: Familiarity with event streaming platforms such as Apache Kafka Preferred: Familiarity with data pipeline platforms such as Apache Airflow Preferred: Familiarity with Java Preferred: Experience in one or more relevant financial areas (market ...

such as Cypher or Gremlin - Deep understanding of graph modelling, distributed systems, data architecture and performance optimisation - Experience with streaming technologies such as Apache Kafka and Flink - Able to work hands-on while providing senior architectural guidance within an early-stage environment - Experience within fintech, accounting, payments, banking ...

such as Cypher or Gremlin - Deep understanding of graph modelling, distributed systems, data architecture and performance optimisation - Experience with streaming technologies such as Apache Kafka and Flink - Able to work hands-on while providing senior architectural guidance within an early-stage environment - Experience within fintech, accounting, payments, banking ...