651 to 675 of 1,238 Kafka Jobs

technical details around implementation, deployment, and monitoring of their solutions. The core tech stack we use is based on AWS and GCP, using: Kafka as our message transportFlink for (near) real time processingDatahub as our catalogBigQuery as our warehouseAirflow (GCP Composer) for schedulingDBT for data transformationMontecarlo for monitoringThe platform ...

processing systems handling large-scale (big data) volumes in near real time. Hands-on exposure to technologies such as HDFS/S3, Snowflake, SingleStore, Kafka (or similar streaming systems), Flink (or similar distributed processing frameworks), and Java/Scala (Python optional). Excellent communication skills, with the ability ...

Architectures and modular design principles. Experience working closely and directly within a team environment. Experience with tools such as Confluence, Eclipse, Jira, Jenkins, Junit, Kafka, and Spring Boot. Knowledge of common skills for software application development What We Offer: Our values drive our actions, behaviors, and performance with ...

Lambda, API Gateway, S3, DynamoDB, RDS)* **Database Architecture**: Experience with Snowflake, relational databases, NoSQL; understanding of data modeling best practices* **Event-Driven Architectures**: Kafka or Kinesis; exactly-once processing; schema registries (Confluent, AWS Glue)* **API & Service Design**: REST, gRPC, GraphQL; versioning and backward compatibility at scale* **Distributed Systems**: Microservices ...

people, head to our tech blog. What you'll be doing Designing and building new features and enhancements using Java 17+, Spring Boot, Elasticsearch, Kafka, Gradle, Hibernate, Couchbase, SQL, and Docker. Collaborating with cross‐functional teams and stakeholders to shape solutions and align on priorities. Taking ownership ...

legacy source systems, structures and unstructured data) Proficiency with Parquet/Delta Lake or other modern data storage formats Experience with streaming architectures using Kafka, Event Hubs, or Kinesis for real-time data processing Knowledge of data architectures supporting AI/ML workloads, including vector databases, feature stores ...

legacy source systems, structures and unstructured data) Proficiency with Parquet/Delta Lake or other modern data storage formats Experience with streaming architectures using Kafka, Event Hubs, or Kinesis for real-time data processing Knowledge of data architectures supporting AI/ML workloads, including vector databases, feature stores ...

language — Python is required . Proficiency in at least one object-oriented language. Experience with big data technologies such as HDFS, YARN, MapReduce, Hive, Kafka, Spark, Airflow, or Presto. Experience with AWS, GCP, or Looker (advantageous but not essential). Solid background in data modelling, including the design, implementation ...

language — Python is required . Proficiency in at least one object-oriented language. Experience with big data technologies such as HDFS, YARN, MapReduce, Hive, Kafka, Spark, Airflow, or Presto. Experience with AWS, GCP, or Looker (advantageous but not essential). Solid background in data modelling, including the design, implementation ...

processing systems handling large-scale (big data) volumes in near real time. Hands-on exposure to technologies such as HDFS/S3, Snowflake, SingleStore, Kafka (or similar streaming systems), Flink (or similar distributed processing frameworks), and Java/Scala (Python optional). Excellent communication skills, with the ability ...

developing and testing agent build in Google ADK Working with Model Context Protocol (MCP) and creating servers. Other technology we use includes Neo4j, Postgres, Kafka and libraries such as FAST API. Build and maintain CI/CD pipelines to support reliable, repeatable deployments. Collaborate with teammates on shared components ...

delivery of secure, full stack features — turning requirements into solid designs, shipping clean Java code, and improving services built on microservices, Kafka/event-driven patterns, and CI/CD pipelines. You will troubleshoot complex production issues, drive performance and resiliency improvements, and automate recurring problems to strengthen operational … services, including testing strategy, release execution, and operational support Strong proficiency in Java and common frameworks such as Spring Boot, Hibernate, JPA, and Spring Kafka, including performance tuning and troubleshooting patterns Working knowledge of microservices and Kafka/event-driven architectures, including reliability patterns such as idempotency, retries ...

17+, Spring Boot, and Microservices architecture. Develop and consume RESTful APIs while implementing robust authentication and authorization mechanisms. Build event-driven solutions using Apache Kafka for real-time data processing and messaging. Deploy, manage, and troubleshoot applications on Kubernetes environments. Implement observability solutions using tools such as Splunk … Skills Strong experience in Java 11/17+, Spring Boot, Spring MVC, Spring Data JPA Expertise in Microservices Architecture Hands-on experience with Apache Kafka Experience deploying applications on Kubernetes Strong knowledge of API Authentication & Authorization OAuth 2.0 JWT OpenID Connect API Gateway concepts Experience with Observability and Monitoring ...

reliable data services by designing and developing scalable, high-performance pipelines and APIs in Java and Micronaut, integrating with event-streaming platforms such as Kafka to ensure accurate and timely data delivery. Own features end-to-end, from design and development through testing, deployment and production support, balancing delivery … such as GitHub Actions and Infrastructure as Code technologies like Terraform. Strong knowledge of cloud platforms, preferably Azure, alongside modern data integration technologies including Kafka, SFTP, relational databases, MongoDB and SaaS integrations. Experience designing data models, data contracts and schema evolution strategies, with a strong understanding of domain-driven ...

systems that ensure accurate, scalable, and efficient accounting across global operations. - Expanding into data analytics and pipeline initiatives using Snowflake, Redis, and Kafka to manage high-volume, real-time data. - Collaborates closely with Product, Operations, and other Engineering teams to deliver business-critical capabilities. - Agile and collaborative environment that … expertise in SQL Server, including stored procedures, performance tuning, and data modeling. - Experience with Redis for caching or data persistence. - Hands-on exposure to Kafka or similar publish-subscribe systems for real-time event processing. - Familiarity with Snowflake and data pipeline concepts (ETL, batch vs. streaming). - Experience with ...

e.g., technical designs, diagrams, architecture decision records) ensuring implementation aligns with design constraints and architecture standards Contribute to event-driven and streaming architectures using Kafka, including topic design, schema/contract strategy, and resilient producer/consumer patterns Support containerized service delivery and operational readiness using Kubernetes, and contribute … Hands-on experience in system design, application development, testing, and operational stability in a large corporate environment, including event-driven architectures and streaming patterns (Kafka) Proficiency in Java and building services with Spring Boot, and strong expertise in React with TypeScript to build robust, maintainable frontend applications; strong ...

Job Type: Permanent (Hybrid – 2 Days Office and 3 Days work from Home) Location: London, United Kingdom Number of hours: 40 hours per week – full time Ready to utilize your experience and expertise in Java ...

GlobalLogic, a Hitachi Group Company, is seeking a Backend Engineer to design and build robust microservices using Java 17+ and Spring Boot 3. You will work across the full backend stack, from API design through ...

teams. Ensure data quality, optimize performance, and enhance data accessibility. What you bring: Expert proficiency in Data Engineering & Java. Advanced skills in AWS, Apache Kafka, and Kubernetes. Solid experience in Big Data Engineering. Proven ability to lead, mentor, and provide technical solutions across teams. If interested, kindly share ...

teams. Ensure data quality, optimize performance, and enhance data accessibility. What you bring: Expert proficiency in Data Engineering & Java. Advanced skills in AWS, Apache Kafka, and Kubernetes. Solid experience in Big Data Engineering. Proven ability to lead, mentor, and provide technical solutions across teams. If interested, kindly share ...

batch). Hands-on experience with: Dremio, Snowflake, or Databricks AWS data services (S3, Glue, Athena, Lake Formation, or equivalent) NATS/Apache Kafka or similar, and CDC patterns (Debezium or equivalent) Stream processing (Apache Flink, Spark Structured Streaming, or equivalent) SQL and query optimisation at scale Data ...

Experience with Linux-based, concurrent, high-throughput, low-latency software systems Experience with pipeline orchestration frameworks (e.g. Airflow, Dagster) Experience with streaming platforms (e.g. Kafka), data lake platforms (e.g. Delta Lake, Apache Iceberg), and relational databases Have a Bachelor or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering ...

with PostgreSQL and Snowflake Preferred: Familiarity with Web Frameworks such as Django, Flask or FastAPI Preferred: Familiarity with event streaming platforms such as Apache Kafka Preferred: Familiarity with data pipeline platforms such as Apache Airflow Preferred: Familiarity with Java Preferred: Experience in one or more relevant financial areas (market ...

such as Cypher or Gremlin - Deep understanding of graph modelling, distributed systems, data architecture and performance optimisation - Experience with streaming technologies such as Apache Kafka and Flink - Able to work hands-on while providing senior architectural guidance within an early-stage environment - Experience within fintech, accounting, payments, banking ...

important but this is not expected to be a hands on role This role is responsible for platforms built using Java, Apache Nifi, Kafka, SpringBoot, Angular 7 and Oracle, experience with some of these technologies is important Continuous Integration and Deployment is achieved using a combination of Jenkins, Teamcity ...