76 to 100 of 237 Kafka Jobs

Desirable Certifications: Databricks and/or AWS certifications at Associate or Professional level. Streaming Architectures: Practical experience with real-time or event-driven streaming (Kafka/MSK, Kinesis, Spark Structured Streaming). Advanced Data Architectures: Exposure to Data Mesh concepts, data products, or federated data governance models. AI/ ...

architecture and solution implementation experience - Strong hands-on development experience with modern programming languages (e.g., Python, Java) and data technologies (SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis) - 3+ years of AWS service suite, Infrastructure as Code (Terraform, CloudFormation), Security tools and frameworks, Compliance automation tool experience - Current, active US Government ...

engineering culture and people? Check out our Tech Blog. What you'll be doing: Design, build and enhance services using Java 21+, Spring Boot, Kafka, Elasticsearch, Couchbase, SQL, Docker and GradleWork closely with Product Managers, Designers, Engineers and stakeholders to solve meaningful business challengesOwn features from idea through ...

APIs; test automation; data structures; distributed processing; Git; CI/CD; containers; infrastructure awareness; production debugging and performance optimization. Data engineering: Spark or Databricks, Kafka or equivalent streaming, ETL/ELT, batch and real-time pipelines, data contracts, lineage, cataloguing, quality rules, and scalable cloud storage. Cybersecurity: SOC workflows ...

Expert SQL and strong Python programming. AWS, Azure, or GCP; Redshift, AWS Glue, Azure Synapse, Azure Data Factory, BigQuery, Dataflow, Databricks, or Snowflake. Apache Kafka, Amazon Kinesis, Apache Flink, or Spark Structured Streaming. Data modeling, data vault, lakehouse, and data mesh architecture. Data quality, catalogs, lineage, API design, data ...

communicate complex technical ideas clearly, collaborate effectively with stakeholders and champion better ways of working. Nice to Have Experience with Docker, Java/Scala, Kafka, Pulsar, Azure Event Hub, Collibra, Apache Iceberg, Apache Arrow, PySpark or AI engineering technologies such as Snowflake AI, LangChain, LlamaIndex or Pinecone would ...

cloud experience. Understanding of distributed systems, object-oriented design and software engineering best practices. Experience working with databases such as PostgreSQL. Knowledge of Kafka, Kubernetes or containerised environments would be advantageous. Strong communication and stakeholder collaboration skills. Why Join? 10% Annual Bonus Private Medical Cover Strong Pension Contribution Enhanced ...

experience is preferred, but outstanding Java Developers willing to learn Scala will also be considered. -Experience with message/event-driven architectures such as Kafka or MQ. -Experience working within Unix/Linux environments. -Strong SQL skills, ideally with Sybase and/or DB2. -Good analytical and problem-solving ...

tracing tools such as ELK, Splunk, Prometheus, Grafana, Graphite, OpenTSDB, OpenTrace, or Jaeger. Exposure to message-oriented middleware including ZeroMQ, JMS, AMPS, RabbitMQ, Kafka, or Google Pub/Sub. Exposure to container and process orchestration such as Mesos, Kubernetes, OpenShift, or Docker. High proficiency in data architecture across ...

with Git, Flux, Helm, and other development and deployment tools. Experience or familiarity with big data technologies such as: Hadoop, Accumulo, Ceph, Spark, NiFi, Kafka, PostgreSQL, ElasticSearch, Hive, Drill, Impala, Trino, Presto, etc. Understanding of AGILE software development methodologies and use of standard software development tool suites. Experience ...

open/close the workspace during regular business hours as needed. Preferred Requirements Experience with big data technologies like: Hadoop, Accumulo, Ceph, Spark, NiFi, Kafka, PostgreSQL, ElasticSearch, Hive, Drill, Impala, Trino, Presto, etc. Experience with K9s, AWS CLI and other AWS services like SNS, SQS and Diode ...

Junction. Flexibility is essential to adapt to schedule changes as needed. Preferred Requirements Experience with big data technologies like: Hadoop, Accumulo, Ceph, Spark, NiFi, Kafka, PostgreSQL, ElasticSearch, Hive, Drill, Impala, Trino, Presto, etc. Experience with K9s, AWS CLI and other AWS services like SNS, SQS and Diode ...

domain-driven design (DDD), bounded contexts, data ownership, event-driven integration, eventual consistency and distributed transactions. Event Streaming: Hands-on experience designing and operating Kafka, Kinesis or equivalent platforms, including partitioning, ordering, event contracts, schema evolution, idempotency, replay, delivery guarantees, fault tolerance, security and operational support. Data Modelling & Storage ...

Experience:Java & Test-Driven Development are essential.Experience in any number of additional technologies (listed below) is advantageous:KotlinCloud Technologies (Kubernetes, Open Shift)Messaging Technologies (Kafka, Solace, TIBCO)Database/Data Store/Data Query Technologies (SQL Server, Trino, Mongo, S3)Observability Technologies (OpenTelemetry, Elastic Stack/ELK, Grafana)Desirable ...

payments systems and the complexities of cross-border money movement. Experience with identity and access management (SAML, SSO, SPIFFE, OAuth2). Familiarity with Kafka or other event streaming platforms. Experience in a platform team serving multiple internal or external consumers. Ability to explain technical decisions to non-technical people ...

people, head to our tech blog. What you'll be doingDesigning and building new features and enhancements using Java 21+, Spring Boot, Elasticsearch, Kafka, Gradle, Hibernate, Couchbase, SQL, and Docker. Collaborating with cross-functional teams and stakeholders to shape solutions and align on priorities. Taking ownership of key technical ...

/CD pipelines and DevOps automation practices. Required Skills & Qualifications - Strong hands on experience in Java (8/11/17) and Spring Boot, Kafka, Spring MVC, Spring Security. - Strong in Python work experience - Solid experience with REST APIs, Microservices Architecture, and messaging systems (Kafka/RabbitMQ). ...

Strong programming experience in Python. Data & Infrastructure Experience with some of the following technologies is highly desirable: Frameworks/Infrastructure Apache Spark Apache Airflow Kafka Elasticsearch/OpenSearch Databases PostgreSQL MongoDB Vector databases such as Qdrant, Milvus, or pgvector Python Libraries Pandas Polars Engineering Skills Experience building scalable backend ...

distributed systems and cloud-native architectures, with experience shaping technical direction across teams and stakeholders Solid expertise in relevant technologies such as AWS, Terraform, Kafka/MSK, Airflow, Glue or Spark, and building scalable data solutions Experience with modern data ecosystems including data lakes/lakehouse architectures, Iceberg ...

with experience developing and maintaining data pipelines Familiarity with ETL/ELT technologies and data streaming tools such as Airflow, Azure, SSIS, Spark or Kafka Experience working with databases and data platforms such as PostgreSQL, SQL Server, Oracle, Snowflake or similar technologies Knowledge of data visualisation tools, particularly Power ...

skills Experience building data pipelines and integrating data from multiple sources Exposure to technologies such as Power BI, Snowflake, SQL Server, PostgreSQL, Spark, Kafka, Airflow, Docker, and Kubernetes Experience within engineering, manufacturing, industrial, or other complex regulated environments would be advantageous Excellent stakeholder management and problem-solving abilities What ...

load balancer configs (F5, Nginx, ALB/NLB), service mesh performance Storage: Latency, IOPS constraints, distributed file system behavior Caching & Middleware: Redis, Hazelcast, NATS, Kafka, RabbitMQ configuration and throughput tuning Databases: Connection pool tuning, slow queries, indexing, replication lag Cloud Layer: AWS compute/storage/network performance, regional ...

candidate will have: * Experience in data engineering, ideally aerospace/defence or industrial sectors. * ETL/ELT tools (Airflow, Azure, Microsoft SSIS), streaming (Spark, Kafka). * Strong Python and SQL; C++, C#, or MATLAB a plus. * Databases: PostgreSQL, SQL Server, Oracle, Snowflake, Iceberg, TimescaleDB. * Data Platform Capabilities: Low-Code ...

Experience with Natural Language Processing (NLP), Large Language Models (LLMs) or Image Processing. Experience in areas of model development, data processing and streaming (Spark, Kafka), microservices in python (Flask or FastAPI), and interactive visualisations and User Interfaces (Streamlit, Plotly, Gradio etc). While we think the above experience ...

Experience with Natural Language Processing (NLP), Large Language Models (LLMs) or Image Processing. Experience in areas of model development, data processing and streaming (Spark, Kafka), microservices in python (Flask or FastAPI), and interactive visualisations and User Interfaces (Streamlit, Plotly, Gradio etc). While we think the above experience ...