/or NoSQL database technologies Expert knowledge of various messaging protocols and technologies such as REST, HTTP/S, AMQP, WebSocket Expert knowledge of Confluent Kafka Experience and good understanding of core technologies provided by GCP/AWS, such as S3, FSX, EKS, SQS, SNS, Kinesis, AmazonMQ, DynamoDB, GKE, CloudStorage More ❯
emerging technologies. Apache Kafka Expertise : Proven experience designing, developing, and managing Kafka-based data pipelines . Good understanding of Kafka Streams , Connect, or the Confluent Kafka platform. Data Engineering Skills : Hands-on experience with ETL tools and data ingestion processes . Strong SQL skills , with the ability to write optimized More ❯
impact, we run our own services. Our current technical stack includes: backend services are containerised and provisioned into ECS clusters, service communication via Kafka (Confluent Cloud), infrastructure automation with Pulumi (Typescript), our infrastructure is hosted at AWS (most used: ECS, S3, DynamoDB, Aurora, OpenSearch), Github Actions for builds and workflow More ❯
various industries. Architectural Expertise: Strong expertise in designing and overseeing delivery of data streaming and event-driven architectures, with a focus on Kafka and Confluent platforms. In-depth knowledge in architecting and implementing data lakes and lakehouse platforms, including experience with Databricks and Unity Catalog. Proficiency in conceptualising and applying More ❯
