Expert knowledge of SQL and/or NoSQL database technologies Expert knowledge of various messaging protocols and technologies such as REST, HTTP/S, AMQP, WebSocket Expert knowledge of Confluent Kafka Experience and good understanding of core technologies provided by GCP/AWS, such as S3, FSX, EKS, SQS, SNS, Kinesis, AmazonMQ, DynamoDB, GKE, CloudStorage, PubSub, Filestore, Knowledge of modern More ❯
on open-source technologies. Your future duties and responsibilities • Integrate with the clients Analytics Platform services in AWS. • Lead the data development of scalable, distributed systems using Apache Kafka (Confluent), Tableau, and the ELK stack. • Security Best Practices: Understanding of secure by design principles, including OAuth2.0, OIDC, IAM. • Implement and enforce best practices for REST APIs and message-driven architecture. … Required qualifications to be successful in this role • AWS: Extensive experience with AWS cloud services (e.g., EC2, RDS, IAM, S3, Lambda). • Message-Driven Architecture: Experience with Apache Kafka (Confluent) and event-driven systems. • REST API Development: Expertise in developing secure, scalable, and maintainable APIs. • ELK Stack: Practical experience with Elasticsearch, Logstash, and Kibana for monitoring and log management. • ArchiMate More ❯
our systems are trusted, reliable and available . The technology underpinning these capabilities includes industry leading data and analytics products such as Snowflake, Tableau, DBT, Talend, Collibra, Kafka/Confluent , Astronomer/Airflow , and Kubernetes . This forms part of a longer-term strategic direction to implement Data Mesh, and with it establish shared platform s that enables a connected More ❯
custom data architecture solutions across various industries. Architectural Expertise: Strong expertise in designing and overseeing delivery of data streaming and event-driven architectures, with a focus on Kafka and Confluent platforms. In-depth knowledge in architecting and implementing data lakes and lakehouse platforms, including experience with Databricks and Unity Catalog. Proficiency in conceptualising and applying Data Mesh and Data Fabric More ❯
Salisbury, Wiltshire, South West, United Kingdom Hybrid / WFH Options
Anson Mccade
directly with senior stakeholders to influence architectural decisions and standards You'll bring: Proven experience as a Lead Data Architect or Senior Data Solutions Architect Expertise in Kafka/Confluent , Databricks , Unity Catalog , and modern data lake/lakehouse architectures Strong grasp of cloud data platforms (AWS, Azure, GCP, Snowflake) Understanding of Data Mesh , Data Fabric , and data product-centric More ❯
that have created large-scale data systems and globally distributed platforms that sit at the heart of some of the largest enterprises out there including Uber, Snowflake, AWS, Linkedin, Confluent and many more. Riding off a fresh $35M Series B backed by Craft, Greylock and Addition Ventures, we're now at $68M total funding and looking for rising talent to More ❯
that have created large-scale data systems and globally distributed platforms that sit at the heart of some of the largest enterprises out there including Uber, Snowflake, AWS, Linkedin, Confluent and many more. Riding off a fresh $35M Series B backed by Craft, Greylock and Addition Ventures, we're now at $68M total funding and looking for rising talent to More ❯