1 to 25 of 38 Amazon MSK Jobs in the UK

guidance. Analysing routing, DNS, load balancing, VPN and CDN behaviour to understand how traffic reaches our platform. Helping to build an Amazon MSK proof of concept, covering cluster set-up, private connectivity, security and client access, using Infrastructure as Code. Presenting findings and recommendations from the proof … control, such as customer offices, ISPs and VoIP/telephony systems. Hands-on experience with Apache Kafka or Amazon MSK, ideally including designing or building a new cluster. Solid AWS networking knowledge (VPCs, subnets, route tables, Transit Gateway, security groups, site-to-site VPN), with exposure ...

Caching Amazon RDS (PostgreSQL) and PSQL Amazon DocumentDB (MongoDB compatibility) Amazon ElastiCache (Redis) Messaging & Streaming Amazon MSK (Managed Streaming for Apache Kafka) Security & Compliance AWS IAM AWS KMS AWS Secrets Manager AWS Config AWS CloudTrail Amazon GuardDuty Amazon … high-availability configurations. Strong understanding of secure VPC architecture, ingress/egress control, and network isolation strategies. Experience operating Kafka-based streaming architectures (MSK). Expertise implementing infrastructure as code using Terraform. Experience building and maintaining CI/CD pipelines for containerized workloads. Strong knowledge of IAM design, encryption ...

including target modelling, cutover approach, reconciliation strategy and technical risk management. Design and build the real‐time data architecture using Amazon MSK/Apache Kafka and PySpark Structured Streaming (evaluating Apache Flink where it is the better fit), including event schema governance, exactly‐once semantics and stream … strong command of data modelling and data warehousing concepts. Production experience designing and operating streaming architectures with Apache Kafka or Amazon MSK, including stream processing with Spark Structured Streaming. Hands‐on experience with open table formats, such as Apache Iceberg or Delta Lake, including partitioning, schema evolution ...

support real-time streaming pipelines and event-driven integrations. Integrate data from multiple sources (streaming, batch, APIs) using AWS managed services (e.g., Kinesis, MSK, Lambda, Glue). Data Architecture & Standards Contribute to data modelling, data architecture best practices, and modern patterns (e.g., medallion architecture). Ensure data quality, lineage ...

Time streaming and batch data pipelines. Work with Kafka, Flink or Spark, with Kafka/Flink preferred. Develop AWS-based data solutions using Kinesis, MSK, Lambda and Glue. Implement data governance, lineage, security and quality controls. Support CI/CD using Azure DevOps, GitHub Actions or Jenkins. Use Terraform ...

working with stream technologies, ideally Kafka Experience designing and implementing stream processing applications with Flink Experience working with cloud-based technologies such as AWS (MSK, S3, Lambda, ECS, SNS) Experience with Kubernetes (either self-hosted or on the cloud) Experience with SQL databases Experience working with Docker, container deployment ...

for backend application development. REST APIs, OpenAPI, JSON and microservices architecture. PostgreSQL, Spring Data JPA/Hibernate and Flyway. Apache Kafka, Amazon MSK and event-driven architectures. AWS cloud services, including API Gateway, ECS, CloudWatch, CodePipeline and Secrets Manager. Docker, Docker Compose and containerised applications. Terraform, Infrastructure ...

production. Skills: Java and Spring Boot TypeScript (Vue or React) REST APIs and Kafka event-driven systems AWS (including S3, Lambda, ECS, EKS, MSK) TDD, CI/CD and IaC Observability AI assisted engineering The money is good too – up to £82k plus benefits including remote working. ...

APIGEE, Kong, Mulesoft Strong understand of OpenAPI Specification (OAS) for RESTful APIs DevOps (CICD, Kubernetes, Terraform) Preferred qualifications, capabilities, and skills AWS (ECS, EKS, MSK) Kong API Gateway Golang programming language Lua programming language ...

proficiency in Python for automation and integration Familiarity with infrastructure as code, using Terraform or Ansible Deep understanding of AWS analytics technologies including EMR, MSK, Athena, Redshift, Glue and MWAA Experience with CI/CD and observability tools such as Jenkins, ArgoCD, Prometheus, Grafana and OpenTelemetry Strong problem‐solving ...

deployment and supporting them in production. Skills: Java and Spring Boot REST APIs and Kafka event-driven systems AWS (including S3, Lambda, ECS, EKS, MSK) TDD, CI/CD and IaC Observability AI assisted engineering The money is good too – up to £100k plus benefits including remote working. ...

deployment and supporting them in production. Skills: Java and Spring Boot REST APIs and Kafka event-driven systems AWS (including S3, Lambda, ECS, EKS, MSK) TDD, CI/CD and IaC Observability AI assisted engineering The money is good too – up to £100k plus benefits including remote working. ...

firm's partner status (competency badges, certified-headcount targets, co-sell with partner account teams) Streaming and event-driven architecture in production (Kafka/MSK, Kinesis, Structured Streaming) Data products, mesh or federated ownership models applied on a real programme, not just in theory ML and AI platform work ...

Bonus Points Hardening infrastructure for high-compliance or security-sensitive environments (HIPAA, SOC 2, PCI). Running managed data services in AWS (RDS, Aurora, MSK, DynamoDB) at scale, including migrations and major version upgrades. Scaling consumer platforms with millions of concurrent users. Certifications such as AWS Certified Solutions Architect ...

cryptocurrency technology ecosystem Experience working with different blockchain technologies is a plus Experience with a SaaS or FinTech company Technologies we use: AWS Services: MSK, EC2, VPC, IAM, S3, SQS, Managed Flink, EKS Data Lakehouse: Kafka, Flink, Spark, Databricks, DBT, Debezium #J-18808-Ljbffr ...

e.g., Python or Java) for building data workflows and automation. Familiarity with AWS services such as S3, Glue, Lambda, EMR, or streaming tools like MSK/Kinesis. Experience with basic data governance, data quality checks, and security practices (e.g., RBAC, encryption, handling PII). Equal Opportunity We believe talent ...

work closely with our Security Engineer and tech leads. Responsibilities Own our infrastructure at scale: the AWS estate today (ECS Fargate, Aurora, ElastiCache, MSK, OpenSearch, Lambda, KMS) and the AWS CDK to Terraform migration. Keep it reliable, observable, and cost-aware. Build out the deployment pipeline as we consolidate … BYOC/self-hosted), or a platform like Nuon, Replicated, or Omnistrate. Multi-cloud (GCP or Azure) IaC, and exposure to Temporal, Kafka/MSK, ClickHouse, or OpenSearch. Our stack Cloud & infra: AWS (ECS Fargate, Aurora Postgres, ElastiCache, MSK, OpenSearch, Lambda, S3, KMS, CloudFront, WAF), GCP, Cloudflare (Workers ...

hands-on AWS data experience: Glue, Lambda, S3, Redshift and EMR Advanced Python, PySpark and SQL Production experience with Kafka or Amazon MSK, including Spark Structured Streaming Hands-on experience with Apache Iceberg or Delta Lake Strong data modelling and lakehouse design (bronze, silver, gold) Terraform ...

native, Java, Spring, typescript, microservice architecture, DynamoDB, lambdas, ECS containers and robust knowledge of AWS cloud infrastructure (API Gateway, AWS SAM, terraform, Kinesis/MSK/SQS/S3/EKS/ECS Product focus: we want to build a quality product therefore as an engineering leader you should ...

hands-on AWS data experience: Glue, Lambda, S3, Redshift and EMR Advanced Python, PySpark and SQL Production experience with Kafka or Amazon MSK, including Spark Structured Streaming Hands-on experience with Apache Iceberg or Delta Lake Strong data modelling and lakehouse design (bronze, silver, gold) Terraform ...

Databricks and/or AWS certifications at Associate or Professional level. Streaming Architectures: Practical experience with real-time or event-driven streaming (Kafka/MSK, Kinesis, Spark Structured Streaming). Advanced Data Architectures: Exposure to Data Mesh concepts, data products, or federated data governance models. AI/ML Infrastructure ...

Databricks and/or AWS certifications at Associate or Professional level. Streaming Architectures: Practical experience with real-time or event-driven streaming (Kafka/MSK, Kinesis, Spark Structured Streaming). Advanced Data Architectures: Exposure to Data Mesh concepts, data products, or federated data governance models. AI/ML Infrastructure ...

patterns . Familiarity with AI/ML workflows and their data requirements. Experience with API specifications and data integrations acrossETL and streaming services ( Glue, MSK, Kinesis, Kafka ) Familiarity with AI developer tools like Cursor and GitHub Copilot and desire to use them to 10x your throughput. Collaborative approach ...

design, build and evolve integration solutions and cloud-native platforms. You will work hands-on with AWS services such as ECS Fargate, SQS, MSK, S3, IAM, and more, contributing to resilient software and infrastructure. Emphasis on AI tooling and modern development practices runs through the role. Required ...

Develop and support AWS serverless solutions (e.g. Lambda, API Gateway, Step Functions, DynamoDB, S3).* Implement event-driven architectures using Kafka (preferably on AWS MSK) for high-throughput, near real-time processing.* Work with Docker and Kubernetes to build, deploy and run containerised services.* Contribute to the design … development.* Proven experience building solutions on AWS, ideally including serverless services (Lambda, API Gateway, DynamoDB, etc.).* Hands-on experience with Kafka (preferably AWS MSK) for messaging/stream processing.* Experience with Docker and Kubernetes for container orchestration.* Good understanding of DevOps concepts, with practical experience using ...