1 to 25 of 32 Amazon MSK Jobs in the UK

clearance, we will support you to apply assuming you have lived and worked in the UK for a minimum of 5 years. We are seeking a highly skilled AWS MSK and Kubernetes expert to architect, deploy, and manage streaming data pipelines and containerized applications on AWS. The ideal candidate will have deep knowledge of AWS MSK for Kafka … and fault-tolerant systems to handle real-time data processing and microservices in cloud-native environments. Duties and Responsibilities Design, deploy, and manage AWS Managed Streaming for Apache Kafka (MSK) clusters. Optimize MSK configurations for low-latency, high-throughput streaming, ensuring high availability Implement Kafka security using SSL encryption, IAM roles, VPC networking, and authentication mechanisms Automate the … creation, monitoring, scaling, and maintenance of Kafka topics, producers, and consumers Integrate MSK with other AWS services (e.g., Lambda, S3, Elastic Search). Implement best practices for data replication and fault tolerance in MSK environments Troubleshoot deployment issues Deploy, monitor, and scale Kubernetes-based applications across AWS. Ensure service discovery, load balancing, auto-scaling, and failover for applications More ❯

looking for candidates who have: Good understanding of deploying Infrastructure as Code using Terraform and an understanding of AWS services and technologies such as IAM, S3, EC2, EKS, RDS, MSK, and Lambda. Experience running, maintaining, and troubleshooting tooling to automate common development processes, reducing the manual effort required to execute tasks. Prior success implementing infrastructure as code including pipelines More ❯

Hands-on experience with Docker and containerized development Familiarity with event-driven architectures and message brokers like Kafka . Experience integrating with AWS services such as Lambda , S3 , DynamoDB , MSK , and API Gateway . Experience with backend development using Java (Spring Boot) or Python is preferred. Innovation: Interest in new technology and ability to work with early-stage ideas. More ❯

Hands-on experience with Docker and containerized development Familiarity with event-driven architectures and message brokers like Kafka . Experience integrating with AWS services such as Lambda , S3 , DynamoDB , MSK , and API Gateway . Experience with backend development using Java (Spring Boot) or Python is preferred. Innovation: Interest in new technology and ability to work with early-stage ideas. More ❯

or lead engineer, you’ll be hands-on in both build and support, working across security-first infrastructure and enabling robust DevSecOps practices. Essential Skills: Strong experience with AWS MSK (Kafka) and secure multi-account AWS environments Proven production experience with Kubernetes, Docker, Helm Proficient in Terraform, CI/CD Pipelines (Drone/GitLab) Excellent understanding of Kafka internals More ❯

or lead engineer, you’ll be hands-on in both build and support, working across security-first infrastructure and enabling robust DevSecOps practices. Essential Skills: Strong experience with AWS MSK (Kafka) and secure multi-account AWS environments Proven production experience with Kubernetes, Docker, Helm Proficient in Terraform, CI/CD Pipelines (Drone/GitLab) Excellent understanding of Kafka internals More ❯

programming, network protocols. Advanced knowledge of Python and related frameworks (FastAPI, NumPy, Pandas, Pydantic) including multithreading and parallel design principles. Understanding of AWS, including knowledge of Cognito, Pinpoint, IoT, MSK and other services. Deep understanding of user-centered design principles, design thinking methodologies, and usability best practices. Proficient in using and maintaining Docker containers. Strong understanding of RESTful API … Google Test, etc. Nice to Haves: Experience with Azure services for managing GPT pipelines and multi-cloud infrastructure. Familiarity with big data technologies such as Apache Spark, Kafka, and MSK for large-scale data processing. Experience with boost libraries (asio, beast). Advanced experience in cost optimization strategies for cloud infrastructure and database performance tuning. Technical Acumen: Advanced knowledge More ❯

Hands-on experience with Docker and containerized development Familiarity with event-driven architectures and message brokers like Kafka . Experience integrating with AWS services such as Lambda , S3 , DynamoDB , MSK , and API Gateway . Experience with backend development using Java (Spring Boot) or Python is preferred. Innovation: Interest in new technology and ability to work with early-stage ideas. More ❯

party services. Ability to read and review code, paired programming, and debugging code related performance issues, SQL tuning, etc. Experience with AWS services such as S3, RDS, Aurora, NoSQL, MSK (Kafka). Experience with batch processing/ETL using Glue Jobs, AWS Lambda, and Step functions. Experience with designing bespoke & tailored front-end solutions (GUI based) using open source More ❯

performance, resilience, and maintainability Technical Stack: Backend: .NET 8, AWS Lambda, ECS, EKS Databases: SQL/NoSQL (DynamoDB, Aurora, DocumentDB MongoDB experience a bonus) Event-Driven Systems: Kafka, AWS MSK, EventBridge, SNS/SQS DevOps & Infrastructure: Terraform, GitHub Actions, Docker Frontend: React What Were Looking For: Proven experience leading development teams in an agile environment Hands-on expertise in More ❯

Fargate Provisioning: Using AWS Control Tower to enable account provisioning and building paved roads for quick, consistent deployment Event-Driven: Data sharing through an event-driven system powered by MSK Observability: Datadog for logging and monitoring Databases: MongoDB and AWS Relational Databases Automation and CICD: Automated deployments via Jenkins pipelines and Github Actions, enabling multiple releases daily Within More ❯

continuous improvement. Experience working with microservices and distributed systems at scale Have experience with working on cross-team projects Have AWS experience, we use EKS, RDS, S3, Cloudfront and MSK excessively Have an understanding of SLIs, SLOs & SLAs Knowledge of platform and ops concepts such as networking and Linux administration Experience with monitoring tools: we use Datadog, Grafana, ELK More ❯

Observability, CI/CD Focus: Infrastructure scalability, automation, performance, and reliability What You’ll Be Doing: Designing and scaling cloud-native infrastructure with a strong emphasis on AWS (EKS, MSK, DynamoDB, RDS) Driving automation with Terraform/OpenTofu , scripting (Python, PowerShell), and GitLab CI Enabling observability across services using Prometheus , OpenTelemetry , and custom tooling Implementing secure deployment practices, performance More ❯

financial district , with remote work available for the remaining three days. Essential Skills and Experience Strong expertise in AWS cloud services , with practical experience or theoretical knowledge of AWS MSK (Managed Streaming for Apache Kafka) Deep understanding of Kafka (Apache Kafka, Confluent Kafka) and event-driven microservices architecture Proficiency in Infrastructure as Code tools (Terraform, AWS CloudFormation) Experience with … practices , including IAM, encryption, and role-based access control At least 5 plus years of experience in cloud engineering, DevOps, or backend platform development Hands-on experience with AWS MSK is ideal, but candidates with strong Kafka expertise and a willingness to upskill in AWS MSK will be considered Multi-cloud experience (Azure Event Hubs, Google Pub/… career progression in a high-growth consultancy Hybrid flexibility – work remotely three days a week, with two days on-site in London Build expertise in event-driven architectures, AWS MSK, and AI-powered data streaming This is an opportunity to work on a truly groundbreaking project, delivering high-performance, cloud-native platforms that will redefine enterprise AI adoption. Immediate More ❯

Join to apply for the AWS Data Engineer role at IBM 4 days ago Be among the first 25 applicants Join to apply for the AWS Data Engineer role at IBM Get AI-powered advice on this job and more More ❯

Required Technical Skills/Experience: Kubernetes cluster management, including experience withKustomizeand/or Helm AWS infrastructure management and configuration, including but not limited to EKS, Aurora RDS, IAM, S3, MSK GitHub Actionsor similar CI tool Observability (APM, Logging, Tracing, Synthetics) Branching, merging, andother Gitflowconcepts Strong understanding of relational databases, messaging(Kafka, SQS) Knowledge of Java/Kotlina plus Qualifications More ❯

building paved roads to help teams get their apps up and running quickly in a consistent manner Event-Driven: We share data through an event-driven system powered by MSK Observability: Datadog is used for comprehensive logging and monitoring Databases: We use a combination of MongoDB and AWS Relational Databases Automation and CICD: Deployments are highly automated using Jenkins More ❯

Scala applications. Knowledge of data structures, algorithms, concurrency, and multi-threading. Strong SQL skills and experience with relational databases like Postgres. Familiarity with AWS services such as S3, Aurora, MSK, IAM. Understanding of cloud networking concepts. Experience working in Agile environments, including Scrum or Kanban. Ability to collaborate in scaled agile teams and participate in ceremonies. Some experience with More ❯

role is pivotal in shaping how our product integrates and interacts with external systems, partners, and platforms. Our Tech Stack: Apache Airflow Python Django AWS (S3, RDS withPostgresql, ElastiCache, MSK, EC2, ECS, Fargate, Lamda etc.) Snowflake Terraform CircleCI Your mission Design and develop data pipelines, orchestrating key activities such as data ingestion, extraction andtransformation, task automation and serving of More ❯

PHP 8+ (Laravel/Symfony) Proficiency in JavaScript/TypeScript, NestJS and ReactJS Experience building platforms using event-based architecture and CQRS Familiarity with AWS Services such as Aurora, MSK Kafka, ECS, and EMR Experience writing automated unit and integration tests Excellent practical experience with Docker Strong understanding of SOLID principles and design patterns Hands-on experience with one More ❯

PHP 8+ (Laravel/Symfony) Proficiency in JavaScript/TypeScript, NestJS and ReactJS Experience building platforms using event-based architecture and CQRS Familiarity with AWS Services such as Aurora, MSK Kafka, ECS, and EMR Experience writing automated unit and integration tests Excellent practical experience with Docker Strong understanding of SOLID principles and design patterns Hands-on experience with one More ❯

approaches and modern data architecture patterns . Familiarity with AI/ML workflows and their data requirements. Experience with API specifications and data integrations acrossETL and streaming services ( Glue, MSK, Kinesis, Kafka ) Familiarity with AI developer tools like Cursor and GitHub Copilot and desire to use them to 10x your throughput. Collaborative approach and excellent communication skills. Strong problem More ❯

experience as a Developer Strong knowledge of modern PHP 8+ (Laravel/Symfony) Experience building platforms using event-based architecture and CQRS Familiarity with AWS Services such as Aurora, MSK Kafka, ECS, and EMR Experience writing automated unit and integration tests Excellent practical experience with Docker Strong understanding of SOLID principles and design patterns Hands-on experience with one More ❯

experience as a Developer Strong knowledge of modern PHP 8+ (Laravel/Symfony) Experience building platforms using event-based architecture and CQRS Familiarity with AWS Services such as Aurora, MSK Kafka, ECS, and EMR Experience writing automated unit and integration tests Excellent practical experience with Docker Strong understanding of SOLID principles and design patterns Hands-on experience with one More ❯

environment, we deploy containerised workloads to AWS through managed Kubernetes and scale on-demand to satisfy burstable workloads. Other managed services we use in AWS include EMR, RDS, OpenSearch, MSK and bespoke EC2 solutions. All infrastructure is managed through Terraform, our source code is in GitHub and automation through GH actions. Responsibilities Design, implement, and manage scalable cloud infrastructure More ❯