19 of 19 Amazon MSK Jobs in the UK

clearance, we will support you to apply assuming you have lived and worked in the UK for a minimum of 5 years. We are seeking a highly skilled AWS MSK and Kubernetes expert to architect, deploy, and manage streaming data pipelines and containerized applications on AWS. The ideal candidate will have deep knowledge of AWS MSK for Kafka … and fault-tolerant systems to handle real-time data processing and microservices in cloud-native environments. Duties and Responsibilities Design, deploy, and manage AWS Managed Streaming for Apache Kafka (MSK) clusters. Optimize MSK configurations for low-latency, high-throughput streaming, ensuring high availability Implement Kafka security using SSL encryption, IAM roles, VPC networking, and authentication mechanisms Automate the … creation, monitoring, scaling, and maintenance of Kafka topics, producers, and consumers Integrate MSK with other AWS services (e.g., Lambda, S3, Elastic Search). Implement best practices for data replication and fault tolerance in MSK environments Troubleshoot deployment issues Deploy, monitor, and scale Kubernetes-based applications across AWS. Ensure service discovery, load balancing, auto-scaling, and failover for applications More ❯

or lead engineer, you’ll be hands-on in both build and support, working across security-first infrastructure and enabling robust DevSecOps practices. Essential Skills: Strong experience with AWS MSK (Kafka) and secure multi-account AWS environments Proven production experience with Kubernetes, Docker, Helm Proficient in Terraform, CI/CD Pipelines (Drone/GitLab) Excellent understanding of Kafka internals More ❯

or lead engineer, you’ll be hands-on in both build and support, working across security-first infrastructure and enabling robust DevSecOps practices. Essential Skills: Strong experience with AWS MSK (Kafka) and secure multi-account AWS environments Proven production experience with Kubernetes, Docker, Helm Proficient in Terraform, CI/CD Pipelines (Drone/GitLab) Excellent understanding of Kafka internals More ❯

programming, network protocols. Advanced knowledge of Python and related frameworks (FastAPI, NumPy, Pandas, Pydantic) including multithreading and parallel design principles. Understanding of AWS, including knowledge of Cognito, Pinpoint, IoT, MSK and other services. Deep understanding of user-centered design principles, design thinking methodologies, and usability best practices. Proficient in using and maintaining Docker containers. Strong understanding of RESTful API … Google Test, etc. Nice to Haves: Experience with Azure services for managing GPT pipelines and multi-cloud infrastructure. Familiarity with big data technologies such as Apache Spark, Kafka, and MSK for large-scale data processing. Experience with boost libraries (asio, beast). Advanced experience in cost optimization strategies for cloud infrastructure and database performance tuning. Technical Acumen: Advanced knowledge More ❯

Hands-on experience with Docker and containerized development Familiarity with event-driven architectures and message brokers like Kafka . Experience integrating with AWS services such as Lambda , S3 , DynamoDB , MSK , and API Gateway . Experience with backend development using Java (Spring Boot) or Python is preferred. Innovation: Interest in new technology and ability to work with early-stage ideas. More ❯

IaC, Observability, CI/CD Focus: Infrastructure scalability, automation, performance, and reliability What You’ll Be Doing: Designing and scaling cloud- infrastructure with a strong emphasis on AWS (EKS, MSK, DynamoDB, RDS) Driving automation with Terraform/OpenTofu , scripting (Python, PowerShell), and GitLab CI Enabling observability across services using Prometheus , OpenTelemetry , and custom tooling Implementing secure deployment practices, performance More ❯

party services. Ability to read and review code, paired programming, and debugging code related performance issues, SQL tuning, etc. Experience with AWS services such as S3, RDS, Aurora, NoSQL, MSK (Kafka). Experience with batch processing/ETL using Glue Jobs, AWS Lambda, and Step functions. Experience with designing bespoke & tailored front-end solutions (GUI based) using open source More ❯

continuous improvement. Experience working with microservices and distributed systems at scale Have experience with working on cross-team projects Have AWS experience, we use EKS, RDS, S3, Cloudfront and MSK excessively Have an understanding of SLIs, SLOs & SLAs Knowledge of platform and ops concepts such as networking and Linux administration Experience with monitoring tools: we use Datadog, Grafana, ELK More ❯

in Java, Scala, or Python. Familiarity with Kafka Connect, Schema Registry, and common integrations (DBs, Elasticsearch, cloud). Experience with Docker, Kubernetes, Terraform, and Helm. Cloud Kafka experience (AWS MSK, Confluent, Azure Event Hubs). Skilled with monitoring tools (Prometheus, Grafana, Datadog, etc.). #J-18808-Ljbffr More ❯

Fargate Provisioning: Using AWS Control Tower to enable account provisioning and building paved roads for quick, consistent deployment Event-Driven: Data sharing through an event-driven system powered by MSK Observability: Datadog for logging and monitoring Databases: MongoDB and AWS Relational Databases Automation and CICD: Automated deployments via Jenkins pipelines and Github Actions, enabling multiple releases daily Within More ❯

building paved roads to help teams get their apps up and running quickly in a consistent manner Event-Driven: We share data through an event-driven system powered by MSK Observability: Datadog is used for comprehensive logging and monitoring Databases: We use a combination of MongoDB and AWS Relational Databases Automation and CICD: Deployments are highly automated using Jenkins More ❯

Good understanding of core Java (at least JDK 1.8) & prefer to have some experience with Spring Boot. Good to have experience using AWS cloud services (e.g., EC2, S3, Lambda, MSK, ECS, EMR, RDS, Athena etc. ) Experience working with Maven, Jenkins, Git etc. Understanding of database concepts and working knowledge with any of the vendors (Preferably Oracle) with at least More ❯

Join to apply for the Azure data Engineer role at IBM 3 days ago Be among the first 25 applicants Join to apply for the Azure data Engineer role at IBM Get AI-powered advice on this job and more More ❯

and communication skills PREFERRED QUALIFICATIONS Experience with development and design of distributed systems Experience in financial services specifically corporate cash management desirable Experience with AWS services - Amazon MSK/Apache kafka, ECS, S3, IAM, AWS XRay Basic knowledge of data science and machine learning is preferable but not essential ABOUT GOLDMAN SACHS At Goldman Sachs, we commit More ❯

approaches and modern data architecture patterns . Familiarity with AI/ML workflows and their data requirements. Experience with API specifications and data integrations acrossETL and streaming services ( Glue, MSK, Kinesis, Kafka ) Familiarity with AI developer tools like Cursor and GitHub Copilot and desire to use them to 10x your throughput. Collaborative approach and excellent communication skills. Strong problem More ❯

experience as a Developer Strong knowledge of modern PHP 8+ (Laravel/Symfony) Experience building platforms using event-based architecture and CQRS Familiarity with AWS Services such as Aurora, MSK Kafka, ECS, and EMR Experience writing automated unit and integration tests Excellent practical experience with Docker Strong understanding of SOLID principles and design patterns Hands-on experience with one More ❯

reinforcement learning) and their applications in healthcare. Previous experience of training (fine turn) large language models, hands on experience with DeepSpeed Extensive experience with AWS services (e.g., SageMaker, Bedrock, MSK, EKS, OpenSearch). Proven record of shipping production level code with best software engineering practice Experience with containerization technologies, CI/CD, front and backend of web applications Excellent More ❯

you to be an expert user of AWS integration technologies with hands-on coding & development skills. 5+ years, and most recent experience, with AWS Tool-sets. API Management: Amazon API Gateway AWS App Sync … Event Bus/Messaging: Amazon Eventbridge Amazon SQS (Simple Queue Service) Amazon SNS (Simple Notification Service) Amazon MQ Amazon MSK (Kafka based messaging) Low Code/No Code/Orchestration AWS Step Function Amplify Studio AWS Appflow AWS SWF (Simple Workflow) AWS Lambda Security AWS IAM Cloudtrail AWS Secrets More ❯

ELT tooling including DBT and Airflow. Experience with CI/CD and infrastructure-as-code, within AWS cloud. Also desirable - familiarity with AWS' data tools such as EMR, MWAA, MSK You are Someone who loves collaboration - our teams are cross functional and you'll be working with other engineers, team leads and product managers to deliver great outcomes together. More ❯