1 to 25 of 28 Amazon MSK Jobs in England

clearance, we will support you to apply assuming you have lived and worked in the UK for a minimum of 5 years. We are seeking a highly skilled AWS MSK and Kubernetes expert to architect, deploy, and manage streaming data pipelines and containerized applications on AWS. The ideal candidate will have deep knowledge of AWS MSK for Kafka … and fault-tolerant systems to handle real-time data processing and microservices in cloud-native environments. Duties and Responsibilities Design, deploy, and manage AWS Managed Streaming for Apache Kafka (MSK) clusters. Optimize MSK configurations for low-latency, high-throughput streaming, ensuring high availability Implement Kafka security using SSL encryption, IAM roles, VPC networking, and authentication mechanisms Automate the … creation, monitoring, scaling, and maintenance of Kafka topics, producers, and consumers Integrate MSK with other AWS services (e.g., Lambda, S3, Elastic Search). Implement best practices for data replication and fault tolerance in MSK environments Troubleshoot deployment issues Deploy, monitor, and scale Kubernetes-based applications across AWS. Ensure service discovery, load balancing, auto-scaling, and failover for applications More ❯

frequency trading. ? What You'll Be Doing: Owning and scaling cloud infrastructure in high-performance computing environments Deploying with Terraform and optimising AWS services (IAM, EC2, ECS, EKS, S3, MSK, Lambda, etc.) Building and managing CI/CD pipelines with GitLab and GitHub Actions Containerising with Docker and applying best practices for security and performance Monitoring and alerting using More ❯

frequency trading. ? What You'll Be Doing: Owning and scaling cloud infrastructure in high-performance computing environments Deploying with Terraform and optimising AWS services (IAM, EC2, ECS, EKS, S3, MSK, Lambda, etc.) Building and managing CI/CD pipelines with GitLab and GitHub Actions Containerising with Docker and applying best practices for security and performance Monitoring and alerting using More ❯

frequency trading. ? What You'll Be Doing: Owning and scaling cloud infrastructure in high-performance computing environments Deploying with Terraform and optimising AWS services (IAM, EC2, ECS, EKS, S3, MSK, Lambda, etc.) Building and managing CI/CD pipelines with GitLab and GitHub Actions Containerising with Docker and applying best practices for security and performance Monitoring and alerting using More ❯

frequency trading. ? What You'll Be Doing: Owning and scaling cloud infrastructure in high-performance computing environments Deploying with Terraform and optimising AWS services (IAM, EC2, ECS, EKS, S3, MSK, Lambda, etc.) Building and managing CI/CD pipelines with GitLab and GitHub Actions Containerising with Docker and applying best practices for security and performance Monitoring and alerting using More ❯

or lead engineer, you’ll be hands-on in both build and support, working across security-first infrastructure and enabling robust DevSecOps practices. Essential Skills: Strong experience with AWS MSK (Kafka) and secure multi-account AWS environments Proven production experience with Kubernetes, Docker, Helm Proficient in Terraform, CI/CD Pipelines (Drone/GitLab) Excellent understanding of Kafka internals More ❯

or lead engineer, you’ll be hands-on in both build and support, working across security-first infrastructure and enabling robust DevSecOps practices. Essential Skills: Strong experience with AWS MSK (Kafka) and secure multi-account AWS environments Proven production experience with Kubernetes, Docker, Helm Proficient in Terraform, CI/CD Pipelines (Drone/GitLab) Excellent understanding of Kafka internals More ❯

programming, network protocols. Advanced knowledge of Python and related frameworks (FastAPI, NumPy, Pandas, Pydantic) including multithreading and parallel design principles. Understanding of AWS, including knowledge of Cognito, Pinpoint, IoT, MSK and other services. Deep understanding of user-centered design principles, design thinking methodologies, and usability best practices. Proficient in using and maintaining Docker containers. Strong understanding of RESTful API … Google Test, etc. Nice to Haves: Experience with Azure services for managing GPT pipelines and multi-cloud infrastructure. Familiarity with big data technologies such as Apache Spark, Kafka, and MSK for large-scale data processing. Experience with boost libraries (asio, beast). Advanced experience in cost optimization strategies for cloud infrastructure and database performance tuning. Technical Acumen: Advanced knowledge More ❯

Hands-on experience with Docker and containerized development Familiarity with event-driven architectures and message brokers like Kafka . Experience integrating with AWS services such as Lambda , S3 , DynamoDB , MSK , and API Gateway . Experience with backend development using Java (Spring Boot) or Python is preferred. Innovation: Interest in new technology and ability to work with early-stage ideas. More ❯

IaC, Observability, CI/CD Focus: Infrastructure scalability, automation, performance, and reliability What You’ll Be Doing: Designing and scaling cloud- infrastructure with a strong emphasis on AWS (EKS, MSK, DynamoDB, RDS) Driving automation with Terraform/OpenTofu , scripting (Python, PowerShell), and GitLab CI Enabling observability across services using Prometheus , OpenTelemetry , and custom tooling Implementing secure deployment practices, performance More ❯

party services. Ability to read and review code, paired programming, and debugging code related performance issues, SQL tuning, etc. Experience with AWS services such as S3, RDS, Aurora, NoSQL, MSK (Kafka). Experience with batch processing/ETL using Glue Jobs, AWS Lambda, and Step functions. Experience with designing bespoke & tailored front-end solutions (GUI based) using open source More ❯

performance, resilience, and maintainability Technical Stack: Backend: .NET 8, AWS Lambda, ECS, EKS Databases: SQL/NoSQL (DynamoDB, Aurora, DocumentDB MongoDB experience a bonus) Event-Driven Systems: Kafka, AWS MSK, EventBridge, SNS/SQS DevOps & Infrastructure: Terraform, GitHub Actions, Docker Frontend: React What Were Looking For: Proven experience leading development teams in an agile environment Hands-on expertise in More ❯

continuous improvement. Experience working with microservices and distributed systems at scale Have experience with working on cross-team projects Have AWS experience, we use EKS, RDS, S3, Cloudfront and MSK excessively Have an understanding of SLIs, SLOs & SLAs Knowledge of platform and ops concepts such as networking and Linux administration Experience with monitoring tools: we use Datadog, Grafana, ELK More ❯

in Java, Scala, or Python. Familiarity with Kafka Connect, Schema Registry, and common integrations (DBs, Elasticsearch, cloud). Experience with Docker, Kubernetes, Terraform, and Helm. Cloud Kafka experience (AWS MSK, Confluent, Azure Event Hubs). Skilled with monitoring tools (Prometheus, Grafana, Datadog, etc.). #J-18808-Ljbffr More ❯

Hands-on experience with Docker and containerized development Familiarity with event-driven architectures and message brokers like Kafka . Experience integrating with AWS services such as Lambda , S3 , DynamoDB , MSK , and API Gateway . Experience with backend development using Java (Spring Boot) or Python is preferred. Innovation: Interest in new technology and ability to work with early-stage ideas. More ❯

Fargate Provisioning: Using AWS Control Tower to enable account provisioning and building paved roads for quick, consistent deployment Event-Driven: Data sharing through an event-driven system powered by MSK Observability: Datadog for logging and monitoring Databases: MongoDB and AWS Relational Databases Automation and CICD: Automated deployments via Jenkins pipelines and Github Actions, enabling multiple releases daily Within More ❯

building paved roads to help teams get their apps up and running quickly in a consistent manner Event-Driven: We share data through an event-driven system powered by MSK Observability: Datadog is used for comprehensive logging and monitoring Databases: We use a combination of MongoDB and AWS Relational Databases Automation and CICD: Deployments are highly automated using Jenkins More ❯

Join to apply for the Azure data Engineer role at IBM 2 days ago Be among the first 25 applicants Join to apply for the Azure data Engineer role at IBM Introduction In this role, you’ll work in one More ❯

Join to apply for the Azure data Engineer role at IBM Continue with Google Continue with Google Join to apply for the Azure data Engineer role at IBM Introduction In this role, you’ll work in one of our IBM More ❯

Join to apply for the Azure data Engineer role at IBM 3 days ago Be among the first 25 applicants Join to apply for the Azure data Engineer role at IBM Introduction In this role, you’ll work in one More ❯

Join to apply for the Azure data Engineer role at IBM 3 days ago Be among the first 25 applicants Join to apply for the Azure data Engineer role at IBM Get AI-powered advice on this job and more More ❯

and communication skills PREFERRED QUALIFICATIONS Experience with development and design of distributed systems Experience in financial services specifically corporate cash management desirable Experience with AWS services - Amazon MSK/Apache kafka, ECS, S3, IAM, AWS XRay Basic knowledge of data science and machine learning is preferable but not essential ABOUT GOLDMAN SACHS At Goldman Sachs, we commit More ❯

approaches and modern data architecture patterns . Familiarity with AI/ML workflows and their data requirements. Experience with API specifications and data integrations acrossETL and streaming services ( Glue, MSK, Kinesis, Kafka ) Familiarity with AI developer tools like Cursor and GitHub Copilot and desire to use them to 10x your throughput. Collaborative approach and excellent communication skills. Strong problem More ❯

approaches and modern data architecture patterns . Familiarity with AI/ML workflows and their data requirements. Experience with API specifications and data integrations acrossETL and streaming services ( Glue, MSK, Kinesis, Kafka ) Familiarity with AI developer tools like Cursor and GitHub Copilot and desire to use them to 10x your throughput. Collaborative approach and excellent communication skills. Strong problem More ❯

experience as a Developer Strong knowledge of modern PHP 8+ (Laravel/Symfony) Experience building platforms using event-based architecture and CQRS Familiarity with AWS Services such as Aurora, MSK Kafka, ECS, and EMR Experience writing automated unit and integration tests Excellent practical experience with Docker Strong understanding of SOLID principles and design patterns Hands-on experience with one More ❯