1 to 25 of 29 Permanent Amazon MSK Jobs in England

Caching Amazon RDS (PostgreSQL) and PSQL Amazon DocumentDB (MongoDB compatibility) Amazon ElastiCache (Redis) Messaging & Streaming Amazon MSK (Managed Streaming for Apache Kafka) Security & Compliance AWS IAM AWS KMS AWS Secrets Manager AWS Config AWS CloudTrail Amazon GuardDuty Amazon … high-availability configurations. Strong understanding of secure VPC architecture, ingress/egress control, and network isolation strategies. Experience operating Kafka-based streaming architectures (MSK). Expertise implementing infrastructure as code using Terraform. Experience building and maintaining CI/CD pipelines for containerized workloads. Strong knowledge of IAM design, encryption ...

including target modelling, cutover approach, reconciliation strategy and technical risk management. Design and build the real‐time data architecture using Amazon MSK/Apache Kafka and PySpark Structured Streaming (evaluating Apache Flink where it is the better fit), including event schema governance, exactly‐once semantics and stream … strong command of data modelling and data warehousing concepts. Production experience designing and operating streaming architectures with Apache Kafka or Amazon MSK, including stream processing with Spark Structured Streaming. Hands‐on experience with open table formats, such as Apache Iceberg or Delta Lake, including partitioning, schema evolution ...

working with stream technologies, ideally Kafka Experience designing and implementing stream processing applications with Flink Experience working with cloud‐based technologies such as AWS (MSK, S3, Lambda, ECS, SNS) Experience with Kubernetes (either self‐hosted or on the cloud) Experience with SQL databases Experience working with Docker, container deployment ...

support real-time streaming pipelines and event-driven integrations. Integrate data from multiple sources (streaming, batch, APIs) using AWS managed services (e.g., Kinesis, MSK, Lambda, Glue). Data Architecture & Standards Contribute to data modelling, data architecture best practices, and modern patterns (e.g., medallion architecture). Ensure data quality, lineage ...

proficiency in Python for automation and integration Familiarity with infrastructure as code, using Terraform or Ansible Deep understanding of AWS analytics technologies including EMR, MSK, Athena, Redshift, Glue and MWAA Experience with CI/CD and observability tools such as Jenkins, ArgoCD, Prometheus, Grafana and OpenTelemetry Strong problem‐solving ...

firm's partner status (competency badges, certified-headcount targets, co-sell with partner account teams) Streaming and event-driven architecture in production (Kafka/MSK, Kinesis, Structured Streaming) Data products, mesh or federated ownership models applied on a real programme, not just in theory ML and AI platform work ...

Bonus Points Hardening infrastructure for high-compliance or security-sensitive environments (HIPAA, SOC 2, PCI). Running managed data services in AWS (RDS, Aurora, MSK, DynamoDB) at scale, including migrations and major version upgrades. Scaling consumer platforms with millions of concurrent users. Certifications such as AWS Certified Solutions Architect ...

cryptocurrency technology ecosystem Experience working with different blockchain technologies is a plus Experience with a SaaS or FinTech company Technologies we use: AWS Services: MSK, EC2, VPC, IAM, S3, SQS, Managed Flink, EKS Data Lakehouse: Kafka, Flink, Spark, Databricks, DBT, Debezium #J-18808-Ljbffr ...

e.g., Python or Java) for building data workflows and automation. Familiarity with AWS services such as S3, Glue, Lambda, EMR, or streaming tools like MSK/Kinesis. Experience with basic data governance, data quality checks, and security practices (e.g., RBAC, encryption, handling PII). Equal Opportunity We believe talent ...

hands-on AWS data experience: Glue, Lambda, S3, Redshift and EMR Advanced Python, PySpark and SQL Production experience with Kafka or Amazon MSK, including Spark Structured Streaming Hands-on experience with Apache Iceberg or Delta Lake Strong data modelling and lakehouse design (bronze, silver, gold) Terraform ...

native, Java, Spring, typescript, microservice architecture, DynamoDB, lambdas, ECS containers and robust knowledge of AWS cloud infrastructure (API Gateway, AWS SAM, terraform, Kinesis/MSK/SQS/S3/EKS/ECS Product focus: we want to build a quality product therefore as an engineering leader you should ...

hands-on AWS data experience: Glue, Lambda, S3, Redshift and EMR Advanced Python, PySpark and SQL Production experience with Kafka or Amazon MSK, including Spark Structured Streaming Hands-on experience with Apache Iceberg or Delta Lake Strong data modelling and lakehouse design (bronze, silver, gold) Terraform ...

Databricks and/or AWS certifications at Associate or Professional level. Streaming Architectures: Practical experience with real-time or event-driven streaming (Kafka/MSK, Kinesis, Spark Structured Streaming).Advanced Data Architectures: Exposure to Data Mesh concepts, data products, or federated data governance models. AI/ML Infrastructure: Exposure ...

Databricks and/or AWS certifications at Associate or Professional level. Streaming Architectures: Practical experience with real-time or event-driven streaming (Kafka/MSK, Kinesis, Spark Structured Streaming). Advanced Data Architectures: Exposure to Data Mesh concepts, data products, or federated data governance models. AI/ML Infrastructure ...

Databricks and/or AWS certifications at Associate or Professional level. Streaming Architectures: Practical experience with real-time or event-driven streaming (Kafka/MSK, Kinesis, Spark Structured Streaming). Advanced Data Architectures: Exposure to Data Mesh concepts, data products, or federated data governance models. AI/ML Infrastructure ...

patterns . Familiarity with AI/ML workflows and their data requirements. Experience with API specifications and data integrations acrossETL and streaming services ( Glue, MSK, Kinesis, Kafka ) Familiarity with AI developer tools like Cursor and GitHub Copilot and desire to use them to 10x your throughput. Collaborative approach ...

cloud-native architectures, with experience shaping technical direction across teams and stakeholders Solid expertise in relevant technologies such as AWS, Terraform, Kafka/MSK, Airflow, Glue or Spark, and building scalable data solutions Experience with modern data ecosystems including data lakes/lakehouse architectures, Iceberg or similar table formats ...

cloud-native architectures, with experience shaping technical direction across teams and stakeholders Solid expertise in relevant technologies such as AWS, Terraform, Kafka/MSK, Airflow, Glue or Spark, and building scalable data solutions Experience with modern data ecosystems including data lakes/lakehouse architectures, Iceberg or similar table formats ...

cloud-native architectures, with experience shaping technical direction across teams and stakeholders Solid expertise in relevant technologies such as AWS, Terraform, Kafka/MSK, Airflow, Glue or Spark, and building scalable data solutions Experience with modern data ecosystems including data lakes/lakehouse architectures, Iceberg or similar table formats ...

cloud-native architectures, with experience shaping technical direction across teams and stakeholders Solid expertise in relevant technologies such as AWS, Terraform, Kafka/MSK, Airflow, Glue or Spark, and building scalable data solutions Experience with modern data ecosystems including data lakes/lakehouse architectures, Iceberg or similar table formats ...

Develop self-service capabilities for engineering teams to provision and manage approved AWS resources.* Provision and operate AWS services including EC2, EKS, RDS, S3, MSK, ElastiCache, IAM, and CloudWatch.* Build and maintain CI/CD pipelines using GitHub Actions and related tooling.* Manage and improve Kubernetes platforms, GitOps workflows … Preferred Qualifications*** Experience with Argo CD, Helm, or other GitOps tooling.* Familiarity with Airflow, Snowflake, or Apache Iceberg.* Experience with Apache Kafka or Amazon MSK.* Experience with hybrid cloud, enterprise networking, or multi-account AWS environments.* Experience with Ansible or similar configuration management tools.* Experience in financial services ...

Develop and support AWS serverless solutions (e.g. Lambda, API Gateway, Step Functions, DynamoDB, S3).* Implement event-driven architectures using Kafka (preferably on AWS MSK) for high-throughput, near real-time processing.* Work with Docker and Kubernetes to build, deploy and run containerised services.* Contribute to the design … development.* Proven experience building solutions on AWS, ideally including serverless services (Lambda, API Gateway, DynamoDB, etc.).* Hands-on experience with Kafka (preferably AWS MSK) for messaging/stream processing.* Experience with Docker and Kubernetes for container orchestration.* Good understanding of DevOps concepts, with practical experience using ...

cloud platform depth (AWS and GCP): hands-on experience with data services across one or both of AWS (Redshift, Glue, S3/Lake Formation, MSK, RDS) and GCP (BigQuery, Dataflow, Pub/Sub, Cloud Composer). Data flow mapping and optimisation: demonstrable experience producing current-state data flow documentation ...

cloud-native data platforms such as Databricks and Snowflake. Strong knowledge of AWS data analytics services, including Redshift, EMR, Glue, Athena, Kinesis, Lake Formation, MSK, and S3 data lake patterns. Preferred Qualifications, Capabilities, and Skills: Experience navigating complex data governance, security, and compliance requirements across multi-cloud and hybrid ...

isolation. Lead the hands‐on build of integrations with third‐party systems and internal platforms, using AWS services such as ECS Fargate, SQS, MSK, S3, IAM, etc., to deliver secure, scalable data flows. Write production‐quality code and build infrastructure hands‐on, working alongside the rest of the team … contributing to design decisions rather than only implementing to a specification. Hands‐on experience building and operating services on AWS, including ECS Fargate, SQS, MSK, S3, IAM, core networking and RDS/RDS Aurora, etc. Strong experience with Java and Spring Boot; exposure to primarily event‐driven systems ...