20 of 20 Permanent Amazon MSK Jobs

support real‐time streaming pipelines and event‐driven integrations. Integrate data from multiple sources (streaming, batch, APIs) using AWS managed services (e.g., Kinesis, MSK, Lambda, Glue). Data Architecture & Standards Contribute to data modelling, data architecture best practices, and modern patterns (e.g., medallion architecture). Ensure data quality, lineage ...

Kafka, Flink, or Spark Develop event-driven architectures and streaming integrations Integrate data from multiple sources using AWS services (e.g. Kinesis, Lambda, Glue, MSK) Architecture & Data Management Contribute to modern data architecture patterns (e.g. medallion architecture) Ensure high standards of data quality, governance, lineage, and security Support scalable ...

using technologies such as Kafka and Flink Integrate data from multiple sources including APIs, batch systems, and streaming platforms using AWS services like Kinesis, MSK, Lambda, and Glue Contribute to modern data architecture patterns including medallion architecture and event-driven design Ensure strong data governance, quality, lineage, and security ...

pipelines using Java (primary) and technologies like Kafka, Flink, or Spark Developing real-time streaming solutions and event-driven architectures using AWS services (Kinesis, MSK, Lambda, Glue) Contributing to data architecture, modelling, and best practices across modern data platforms Deploying and maintaining solutions using CI/CD and Infrastructure ...

time streaming and event-driven integrations Integrate data from multiple sources including streaming, batch, and APIs Work with managed cloud services such as Kinesis, MSK, Lambda, and Glue Contribute to data modelling, architecture patterns, and engineering best practice Ensure data quality, lineage, governance, and security controls are embedded Deploy ...

Storage (S3, EBS, EFS & FSX) Security (IAM & SAML, Config, CloudTrail) Automation (EventBridge, Lambda) Logging & Monitoring (OpenSearch, CloudWatch, AMP, AMG) Managed Services (MWAA, MSK, Kinesis) Terraform & Terraform Cloud Scripting and automation (Bash, Python & PowerShell) Additional Hashicorp tools (Vault & Packer) CI/CD solutions (Jenkins, TeamCity, Argo) Your experience ...

Agentic Solutions and technologies (Langchain, Langragh, Rag-Patterns) Deep experience with AWS services (S3, Glue, Kinesis, Lambda, ECS, IAM, KMS, Api Gateway, Step Functions, MSK, Cloudformation etc.) Experience with On-Prem Hadoop and Kubernetes. Strong programming skills in Python; familiarity with Java is a plus. Knowledge of how quantitative ...

delivery of production‐ready solutions at scale. Data and streaming technologies, including working knowledge of JSON, Iceberg, Avro, and streaming platforms such as Kafka, MSK, Kinesis or Glue Streaming, alongside Big Data or Data Warehouse environments. Ability to communicate effectively with cross-functional teams and stakeholders. Documenting configurations, processes ...

Experience operating Apache Flink (or similar streaming frameworks) at the infrastructure level (checkpointing and state management). Strong IaC experience and AWS familiarity (e.g., MSK/EC2/EKS, IAM, VPC, CloudWatch, S3). Proven experience with HA/DR and reliability practices (SLA/SLO ownership, incident response ...

APIGEE, Kong, Mulesoft Strong understand of OpenAPI Specification (OAS) for RESTful APIs DevOps (CICD, Kubernetes, Terraform) Preferred qualifications, capabilities, and skills AWS (ECS, EKS, MSK) Kong API Gateway Golang programming language Lua programming language ...

Kong, Mulesoft Strong understand of OpenAPI Specification (OAS) for RESTful API s DevOps (CICD, Kubernetes, Terraform) Preferred qualifications, capabilities, and skills AWS (ECS, EKS, MSK) Kong API Gateway Golang programming language Lua programming language ...

level software solutions using tools and techniques such as Source Control, Build Tools (e.g. Maven), TDD, Gitlab. Knowledge of Streaming services is preferable (Kafka , MSK , Kinesis , Glue Streaming etc.). You may be assessed on the key critical skills relevant for success in role, such as risk and controls ...

/CD, with a strong understanding of automated build, test, and deployment workflows. • Proven experience designing, deploying, and managing scalable cloud infrastructure on Amazon Web Services (AWS) using Infrastructure as Code tools. • Developer Experience - Continuously improve platform tooling, documentation, and automation to empower product teams and reduce cognitive … currently use in our team: · Java 17/21, Spring boot · Python (Apache Airflow/Apache Spark) · Typescrpt (Lambda, AWS CDK) · AWS: S3, MSK (Kafka), Glue, Athena, Flink · CI/CD: Jenkins, Github Actions ...

polished layers using Cloud native services such as"S3, Glue (ETL & Data Catalog), Lake Formation, Redshift, Athena, EMR/Spark, Kinesis/MSK, Step Functions, Lambda, EventBridge. Define storage/format strategies (e.g.,"Parquet/Delta/Apache Iceberg) and partitioning, compaction, and indexing for performance and cost. Implement … C#"and"Angular"consumers. Orchestrate ingestion from"SAP, Salesforce, IoT/telemetry, external data sources, and partner ecosystems; standardize CDC and streaming patterns (e.g.,"MSK/Kinesis,"DMS,"Glue). Partner with Solution/Platform Architects to ensure"microservices"and"event driven"designs are data efficient and observability ready. ...

quality, scalability, and reliability. Develop and optimise Spark (PySpark) jobs for large-scale distributed processing. Design and implement streaming data pipelines with Kafka/MSK, applying best practices for late event handling and throughput. Use Terraform and CI/CD pipelines (GitHub Actions or similar) to manage infrastructure ...

track record of meeting deadlines Excellent communication skills for cross-team collaboration Desirable skills (not essential, but a big plus): SSAS, SSRS, SSIS Kafka, MSK, Snowflake, Aurora DB, SNS AWS or Azure database management If you're ready to join a company that challenges limits, delivers excellence, and offers ...

cloud-native data platforms such as Databricks and Snowflake Good understanding of AWS data analytics services, including Redshift, EMR, Glue, Athena, Kinesis, Lake Formation, MSK, and S3 data lake patterns, with demonstrated experience architecting end-to-end data solutions Experience navigating complex data governance, security, and compliance requirements across ...

cloud-native data platforms such as Databricks and Snowflake. Strong knowledge of AWS data analytics services, including Redshift, EMR, Glue, Athena, Kinesis, Lake Formation, MSK, and S3 data lake patterns. Preferred Qualifications, Capabilities, and Skills Experience navigating complex data governance, security, and compliance requirements across multi-cloud and hybrid ...

write reusable CDK and Terraform modules that other squads reach for first when building new infrastructure. Design and maintain golden paths for Lambda, Kafka (MSK), and Flink — opinionated, well-documented patterns that reduce cognitive load for the broader data engineering team. Build and maintain common CI/CD pipeline … able to demonstrate a technical and passionate mindset for solving complex problems: AWS — the core of our production infrastructure. We make heavy use of MSK, Managed Flink, Lambda, Glue, S3, Lake Formation, CloudWatch, and CDK. CDK (TypeScript) and Terraform for infrastructure as code and reusable module development. GitHub ...

Data Engineer Salary up to £60,000 + discretionary bonus Hybrid working model with collaborative office environment Work with Databricks, Spark Structured Streaming, Kafka (MSK), and AWS Apply online or contact Chelsea Hackett via chelsea.hackett@searchability.com ABOUT THE CLIENT Due to continued growth, we’re seeking a skilled Data … experience with Databricks and Apache Spark (PySpark or Scala) Experience building streaming and batch pipelines using Spark Structured Streaming Hands-on experience with Kafka (MSK) and real-time data ingestion Strong understanding of Delta Lake, Delta Live Tables, and Medallion Architecture Proficiency in Python and SQL for data engineering ...