1 to 25 of 39 Amazon Kinesis Jobs in England

Contract DevOps Engineer (Terraform/AWS/Kinesis) Location: London (2 days per week onsite) Rate: £350/day (Inside IR35) Contract: Part-time (2 days per week) Start: ASAP Overview We are seeking a DevOps Engineer with strong experience in Terraform and Amazon Web Services to support … based platform. This role is primarily focused on infrastructure, environment support, and CI/CD reliability, with exposure to event streaming technologies such as Amazon Kinesis . Key Responsibilities Infrastructure & Environment Provision and manage cloud infrastructure using Terraform Support environment setup, configuration, and readiness Manage IAM roles, networking ...

Your Responsibilities: Define enterprise integration architecture using event driven, microservices, and real time streaming patterns. Architect solutions using Kafka, AWS EventBridge, SQS/SNS, Kinesis Streams/Firehose, and Kafka Connect. Establish integration standards, best practices, reusable frameworks, and governance models. Design solutions that ensure high availability, scalability, observability … building producers, consumers, connectors, and stream processing applications. Review designs/code to ensure alignment with architecture guidelines. Architect integration workloads using: AWS Kinesis Streams & Kinesis Firehose AWS EventBridge event bus SQS/SNS for messaging patterns Kafka clusters (Confluent, MSK, or open-source) Work closely with cloud ...

BFSI (risk, pricing, regulatory reporting, underwriting, fraud, payments, or actuarial data). Experience with event-driven and near-real-time pipelines (Kafka/Kinesis, streaming ETL). Knowledge of data quality frameworks (Great Expectations, Deequ) and data lineage/catalog (Atlas, Alation, Collibra). Exposure to Databricks ...

BFSI (risk, pricing, regulatory reporting, underwriting, fraud, payments, or actuarial data). Experience with event-driven and near-real-time pipelines (Kafka/Kinesis, streaming ETL). Knowledge of data quality frameworks (Great Expectations, Deequ) and data lineage/catalog (Atlas, Alation, Collibra). Exposure to Databricks ...

effective data solutions that meet complex business needs and support informed decision-making. Experience Required: Strong AWS expertise, including tools such as Glue, Lambda, Kinesis, EMR, Athena, DynamoDB, CloudWatch, SNS and Step Functions. Skilled in modern programming, particularly Python, Java, Scala and PySpark. Solid knowledge of data storage ...

production environment. Hands-on experience with modern data engineering frameworks such as: Apache Spark, Databricks Airflow/Prefect/Dagster Kafka/EventHub/Kinesis Experience building data solutions on at least one major cloud platform (AWS, Azure, or GCP). Strong understanding of data warehousing concepts , dimensional modelling ...

designing and deploying production-grade pipelines (Python, Scala, Java, Spark, SQL). Strong experience working with AWS cloud data technologies (e.g., Glue, EMR, Redshift, Kinesis, Lambda, DynamoDB). Commercial experience ingesting, processing and curating structured and unstructured datasets. Experience with API ingestion, data modelling and optimisation for analytics. Familiarity ...

ensure solutions are buildable and operable Required Skills & Experience Core Technical Strong AWS architecture experience (VPC, IAM, EC2, S3, RDS, DynamoDB, Lambda, EKS, Glue, Kinesis or equivalents) API and integration design experience Strong background in DevOps and automation Solid understanding of data migration and data platform design Experience designing ...

with CI/CD for data pipelines. Good to have skills Although not essential, the following skills are desired by the client: Kafka/Kinesis, Airflow, CodePipeline. BI tools (Power BI/Tableau). Docker/OpenShift; metadata driven pipelines. 3-8+ years Data Engineering experience. Cloud data ...

multiple sources using APIs, scripting and cloud-native tooling Design and build robust AWS cloud data platforms using services such as EMR, Glue, Redshift, Kinesis, Lambda and DynamoDB Collaborate cross-functionally with product, design and engineering teams in agile delivery environments Participate in live whiteboarding sessions and technical problem ...

multiple sources using APIs, scripting and cloud-native tooling Design and build robust AWS cloud data platforms using services such as EMR, Glue, Redshift, Kinesis, Lambda and DynamoDB Collaborate cross-functionally with product, design and engineering teams in agile delivery environments Participate in live whiteboarding sessions and technical problem ...

multiple sources using APIs, scripting and cloud-native tooling Design and build robust AWS cloud data platforms using services such as EMR, Glue, Redshift, Kinesis, Lambda and DynamoDB Collaborate cross-functionally with product, design and engineering teams in agile delivery environments Participate in live whiteboarding sessions and technical problem ...

work closely with technical and business teams to deliver impactful solutions. Nice-to-Haves: Orchestration tools (Airflow, dbt, Prefect) or streaming frameworks (Kafka, Kinesis). CI/CD experience and DevOps practices for data workflows. Exposure to data visualisation platforms (PowerBI, Tableau, MicroStrategy). Experience in financial services ...

ensure solutions are buildable and operable Required Skills & Experience Core Technical Strong AWS architecture experience (VPC, IAM, EC2, S3, RDS, DynamoDB, Lambda, EKS, Glue, Kinesis or equivalents) API and integration design experience Strong background in DevOps and automation Solid understanding of data migration and data platform design Experience designing ...

ensure solutions are buildable and operable Required Skills & Experience Core Technical Strong AWS architecture experience (VPC, IAM, EC2, S3, RDS, DynamoDB, Lambda, EKS, Glue, Kinesis or equivalents) API and integration design experience Strong background in DevOps and automation Solid understanding of data migration and data platform design Experience designing ...

with varied tech stacks across multiple industries. Access professional development, including technical courses, certifications, mentoring, and coaching. Tech stack: AWS cloud (EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB) for ETL, data lake/warehouse design, and data movement. Programming: Java, Python, Scala, Spark, SQL. Experience integrating and processing large-scale ...

with varied tech stacks across multiple industries. Access professional development, including technical courses, certifications, mentoring, and coaching. Tech stack: AWS cloud (EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB) for ETL, data lake/warehouse design, and data movement. Programming: Java, Python, Scala, Spark, SQL. Experience integrating and processing large-scale ...

following: - Expertise in designing production-grade data pipelines using Python, Scala, Spark, and SQL - Deep knowledge of AWS Cloud Platforms (EMR, Glue, Redshift, Kinesis, Lambda, DynamoDB) - Experience with data processing across structured and unstructured sources - Strong scripting abilities and API integration skills - Knowledge of data visualization and reporting best ...

helpful but not required) Nice to have: DuckDB experience Time-series experience (market data, telemetry, pricing, events) Streaming exposure (Kafka/Event Hubs/Kinesis) Experience with Temporal (or similar orchestrators like Airflow/Dagster/Prefect) Any exposure to AI agents/automation tooling 👉 Apply ...

Data Architect or Senior Data Engineer Deep expertise in Kafka (MSK or Confluent) and real-time data architectures Strong AWS data platform experience (S3, Kinesis, Glue, Redshift, Lambda, ECS/EKS) Experience designing both real-time and batch systems at enterprise scale Excellent documentation and stakeholder communication skills Nice ...

following tech stack: NodeJS/Typescript/Mocha/Sinon/Terraform/Git/Gitlab CICD/Docker AWS (ECS, EC2, Kinesis, Firehose, RDS, Lambda, S3, DynamoDB, SQS, SNS) Databases – Postgres/MySQL As a Senior Developer to lead by example. A strong critical thinker with excellent problem ...

Ingestion Data Manipulation & Processing GitHub, GitHub Actions, Azure DevOps Azure Data Factory Databricks SQL Database Azure Synapse Stream Analytics AWS Glue Apache Airflow AWS Kinesis Amazon Redshift SonarQube PyTest Optional/Nice to Have Experience managing projects or running Scrum teams Experience with BPC/Planning solutions Exposure ...

technical solutions Deep knowledge of data governance, lineage and quality frameworks Nice to Have Terraform, CloudFormation or CDK Real-time data platforms (Kafka/Kinesis) Previous UK banking experience ...

/experience: Good understanding of Data Lake and Big Data technologies. Understanding of AWS Services will be required. AWS native data services (S3, Lambda, Kinesis) etc. ETL/ELT solutions such as AWS glue, DBT, Data solutions such as Snowflake. Good understanding of Insurance Domain. Desirable skills/knowledge ...

/experience: Good understanding of Data Lake and Big Data technologies. Understanding of AWS Services will be required AWS native data services(S3, Lambda, Kinesis) etc ETL/ELT solutions such as AWS glue, DBT, Data solutions such as Snowflake Good understanding of Insurance Domain Desirable skills/knowledge ...