12 of 12 AWS Step Functions Jobs in the City of London

payments and financial data . You will define end-to-end As-Is to To-Be data architecture, build resilient streaming pipelines, and architect AWS-native lakehouse platforms capable of handling tens of millions of events per day . This role requires close collaboration with engineering, platform, and business … short-term, low-latency layer) Channel Analytics Data Lake (long-term historical layer) Define and expose status and statement APIs with clear SLAs. Architect AWS lakehouse solutions using S3, Glue, Athena, Iceberg, and Redshift . Enable analytics and dashboards using Amazon QuickSight . Streaming & Event-Driven Design Build event ...

implement ETL/ELT pipelines with strong error handling and retry logic. Develop incremental data processing patterns for large-scale datasets. Work with AWS services including Glue, Step Functions, S3, DynamoDB, Redshift, Lambda, and EventBridge. Build and optimise vector database solutions and embedding generation pipelines for semantic … Required Skills ETL/ELT pipeline design and data validation frameworks. Advanced Python (pandas, numpy, boto3) and SQL (complex queries, optimisation). Experience with AWS Glue , Step Functions , and event-driven architectures . Knowledge of vector databases , embeddings, and semantic search strategies. Familiarity with document parsing libraries ...

annum Location: Fully Remote (UK-based) What you’ll be doing: Design, build, and optimise scalable software using Node.js, TypeScript, React, AWS Lambda, Step Functions, DynamoDB Contribute to architecture discussions and ensure solutions are secure, cloud-native, and maintainable Use AI-assisted tooling to speed up development … need: Strong full stack experience with a backend-first mindset Expertise in Node.js, TypeScript, React , and modern cloud engineering Hands-on experience with AWS serverless , particularly Lambda, Step Functions, DynamoDB Solid understanding of scalable architecture and performance optimisation Experience in scale ups, startups, or SMEs where speed ...

Required Technical Skills Data Pipeline & ETL Design, build, and maintain robust ETL/ELT pipelines for structured and unstructured data Hands-on experience with AWS Glue and AWS Step Functions Implementation of data validation, data quality frameworks, and reconciliation checks Strong error handling, monitoring, and retry … strategies in production pipelines Experience with incremental data processing patterns (CDC, watermarking, upserts) AWS Data Services Amazon S3: data lake architectures, partitioning strategies, lifecycle policies DynamoDB: data modeling, secondary indexes, streams, and performance optimization Amazon Redshift: foundational querying, integrations, and performance considerations AWS Lambda for scalable data processing ...

hands-on. Collaborate with internal infra/platform teams to align capabilities and avoid duplication. Design and implement secure, cost-aware, scalable systems using AWS services and Kubernetes. Mentor junior engineers and set best practices for AI/ML infrastructure. Influence across organisational boundaries and champion modern engineering trends. … Stay ahead of the curve in Generative AI, ML infrastructure, and cloud-native tooling. Tech Stack Programming: Python (Java familiarity is a plus). AWS: S3, Kinesis, Glue, Lambda, Step Functions, SageMaker, and more. On-Prem: Managed Kubernetes Platform and Hadoop ecosystem. Why This Role is Different ...

driven trading. Collaborate with internal infra/platform teams to align capabilities and avoid duplication. Design and implement secure, cost-aware, scalable systems using AWS services and Kubernetes. Contribute to best practices for AI/ML infrastructure and mentor junior engineers when needed. Work across organisational boundaries and champion … Stay ahead of the curve in Generative AI, ML infrastructure, and cloud-native tooling. Tech Stack Programming: Python (Java familiarity is a plus). AWS: S3, Kinesis, Glue, Lambda, Step Functions, SageMaker, and more. On-Prem: Managed Kubernetes Platform and Hadoop ecosystem. Why This Role is Different ...

agentic and RAG-based solutions for enterprise use Own delivery from proof-of-concept through to production Work with cloud-native architectures (e.g. AWS Lambda, Step Functions) Lead and guide junior engineers within project teams Key Details Salary : £100,000–£130,000 + benefits Working model : Hybrid … days/week in London office) Tech stack : Python, LLMs (OpenAI/Claude), Docker, CI/CD, microservices, AWS If you're a strong backend or platform engineer passionate about GenAI and excited to ship high-impact tools, this is the opportunity to step into it. Budget Salary ...

performance and operational maturity • Communicate progress, risks and trade-offs clearly to wider delivery stakeholders Required Skills & Experience • Strong Data Engineering experience within AWS environments • Hands-on experience with core AWS data services: – S3, Glue, Lambda, Athena, Kinesis, Step Functions (or similar) • Proficiency in Python ...

Role Title: Senior Data Architect Location : London, UK (Hybrid 2 days onsite/week) Contract (InsideIR35) Must-Have Skills: • Streaming & EDA Kafka (Confluent) and AWS MSK/Kinesis/Kinesis Firehose; outbox, ordering, replay, exactly/at-least-once semantics. EventBridge for event routing and filtering. • Schema Management: Avro …/Protobuf + Schema Registry (compatibility, subject strategy, evolution). • AWS Data Stack: S3/Glue/Athena, Redshift, Step Functions, Lambda; Iceberg-ready lakehouse patterns. Kinesis→S3→Glue streaming pipelines; Glue Streaming; DLQ patterns. • Payments & ISO 20022: PAIN/PACS/CAMT, lifecycle modeling, reconciliation/ ...

type: Contract Job Description: Data product architecture experience is mandatory - talent must have architecture experience in Data products Streaming & EDA: Kafka (Confluent) and AWS MSK/Kinesis/Kinesis Firehose; outbox, ordering, replay, exactly/at-least-once semantics. EventBridge for event routing and filtering. Schema management: Avro/… Protobuf + Schema Registry (compatibility, subject strategy, evolution). AWS data stack: S3/Glue/Athena, Redshift, Step Functions, Lambda; Iceberg-ready lakehouse patterns. Kinesis→S3→Glue streaming pipelines; Glue Streaming; DLQ patterns. Payments & ISO 20022: PAIN/PACS/CAMT, lifecycle modeling, reconciliation/advices ...

Contract duration: 6 months Location: London Max Rate : 450 - 495 pounds/day on Inside Must-Have Skills: Streaming EDA: Kafka (Confluent) and AWS: Kinesis, Kinesis Firehose -Outbox, ordering, replay, exactly-at-least-once semantics -EventBridge for event routing and filtering Schema Management: Avro, Protobuf Schema Registry: compatibility, subject … strategy, evolution AWS Data Stack: S3, Glue, Athena, Redshift Step Functions, Lambda Iceberg-ready lakehouse patterns Streaming Pipelines: Kinesis → S3 → Glue Glue Streaming DLQ patterns Minimum years of experience: > 10 years ...

Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time on-site when required Expertise required in AWS, Data Pipelines, ETL, Data Storage … analytics and reporting. Develop ETL/ELT workflows to move data efficiently into data warehouses, data lakes and lake houses using open-source and AWS tooling. Apply DevOps practices, including CI/CD, infrastructure as code and automation, to improve and streamline data engineering processes. Design effective data solutions ...