1 to 25 of 48 AWS Step Functions Jobs in London

who are looking anSC Cleared Data Engineer. Candidates ideally have experience working within the Central Gov/Policing Sector. Essential experience: Data migration experience. AWS experience, particularly using ETL applications such as AWS Glue and storage applications such as AWS RDS. Other tools include AWS Lambda … AWS S3, AWS Step Functions and more. Excellent knowledge of PostgreSQL databases and SQL, as well as Python for data mapping and manually implementing AWS Glue Jobs Building, maintaining and refining AWS Glue jobs as part of an ETL pipeline. Soft skills, including pro … with other teams such as DevOps and Database Analysts. Completing show and tells Ensuring proper audit and logging mechanisms in ETL pipelines, particularly in AWS Ideal to have: AWS Database Migration experience (including its Change Data Capture ability) Experience handing queries related to the data model (data mapping More ❯

AWS Data Engineer (Must hold current SC) The Company: At Amber Labs, we are a cutting-edge UK and European technology consultancy that prioritises empowering autonomy, promoting experimentation, and facilitating rapid learning to provide exceptional value to our clients. Our company culture is centred around collaboration, where all colleagues … shorten delivery times. Our team consists of highly-skilled cross-functional consultants, analysts, and support staff. Overview: We are looking for a highly skilled AWS Data Engineer to join our team. The ideal candidate will have expertise in designing, building, and managing scalable data pipelines on AWS. You will … engineers to implement efficient data solutions that support business intelligence and analytics needs. Responsibilities: Design, develop, and maintain scalable ETL/ELT pipelines using AWS services such as AWS Glue, Lambda, Step Functions, and Kinesis. Work with structured and unstructured data from multiple sources, ensuring efficient More ❯

At Cloud Bridge , we transform how businesses use AWS cloud services. We specialise in Consultancy, Managed Services, Cloud Governance, FinOps, and AI/ML to unlock AWS's full potential. Recognised as AWS's Rising Star Partner of the Year for 2023 in EMEA and 2022 in … cloud migrations, architectural projects, cost optimisations, and support services for a diverse range of customers, from start-ups to public sector organisations. As an AWS Advanced Partner, we enhance IT experiences for clients across various sectors. If you're ready to make a difference and join an exciting journey … with Cloud Bridge and AWS, we want to hear from you. As a Senior Solution Architect, you'll work with customers to modernise legacy applications and databases as they migrate to AWS. You will be a technical authority in designing and delivering cloud-native architectures, serverless solutions, application and More ❯

At Cloud Bridge , we transform how businesses use AWS cloud services. We specialise in Consultancy, Managed Services, Cloud Governance, FinOps, and AI/ML to unlock AWS's full potential. Recognised as AWS's Rising Star Partner of the Year for 2023 in EMEA and 2022 in … cloud migrations, architectural projects, cost optimisations, and support services for a diverse range of customers, from start-ups to public sector organisations. As an AWS Advanced Partner, we enhance IT experiences for clients across various sectors. If you're ready to make a difference and join an exciting journey … with Cloud Bridge and AWS, we want to hear from you. As a Senior Solution Architect, you’ll work with customers to modernise legacy applications and databases as they migrate to AWS. You will be a technical authority in designing and delivering cloud-native architectures, serverless solutions, application and More ❯

UK (2 Days per week in office) (Sometimes out-of-hours support is required and also sometimes weekend testing can be there.) Must Haves: AWS Lambda JavaScript/Typescript Dynamo DB App sync Step Functions. JavaScript/Typescript exp Aws serverless exp Aws certification would be … a need as they would be knowing a lot of things on AWS Aws serverless development, lambda, Dynamo DB Someone who has worked e2e architecting design to delivery. They use AWS cdk framework so that is required. They use Ias Candidate can be a SME help in … making architecture decisions. CORE AWS SERVERLESS DEVLOPER AND WORKED ON INFRA Act as a lead developer would be advantage but s/he wont be leading a team or line managing anyone. Working in Tech, Product is about building the next and the new. From broadband to broadcast, streaming More ❯

Lead AWS Data Engineer 📍 City of London (Hybrid: Around 2-3 office days per week) 💰 Salary: Up to £120,000 🏦 Industry: FinTech/RegTech A 200-employee data and technology company specialising in Regulatory Technology (RegTech) are looking for a Lead AWS Data Engineer. They develop products that … team of onshore and offshore Data Engineers, driving technical growth and ensuring effective collaboration. Design, develop, and optimise scalable data pipelines and infrastructure using AWS (Glue, Athena, Redshift, Kinesis, Step Functions, Lake Formation). Utilise PySpark for distributed data processing, ETL, SQL querying, and real-time data … experience in data engineering, including mentoring and team management. 7+ years of hands-on experience in data engineering and ETL architecture. Deep expertise in AWS Data Services, including Glue, Athena, Redshift, Kinesis, Step Functions, and Lake Formation. Strong programming skills in Python and PySpark for data processing More ❯

Lead AWS Data Engineer 📍 City of London (Hybrid: Around 2-3 office days per week) 💰 Salary: Up to £120,000 🏦 Industry: FinTech/RegTech A 200-employee data and technology company specialising in Regulatory Technology (RegTech) are looking for a Lead AWS Data Engineer. They develop products that … team of onshore and offshore Data Engineers, driving technical growth and ensuring effective collaboration. Design, develop, and optimise scalable data pipelines and infrastructure using AWS (Glue, Athena, Redshift, Kinesis, Step Functions, Lake Formation). Utilise PySpark for distributed data processing, ETL, SQL querying, and real-time data … experience in data engineering, including mentoring and team management. 7+ years of hands-on experience in data engineering and ETL architecture. Deep expertise in AWS Data Services, including Glue, Athena, Redshift, Kinesis, Step Functions, and Lake Formation. Strong programming skills in Python and PySpark for data processing More ❯

Contract Opportunity: Senior AWS Machine Learning Data Engineer Location: London | Duration: 6 Months (Extension Possible) | Start Date: ASAP Rate: Up to £600 a day (Inisde IR35) Are you a cloud-native data engineer with a passion for building intelligent systems? I'm looking for a Senior AWS Machine … variety of domains — from predictive analytics to real-time personalization. ? What You'll Do: Architect and build scalable, secure, and maintainable data pipelines on AWS (Glue, Lambda, Step Functions, S3, Redshift, etc.) Operationalize machine learning models in production environments using SageMaker or custom deployment frameworks Automate and … with business needs ? What We're Looking For: 5+ years of data engineering experience, with 2+ years in a senior role Deep expertise with AWS services (S3, Glue, Lambda, SageMaker, Redshift, etc.) Strong Python and SQL skills; experience with PySpark a bonus Familiarity with containerization (Docker), orchestration (Airflow, Step More ❯

Senior ML Engineer - Python/Serverless ML Pipelines (AWS Lambda) - Fully Remote (Northern Ireland-based candidates encouraged) Salary: £100k+ market-leading benefits package About the Company: Our client is a rapidly scaling, VC-backed technology company focused on cloud cost optimization and FinOps solutions for enterprises and MSPs operating … intelligent automation features and ML-enhanced services in a high-scale cloud environment. The role requires deep expertise in Python, applied machine learning, and AWS-native ML workflows. You'll work closely with data engineers, backend developers, and product leaders to embed ML across core features - from forecasting and … anomaly detection to optimization and automated decision-making. Key Responsibilities: * Design and build serverless ML pipelines using AWS tools (Lambda, SageMaker, Step Functions) * Develop, deploy, and monitor models in production (e.g., cost forecasting, anomaly detection, usage classification) * Collaborate on data ingestion and transformation with Snowflake, DBT, Airflow More ❯

Senior ML Engineer - Python/Serverless ML Pipelines (AWS Lambda) - Fully Remote (Northern Ireland-based candidates encouraged) Salary: £100k+ market-leading benefits package About the Company: Our client is a rapidly scaling, VC-backed technology company focused on cloud cost optimization and FinOps solutions for enterprises and MSPs operating … intelligent automation features and ML-enhanced services in a high-scale cloud environment. The role requires deep expertise in Python, applied machine learning, and AWS-native ML workflows. You'll work closely with data engineers, backend developers, and product leaders to embed ML across core features - from forecasting and … anomaly detection to optimization and automated decision-making. Key Responsibilities: * Design and build serverless ML pipelines using AWS tools (Lambda, SageMaker, Step Functions) * Develop, deploy, and monitor models in production (e.g., cost forecasting, anomaly detection, usage classification) * Collaborate on data ingestion and transformation with Snowflake, DBT, Airflow More ❯

Senior ML Engineer - Python/Serverless ML Pipelines (AWS Lambda) - Fully Remote (Northern Ireland-based candidates encouraged) Salary: £100k+ market-leading benefits package About the Company: Our client is a rapidly scaling, VC-backed technology company focused on cloud cost optimization and FinOps solutions for enterprises and MSPs operating … intelligent automation features and ML-enhanced services in a high-scale cloud environment. The role requires deep expertise in Python, applied machine learning, and AWS-native ML workflows. You'll work closely with data engineers, backend developers, and product leaders to embed ML across core features - from forecasting and … anomaly detection to optimization and automated decision-making. Key Responsibilities: * Design and build serverless ML pipelines using AWS tools (Lambda, SageMaker, Step Functions) * Develop, deploy, and monitor models in production (e.g., cost forecasting, anomaly detection, usage classification) * Collaborate on data ingestion and transformation with Snowflake, DBT, Airflow More ❯

vendors and colleagues in Comcast in the US • Quickly build prototypes and work with top brains in ML across the industry Notes from HM Aws serverless development , Lambda , dynamo db Minimum 3-4 yrs exp, scaling aws, rapid ramp-down up & rapid rampdown JavaScript/Typescript exp Aws serverless exp Atleast 2 yrs exp with javascript/typescript. Also backend engineer - writing api's on aws, also to know set up a Aws infrastructure Someone who has worked e2e architecting design to delievery. They use aws cdk framework so that is required. They use … Ias Want backened developer worked on aws serverless Backend api services Aws set up to run services Backedn and infra using aws cdk framework NOSQL DATABASE EXP/DYNAMO DB Act as a lead developer would be advantage but he wont be leading a team or line More ❯

vendors and colleagues in Comcast in the US • Quickly build prototypes and work with top brains in ML across the industry Notes from HM Aws serverless development , Lambda , dynamo db Minimum 3-4 yrs exp, scaling aws, rapid ramp-down up & rapid rampdown JavaScript/Typescript exp Aws serverless exp Atleast 2 yrs exp with javascript/typescript. Also backend engineer - writing api's on aws, also to know set up a Aws infrastructure Someone who has worked e2e architecting design to delievery. They use aws cdk framework so that is required. They use … Ias Want backened developer worked on aws serverless Backend api services Aws set up to run services Backedn and infra using aws cdk framework NOSQL DATABASE EXP/DYNAMO DB Act as a lead developer would be advantage but he wont be leading a team or line More ❯

We are seeking a talented AWS Cloud Architect to join our IT team. In this role, you will be responsible for leading the design and architecture of AWS-based cloud infrastructures, ensuring that the solutions are reliable, high-performing, and secure. You will collaborate with internal stakeholders and … teams to develop cloud architectures that align with business goals and support future growth. Key Responsibilities: Architect scalable, reliable, and secure cloud solutions using AWS services like EC2, S3, VPC, RDS, Lambda, CloudFormation, and API Gateway, ensuring alignment with business objectives. Define cloud adoption strategies, roadmaps, and migration plans … to transition legacy applications and infrastructure to the cloud with minimal disruption. Design cost-effective cloud architectures leveraging AWS services, optimizing performance, security, compliance, and resource utilization. Use tools like AWS CloudFormation, Terraform, and AWS CDK to automate infrastructure provisioning and management, improving efficiency and reducing manual More ❯

programming languages (e.g., Java, Python) and related popular libraries Experience in building containerized applications and deploying to cloud infrastructure such as Amazon Web Services (AWS), Microsoft Azure, or similar providers. Proficient on Linux platforms with knowledge of various scripting languages Strong knowledge of one or more relevant database technologies … Financial Engineering degree Strong knowledge in other programming language(s) - e.g., JavaScript, Typescript, Kotlin Strong knowledge of data orchestration technologies - e.g., Apache Airflow, Dagster, AWS Step Functions Understanding of ETL/ELT workflows, data modeling, and performance optimization for both batch and real-time processing. Commitment to More ❯

programming languages (e.g., Java, Python) and related popular libraries Experience in building containerized applications and deploying to cloud infrastructure such as Amazon Web Services (AWS), Microsoft Azure, or similar providers. Proficient on Linux platforms with knowledge of various scripting languages Strong knowledge of one or more relevant database technologies … Financial Engineering degree Strong knowledge in other programming language(s) – e.g., JavaScript, Typescript, Kotlin Strong knowledge of data orchestration technologies – e.g., Apache Airflow, Dagster, AWS Step Functions Understanding of ETL/ELT workflows, data modeling, and performance optimization for both batch and real-time processing. Commitment to More ❯

pragmatic approach to how we apply new technologies. Our Tech Stack TypeScript (Full-stack) React + Next.js, Tailwind, Prisma, tRPC PostgreSQL, MongoDB, Redis Serverless, AWS, Google Cloud, Github Actions DBT, BigQuery Terraform Python Minimum Requirements Strong Python experience in building scalable backend systems. Familiarity with API design & distributed systems … architecture . Experience working with event-driven architectures (e.g. Kafka, Pub/Sub, AWS Step Functions, etc.). Comfortable optimising performance & scaling distributed AI workloads . Experience working with cloud platforms (AWS, GCP etc) . Understanding of best practices in observability, monitoring, and debugging . Nice More ❯

pragmatic approach to how we apply new technologies. Our Tech Stack TypeScript (Full-stack) React + Next.js, Tailwind, Prisma, tRPC PostgreSQL, MongoDB, Redis Serverless, AWS, Google Cloud, Github Actions DBT, BigQuery Terraform Python Minimum Requirements Strong Python experience in building scalable backend systems. Familiarity with API design & distributed systems … architecture . Experience working with event-driven architectures (e.g. Kafka, Pub/Sub, AWS Step Functions, etc.). Comfortable optimising performance & scaling distributed AI workloads . Experience working with cloud platforms (AWS, GCP etc) . Understanding of best practices in observability, monitoring, and debugging . Nice More ❯

programming languages (e.g., Java, Python) and related popular libraries Experience in building containerized applications and deploying to cloud infrastructure such as Amazon Web Services (AWS), Microsoft Azure, or similar providers. Proficient on Linux platforms with knowledge of various scripting languages Strong knowledge of one or more relevant database technologies … financial instruments (securities, derivatives) and capital markets Computer Science, Math, or Financial Engineering degree Strong knowledge of data orchestration technologies – e.g., Apache Airflow, Dagster, AWS Step Functions Understanding of ETL/ELT workflows, data modeling, and performance optimization for both batch and real-time processing. Role Responsibilities More ❯

platform. Key Skills: Experience in Data Engineering, including data integration, modelling, optimisation and data quality Exceptional understanding of Python Experience developing in the cloud (AWS preferred) Solid understanding of libraries like Pandas and NumPy Experience in data warehousing tools like Snowflake, Databricks, BigQuery Familiar with AWS Step Functions, Airflow, Dagster, or other workflow orchestration tools Commercial experience with performant database programming in SQL Capability to solve complex technical issues, comprehending risks prior to the circumstance Comfortable working in an agile environment, where features may change and evolve quickly Prior experience in financial services, specifically capital More ❯

platform. Key Skills: Experience in Data Engineering, including data integration, modelling, optimisation and data quality Exceptional understanding of Python Experience developing in the cloud (AWS preferred) Solid understanding of libraries like Pandas and NumPy Experience in data warehousing tools like Snowflake, Databricks, BigQuery Familiar with AWS Step Functions, Airflow, Dagster, or other workflow orchestration tools Commercial experience with performant database programming in SQL Capability to solve complex technical issues, comprehending risks prior to the circumstance Comfortable working in an agile environment, where features may change and evolve quickly Prior experience in financial services, specifically capital More ❯

Centre (Scotland) Limited Join us in revolutionizing Amazon's HR tech: help transform our widely-used Promote tool through an exciting greenfield project leveraging AWS Step Functions for next-gen orchestration! The Promotions Intelligence team (Pint), part of Global Talent Management & Compensation (GTMC) is looking for a … products/services for the Connected Talent Management team's 3-year vision. If you're passionate about scalable, high-availability web architectures using AWS, this is for you. You'll contribute to full-stack dev, following agile SDLC to solve ambiguous customer problems. You'll collaborate across the More ❯

foundation that powers the entire technology stack, from AI agents to APIs to workflows to integrations Set up and manage the cloud infrastructure using AWS, Docker containerisation, and Infrastructure-as-Code with Terraform Build robust data integration infrastructure to connect the platform with various customer systems (TMS, RMS, etc. … that enables our AI-driven workflows Skills and Qualifications Experience building end-to-end platform solutions that integrate workflow orchestration systems (like Airflow, Temporal, AWS Step Functions) with real-world business processes and data pipelines Strong background in integration engineering and data modelling Exceptional Python skills for … building APIs, services, and data processing pipelines Experience with cloud infrastructure (AWS) and infrastructure-as-code (Terraform) including implementing monitoring and observability Knowledge of AI engineering workflows - particularly understanding how to build reliable systems around LLMs Problem-solving mindset and ability to navigate the challenges of creating a reliable More ❯

foundation that powers the entire technology stack, from AI agents to APIs to workflows to integrations Set up and manage the cloud infrastructure using AWS, Docker containerisation, and Infrastructure-as-Code with Terraform Build robust data integration infrastructure to connect the platform with various customer systems (TMS, RMS, etc. … that enables our AI-driven workflows Skills and Qualifications Experience building end-to-end platform solutions that integrate workflow orchestration systems (like Airflow, Temporal, AWS Step Functions) with real-world business processes and data pipelines Strong background in integration engineering and data modelling Exceptional Python skills for … building APIs, services, and data processing pipelines Experience with cloud infrastructure (AWS) and infrastructure-as-code (Terraform) including implementing monitoring and observability Knowledge of AI engineering workflows - particularly understanding how to build reliable systems around LLMs Problem-solving mindset and ability to navigate the challenges of creating a reliable More ❯

Technology. Responsibilities Architecture & Solution Design: Oversee the technical architecture of our solutions, ensuring they meet performance, scalability, and security requirements. Design and develop scalable AWS architectures for API-based and data-centric applications. Define data pipelines, ETL processes, and storage solutions using AWS services such as S3, OpenSearch … Redshift, Step Functions, Lambda, Glue, and Athena. Architect RESTful APIs, ensuring security, performance, and scalability. Optimise microservices architecture and API management strategies, leveraging tools such as KONG Gateway, Lambda, and EKS. Collaborate with DevOps teams to implement CI/CD pipelines, Infrastructure as Code (IaC), and automation using … AWS CloudFormation. Maintain cloud governance, security, and compliance best practices in AWS environments. Strategic & Business Impact: Work closely with the Director of Product and Technology and customers to define solutions that align with their business needs. Drive forward new strategic projects central to the success of the organisation. More ❯