51 to 75 of 77 Amazon S3 Jobs in the City of London

pipelines are optimized for performance, reliability, and maintainability. 🌳 AWS Expertise: Utilize AWS services for data storage, processing, and analytics. Leverage AWS technologies such as S3, Glue, Redshift, and others to build and maintain data solutions. Implement best practices for security and compliance in an AWS environment. 🌳 Python Programming: Demonstrate ...

performance, quality, and scalability standards Skills Proven experience delivering data engineering solutions in AWS environments Strong hands-on experience with AWS services including Redshift, S3, Lambda, and DynamoDB Advanced SQL and Python development skills Experience integrating data via APIs Tableau dashboard development and data visualisation experience ...

Designing and developing scalable, testable data pipelines using Python and Apache Spark • Orchestrating data workflows with AWS tools like Glue, EMR Serverless, Lambda, and S3 • Applying modern software engineering practices: version control, CI/CD, modular design, and automated testing • Contributing to the development of a lakehouse architecture using ...

Experience designing and delivering ML solutions across the full lifecycle, from experimentation to production Strong knowledge of AWS-based ML services (e.g. SageMaker, Lambda, S3) in production environments Experience with experiment design, hypothesis testing, A/B testing and statistical evaluation Proven ability to transition validated models into production ...

fast-paced environment. Strong software development experience with Python and Django in a professional environment. Solid understanding of AWS services—ideally including S3, Transfer Family, EC2 and RDS. Experience across the full software development lifecycle (design, build, testing, deployment). Excellent written and verbal communication skills, and confidence interacting ...

payment processing and subscription management (Stripe) Design and manage user databases and data models (MongoDB, PostgreSQL) Implement asset storage, retrieval, and management systems (AWS S3) Build job queue management for async ML workflows (SNS, SQS) Setup application monitoring and logging (CloudWatch, Grafana, Prometheus) Implement CI/CD for application ...

development and optimisation. Strong skills in Python and SQL for ELT/ETL and transformation workflows. Experience with cloud native storage and compute tools: S3, Data Lake, ADF, Redshift, Synapse, etc. Familiarity with CI/CD pipelines, test automation, and DevOps practices in data workflows. Stakeholder management Career & Development ...

Data Engineering , ideally in cloud-native or AI-oriented environments. Strong Python skills for data pipeline and service development. Proficiency with AWS (Lambda, S3, Glue) and orchestration tools (Airflow, Dagster, etc.). Familiarity with relational and vector databases (PostgreSQL, Pinecone, MySQL). Understanding of API development and event-driven ...

monitoring frameworks Explainability tooling Essential Strong experience in MLOps/ML platform engineering Solid Python skills Hands-on experience with AWS, particularly SageMaker and S3 Experience with Docker and CI/CD pipelines Background building or maintaining ETL/orchestration workflows Experience using MLflow or a similar experiment tracking ...

Lead by example — fostering collaboration, accountability, and agile delivery in every sprint. 🧠 What You Bring Expertise in AWS : Hands-on experience with Python, Glue, S3, Airflow, DBT, Redshift, and RDS. Proven success in end-to-end data engineering — from ingestion to insight. Strong leadership and communication skills, with ...

Python , R , and data science libraries (Pandas, NumPy, Scikit-learn, TensorFlow, PyTorch). Expertise in multi-cloud environments (AWS, Azure, GCP) including services like S3, BigQuery, Azure ML, etc. Solid understanding of data engineering principles , SQL, and distributed computing frameworks (Spark, Hadoop). Experience in consulting or client-facing ...

publications in relevant areas Tech stack • ML/AI: PyTorch, MLflow, SageMaker, ZenML • Infrastructure: AWS, Kubernetes, Docker • Edge deployment: CoreML, ONNX • Data: Python, S3, multimodal sensor data pipelines • Collaboration: JIRA, Git, structured OKR methodology Why you will enjoy working with our client: You’ll join a small, growing ...

/ML, and BI capabilities across the enterprise. 2. Cloud Data Enablement Architect and implement cloud-native data solutions using AWS (Redshift, Glue, S3, Athena), Azure (Synapse, Data Factory, Databricks), or GCP (BigQuery, Dataflow, Pub/Sub). Guide the migration of on-premise data assets to cloud environments ...

data engineer who has hands-on experience in AWS to conduct end-to-end data analysis and data pipeline build-out using Python, Glue, S3, Airflow, DBT, Redshift, RDS, etc. Extensive Python API design experience, preferably Fast API Strong SQL knowledge Nice to have skills Pyspark Databricks ETL design ...

long term reliability What they are looking for: • Strong experience in data engineering and cloud based data platforms • Experience with AWS services such as S3, Redshift and Lambda is ideal, but open to cloud agnostic and Azure backgrounds with lakehouse expertise • Hands on experience with Airflow, dbt and Kafka ...

modern approach to data delivery. Skills & Experience Needed Strong background in data engineering, especially within AWS environments. Hands-on experience with services such as S3, Redshift , and other AWS data ecosystem tools. Familiarity with modern data stack tools: Airflow, dbt, Airbyte (or similar). Proficient in building automated pipelines ...

layer) Channel Analytics Data Lake (long-term historical layer) Define and expose status and statement APIs with clear SLAs. Architect AWS lakehouse solutions using S3, Glue, Athena, Iceberg, and Redshift . Enable analytics and dashboards using Amazon QuickSight . Streaming & Event-Driven Design Build event-driven pipelines … with Schema Registry , schema evolution & governance Proven experience in ISO 20022 payments messaging (PAIN, PACS, CAMT, SWIFT MX) Strong background in AWS Lakehouse using S3, Glue, Athena, Iceberg , Redshift Experience using Amazon EventBridge for event routing/orchestration Solid understanding of data modeling, CQRS, event sourcing ...

Strong JavaScript/TypeScript development background 👉🏼 Solid knowledge of state management, REST APIs, HTTP, async programming 👉🏼 Hands-on experience integrating with AWS (Cognito, Amplify, S3) 👉🏼 Experience working with app stores (Apple/Google Play) 👉🏼 Ability to contribute to architecture, code quality, and best practices 👉🏼 Start-up/scale ...

implement, and manage AWS cloud architecture ensuring scalability, resilience, and high availability Automate infrastructure and application provisioning, configuration, and deployment Manage containerised environments (Amazon ECS) and serverless workloads (AWS Lambda) Provide 3rd line support and escalation for complex infrastructure issues Optimise and maintain cloud-managed network environments Implement … background as a Cloud Engineer, AWS Solutions Architect, or DevOps Engineer Extensive hands-on experience with AWS services including CloudFormation, ECS, Lambda, EC2, and S3 Strong Linux system administration and scripting skills (Bash, Python, or similar) Experience with infrastructure automation and configuration management Strong knowledge of AWS security principles ...

ahead of the curve in Generative AI, ML infrastructure, and cloud-native tooling. Tech Stack Programming: Python (Java familiarity is a plus). AWS: S3, Kinesis, Glue, Lambda, Step Functions, SageMaker, and more. On-Prem: Managed Kubernetes Platform and Hadoop ecosystem. Why This Role is Different Direct Impact: Build … Python; passion for code quality and testing. Demonstrable experience applying GenAI concepts to front-office/capital markets environments. Deep experience with AWS services (S3, Glue, Kinesis, Lambda, ECS, IAM, KMS, API Gateway, Step Functions, MSK, CloudFormation). Passion for being hands-on while enabling and growing a small ...

ahead of the curve in Generative AI, ML infrastructure, and cloud-native tooling. Tech Stack Programming: Python (Java familiarity is a plus). AWS: S3, Kinesis, Glue, Lambda, Step Functions, SageMaker, and more. On-Prem: Managed Kubernetes Platform and Hadoop ecosystem. Why This Role is Different Direct Impact: Build … code quality and testing. Demonstrable experience applying Generative AI concepts (ideally in a front-office/capital market environment) Experience with AWS services (S3, Glue, Kinesis, Lambda, ECS, IAM, KMS, API Gateway, Step Functions, MSK, CloudFormation). Experience working in a fast-paced front-office environment in either engineering ...

high-quality delivery. Set technical direction across Python services, distributed systems, and large-scale data processing. Work heavily with AWS — especially Redshift, Lambda, ECS, S3 , plus data formats like Parquet . Shape high-throughput data pipelines and SQL-based workflows , ensuring scalability and performance. Run technical design reviews , guide … Design to define technical requirements, prioritise roadmaps, and drive measurable outcomes. Tech Environment You’ll Influence Primary language: Python AWS stack: Redshift, Lambda, ECS, S3 Data workflows: Parquet, SQL, distributed data pipelines Scale: systems processing hundreds of millions to billions of rows Focus areas: performance tuning, reliability, cost optimisation ...

once semantics. EventBridge for event routing and filtering. • Schema Management: Avro/Protobuf + Schema Registry (compatibility, subject strategy, evolution). • AWS Data Stack: S3/Glue/Athena, Redshift, Step Functions, Lambda; Iceberg-ready lakehouse patterns. Kinesis→S3→Glue streaming pipelines; Glue Streaming; DLQ patterns. • Payments ...

once semantics. EventBridge for event routing and filtering. Schema management: Avro/Protobuf + Schema Registry (compatibility, subject strategy, evolution). AWS data stack: S3/Glue/Athena, Redshift, Step Functions, Lambda; Iceberg-ready lakehouse patterns. Kinesis→S3→Glue streaming pipelines; Glue Streaming; DLQ patterns. Payments ...

Fullstack Engineer - Up to £60k - 2 Days onsite - Fulham I am currently working with an excting SaaS client who has built out a Risk management solutions platform. Their primary focus is to provide businesses with ...