51 to 75 of 83 Amazon S3 Jobs in London

Python and SQL, with experience using PySpark or similar distributed processing frameworks Experience building and maintaining data pipelines in AWS using services such as S3, Glue or EKS Hands on experience with modern analytics stacks such as Snowflake, dbt and Iceberg Familiarity with orchestration tools such as Dagster ...

structured and unstructured data sources, orchestration tooling, and distributed storage. RDS Postgres, MongoDB, AWS Athena, Parquet, AWS Glue, Airflow, Python, Docker, S3, GraphQL, REST. You won't know all of it, you'll be strong in your core area and curious about the rest. Nice to have : Python proficiency ...

including CSS, HTML and/or JQuery Solid database capability using PostgreSQL, with strong proficiency in SQL Experience working with AWS technologies such as S3, Redis caching and similar cloud services Proven understanding of authentication and security methods, including certificates, LDAP or equivalent approaches Experience with messaging and streaming ...

including CSS, HTML and/or JQuery Solid database capability using PostgreSQL, with strong proficiency in SQL Experience working with AWS technologies such as S3, Redis caching and similar cloud services Proven understanding of authentication and security methods, including certificates, LDAP or equivalent approaches Experience with messaging and streaming ...

Configuration and automation of business workflow tooling (e.g., Jira) Hands-on experience with a range of databases and storage technologies: Elastic, Mongo, Cassandra, Redis, S3 Desirable Skills PyTorch, AI/ML, NLP, LLMs Experience with the Atlassian Suite, GitHub, Linux CLI Broader data handling and advanced model-driven development ...

requests). Preferred Qualifications (A Plus) Experience with a distributed computing framework like Apache Spark (using PySpark). Familiarity with cloud data services ( AWS S3/Redshift, Azure Data Lake/Synapse, or Google BigQuery/Cloud Storage ). Exposure to workflow orchestration tools ( Apache Airflow, Prefect, or Dagster ...

exploration Redis for caching and task queues GitHub , Codeship and Heroku for seamless code review, integration and deployment Claude Code for agentic coding AWS S3 , CloudFront and Lambda for storage and content delivery Cypress for end-to-end testing Third party APIs: OpenAI, Stripe, Twilio, Sendgrid, Mailchimp and more ...

Data & Analytics, with 5+ years in leadership roles Strong hands-on experience across: Azure cloud, ADF, DevOps, Power BI, Fabric workspaces AWS cloud, S3, cross-cloud connectivity, API Gateways GCP (BigQuery, GCS, Dataflow) Deep expertise in: Databricks (Lakehouse architecture, Delta Lake, Unity Catalog, Delta Sharing, Pyspark, Spark SQL etc. ...

events and market behaviours that drive them, and the operational trade lifecycle. Strong expertise in relational databases and SQL. Proficiency with technologies such as S3, Kafka, Airflow, or Iceberg. Demonstrated experience managing large, complex financial datasets sourced from multiple vendors. Confidence working with a team that is newer ...

build, automate + delivering highly available, secure + scalable AWS Cloud environments. In-depth AWS Services expertise including: EC2, RDS, Aurora PG, VPC, S3, IAM, CloudWatch, KMS, and Amazon Linux 2023. DevOps Tools: Terraform, Jenkins, Docker + Groovy pipelines experience. Scripting: Shell, Python, PowerShell, Perl, Java. PostgreSQL ...

IAAC). Strong knowledge of distributed systems (virtualisation, Linux, Windows, containers, storage). Experience with compute (HCI/CI), backup (Cohesity), or storage (NAS, S3, SAN). Solid understanding of networking and core Internet protocols. Hands-on experience with Terraform (Enterprise), including modules, state management, and providers (e.g., Nutanix ...

agentic workflows, NLP). Strong product and systems thinking with a practical, impact-led mindset. Nice to Have AWS experience (e.g. SageMaker, Bedrock, Lambda, S3, Redshift). Familiarity with MLOps practices. Background in adtech, media, fraud, or adversarial systems. Why Join Work on technically challenging, high-scale AI problems. ...

Engineering teams to productionise models and scale data infrastructure YOUR SKILLS AND EXPERIENCE Strong experience with Python and SQL Hands-on AWS experience (Redshift, S3, Glue, Athena) Experience building data pipelines for high-volume or event-driven data Comfortable owning data systems end-to-end in production environments SALARY ...

skills and experience: Strong commercial experience in Python, SQL and cloud-based data engineering. Hands-on experience with AWS services such as Redshift, Athena, S3, Glue and ideally Kinesis. Understanding of streaming data, system performance and cost-efficient architecture. A proactive mindset with the confidence to identify and solve ...

technical solutions Evaluate new tools and technologies to improve infrastructure efficiency and scalability Skills and Experience Required: Deep knowledge of AWS (EC2, VPC, RDS, S3, CloudFront, Route 53, IAM, CloudWatch, EKS) and Microsoft Azure Experience managing and delivering within multi-cloud environments Hands-on experience with CI/… pipelines and GitOps practices (e.g. Jenkins, Bitbucket, Terraform) Experience deploying and maintaining Linux systems (Ubuntu, CentOS, RHEL, Amazon Linux) Knowledge of containerisation technologies including Docker and Kubernetes Experience with middleware technologies, including AWS SQS/SNS and API Gateway Scripting skills in Bash and/or Python Proven ...

field. You’ll have solid Python and SQL skills, experience working with data pipelines, and an understanding of cloud-based storage such as Amazon S3. Experience with tools like Databricks, Delta Lake, or BI platforms such as Power BI or Tableau would be advantageous. This organisation operates globally ...

enterprise services. Key Responsibilities: Develop: Build scalable back-end services using Python (3.10+) and FastAPI/Flask. Architect: Provision and manage AWS resources (Lambda, S3, RDS, DynamoDB, VPC) using Terraform or AWS CDK. Streamline: Own and optimize CI/CD deployment pipelines. Optimize: Monitor performance via CloudWatch and manage … Drive quality through TDD and Pair Programming within an Agile framework. Key Requirements: Languages/Frameworks: Python (Django, FastAPI, Flask). AWS Ecosystem: Lambda, S3, RDS, DynamoDB, VPC, Step Functions. API Design: RESTful, GraphQL, AppSync. IaC: Terraform or AWS CDK. CI/CD: GitLab Cloud, GitHub Actions ...

Domain experience - MUST HAVE Role Overview We are seeking an experienced AWS Data Engineer with strong expertise in ETL pipelines, Redshift, Iceberg, Athena, and S3 to support large-scale data processing and analytics initiatives in the telecom domain . The candidate will work closely with data architects, business analysts ...

data platforms such as Databricks and Snowflake. Strong knowledge of AWS data analytics services, including Redshift, EMR, Glue, Athena, Kinesis, Lake Formation, MSK, and S3 data lake patterns. Preferred Qualifications, Capabilities, and Skills Experience navigating complex data governance, security, and compliance requirements across multi-cloud and hybrid data environments. ...

with a particular focus on the Research and Development areas. Help drive migration away from legacy infrastructure. Technologies: AWS: Compute (EC2, ECS & EKS) Storage (S3, EBS, EFS & FSX) Security (IAM & SAML, Config, CloudTrail) Automation (EventBridge, Lambda) Logging & Monitoring (OpenSearch, CloudWatch, AMP, AMG) Managed Services (MWAA, MSK, Kinesis) Terraform & Terraform … building testing & deployment pipelines - especially Jenkins, TeamCity and/or ArgoCD. Good working knowledge of Linux and Docker. Kubernetes experience preferred - especially Amazon EKS. Strong scripting abilities - especially witih Python. This is an excellent opportunity to join a well-established Quant Hedge Fund with an excellent friendly culture ...

optimise RESTful APIs and contribute to GraphQL service development. Develop cloud-native solutions using AWS services such as Lambda, API Gateway, DynamoDB, ECS, S3, and others. Contribute to microservices architecture, event-driven systems, and distributed design patterns. Implement CI/CD pipelines using tools such as Jenkins, GitHub Actions … Skills & Experience Strong proficiency in Java, Spring Boot, and modern backend development. Hands-on experience with AWS cloud services (Lambda, API Gateway, DynamoDB, ECS, S3, etc.). Solid understanding of RESTful API design and exposure to GraphQL. Experience with microservices, event-driven architectures, and distributed systems. Familiarity with ...

using DMS and CDC patterns Ensure automation, scalability, and resilience across platform and data pipelines Enable event-driven and batch processing architectures (e.g., S3, Lambda) Enforce engineering standards and best practices across the platform Ensure data lineage, cataloguing, and governance are maintained Collaborate with stakeholders and contribute to technical … decision-making Required Skills & Experience Strong experience as a Platform Engineer/Cloud Engineer/DevOps Engineer Proven expertise in AWS (S3, Lambda, IAM, VPC, DMS) Strong hands-on experience with Terraform (Infrastructure-as-Code) Experience building and managing CI/CD pipelines Solid programming skills in Python ...

enterprise databases into AWS using DMS and CDC patterns Ensure migration pipelines are scalable, automated, and resilient Enable event-driven and batch data pipelines (S3, Lambda, orchestration) Ensure data lineage, cataloguing, and documentation are captured Coordinate backlog prioritisation, sprint planning, and delivery sequencing Validate deliverables for quality, performance, security … partners Lead knowledge transfer and upskilling of engineers Required Experience & Skills 5+ years in data/platform engineering, including leadership experience Strong AWS experience: S3, Lambda, IAM, VPC/networking, DMS Proven experience with Infrastructure-as-Code (Terraform) and CI/CD pipelines Experience delivering large-scale data migrations ...

Infrastructure & Cloud - Manage and evolve our AWS infrastructure via Pulumi (TypeScript): ECS/Fargate services, RDS (PostgreSQL 17), ElastiCache (Redis with read replicas), S3, SQS, ALB, Lambda - Scale infrastructure up and down for large data operations (e.g. music catalog ingestion of 1B+ rows) - Manage Cloudflare (WAF, bot management … rollout verification - Maintain test environments and cleanup automation WHAT WE'RE LOOKING FOR Must Have - Strong experience with AWS (ECS/Fargate, RDS, ElastiCache, S3, ALB, SQS at minimum) - Infrastructure-as-code experience - ideally Pulumi, but Terraform or CDK background is fine - Deep PostgreSQL knowledge: performance tuning, indexing strategies ...

What You’ll Be Working On Building and supporting APIs and microservices in production Developing backend systems using Python + AWS (Lambda, API Gateway, S3, DynamoDB) Working with event-driven systems (Kafka, SNS/SQS, etc.) Supporting and improving existing production systems Debugging real-world issues and keeping systems … stable at scale Collaborating within an existing team + codebase (pragmatic engineering) Tech Stack Python AWS (Lambda, API Gateway, S3, DynamoDB, IAM) Event-driven systems (Kafka, SNS/SQS) Databases (Postgres, DynamoDB, Couchbase) CI/CD (Concourse, Git workflows) Observability (Prometheus, Grafana, CloudWatch) What You’ll Bring Strong backend ...