176 to 200 of 219 Amazon S3 Jobs

RabbitMQ, Redis, MongoDB, PostgreSQL, NGINX and F5 load balancers, VMware vSphere, HashiCorp Vault, Keycloak, ArgoCD, Helm Charts, SonarQube, Snyk. Implement object storage platforms using S3-compatible storage and MinIO. Setting up Apache Airflow, Cisco NSO, Itential at platform level. Develop, test and maintain backup and disaster recovery strategies. DevOps ...

enterprise-scale data solutions Deep expertise in data modelling techniques with strong SQL proficiency Good knowledge of cloud data platforms (AWS preferred: Redshift, Athena, S3, Glue, knowledge of Azure or GCP beneficial) and modern data engineering patterns including ETL/ELT Experience with data governance frameworks, data quality tools ...

field. You’ll have solid Python and SQL skills, experience working with data pipelines, and an understanding of cloud-based storage such as Amazon S3. Experience with tools like Databricks, Delta Lake, or BI platforms such as Power BI or Tableau would be advantageous. This organisation operates globally ...

works well across teams Comfortable using AI tools to improve productivity and learning Nice to Have Experience with AWS data tools such as S3, Spark, Athena, or workflow orchestration tools Exposure to AI-assisted workflows Why Join You will join a team that values growth, collaboration, and continuous improvement ...

experience with PyTorch or TensorFlow (LLMs and/or CV). Data engineering: PySpark, SQL, Postgres, data modeling, query tuning. Cloud data platforms (Databricks, S3/Snowflake/Azure/GCP). Experiment design, statistical validation, and error analysis. HITL lifecycle design and feedback integration. Nice to Have Additional ...

include: Developing, testing, and deploying high-quality code primarily using Java and Spring Boot . Designing and implementing cloud-native applications on AWS (Amazon Web Services). Contributing to the front-end development using JavaScript . Collaborating with product managers, designers, and other engineers to define and deliver … consultancy to be suitable for this role. Strong working knowledge of the Spring Boot framework. Hands-on experience with AWS (e.g., EC2, S3, Lambda, RDS). Familiarity with JavaScript for front-end development. Experience with relational and/or NoSQL databases. Solid understanding of software development principles, design patterns ...

include: Developing, testing, and deploying high-quality code primarily using Java and Spring Boot . Designing and implementing cloud-native applications on AWS (Amazon Web Services). Contributing to the front-end development using JavaScript . Collaborating with product managers, designers, and other engineers to define and deliver … Essential Skills: Proven experience as a Java Developer . Strong working knowledge of the Spring Boot framework. Hands-on experience with AWS (e.g., EC2, S3, Lambda, RDS). Familiarity with JavaScript for front-end development. Experience with relational and/or NoSQL databases. Solid understanding of software development principles ...

enterprise services. Key Responsibilities: Develop: Build scalable back-end services using Python (3.10+) and FastAPI/Flask. Architect: Provision and manage AWS resources (Lambda, S3, RDS, DynamoDB, VPC) using Terraform or AWS CDK. Streamline: Own and optimize CI/CD deployment pipelines. Optimize: Monitor performance via CloudWatch and manage … Drive quality through TDD and Pair Programming within an Agile framework. Key Requirements: Languages/Frameworks: Python (Django, FastAPI, Flask). AWS Ecosystem: Lambda, S3, RDS, DynamoDB, VPC, Step Functions. API Design: RESTful, GraphQL, AppSync. IaC: Terraform or AWS CDK. CI/CD: GitLab Cloud, GitHub Actions ...

products meet high standards of usability, functionality, and scalability. Strong experience with Amazon Web Services (AWS) including basic services such as EC2, S3, AMIs, and Virtual Private Clouds (VPCs). Strong experience with infrastructure-as-code (IAC) using Ansible and/or Puppet. Design, develop, and test … oversight on large-scale software projects. 5 years of experience in Amazon Web Services (AWS) including basic services such as EC2, S3, AMIs, and VPCs. 3 years of experience with infrastructure-as-code (IAC) using Ansible and/or Puppet. 5 years of experience using open-source ...

Domain experience - MUST HAVE Role Overview We are seeking an experienced AWS Data Engineer with strong expertise in ETL pipelines, Redshift, Iceberg, Athena, and S3 to support large-scale data processing and analytics initiatives in the telecom domain . The candidate will work closely with data architects, business analysts ...

Utilise Databricks (Unity Catalog, Delta Lake, MLflow) to ingest, process, and analyse large-scale structured and unstructured data from diverse sources (e.g., SAP Datasphere, S3). · Algorithm Versatility: Apply a wide range of ML techniques, including time-series forecasting (e.g., Prophet, XGBoost, LSTMs), statistical modelling, Bayesian Modelling and optimization ...

data platforms such as Databricks and Snowflake. Strong knowledge of AWS data analytics services, including Redshift, EMR, Glue, Athena, Kinesis, Lake Formation, MSK, and S3 data lake patterns. Preferred Qualifications, Capabilities, and Skills Experience navigating complex data governance, security, and compliance requirements across multi-cloud and hybrid data environments. ...

with a particular focus on the Research and Development areas. Help drive migration away from legacy infrastructure. Technologies: AWS: Compute (EC2, ECS & EKS) Storage (S3, EBS, EFS & FSX) Security (IAM & SAML, Config, CloudTrail) Automation (EventBridge, Lambda) Logging & Monitoring (OpenSearch, CloudWatch, AMP, AMG) Managed Services (MWAA, MSK, Kinesis) Terraform & Terraform … building testing & deployment pipelines - especially Jenkins, TeamCity and/or ArgoCD. Good working knowledge of Linux and Docker. Kubernetes experience preferred - especially Amazon EKS. Strong scripting abilities - especially witih Python. This is an excellent opportunity to join a well-established Quant Hedge Fund with an excellent friendly culture ...

optimise RESTful APIs and contribute to GraphQL service development. Develop cloud-native solutions using AWS services such as Lambda, API Gateway, DynamoDB, ECS, S3, and others. Contribute to microservices architecture, event-driven systems, and distributed design patterns. Implement CI/CD pipelines using tools such as Jenkins, GitHub Actions … Skills & Experience Strong proficiency in Java, Spring Boot, and modern backend development. Hands-on experience with AWS cloud services (Lambda, API Gateway, DynamoDB, ECS, S3, etc.). Solid understanding of RESTful API design and exposure to GraphQL. Experience with microservices, event-driven architectures, and distributed systems. Familiarity with ...

high-performance data pipelines in Snowflake and Databricks (PySpark, Delta Lake, Unity Catalog) for batch and streaming workloads. Orchestration using Apache Airflow and Amazon tools. Engineer scalable data ingestion pipelines into AWS (DBT, SQL, PythonS3, Kinesis, Glue, Lambda, Step Functions) with strong monitoring and fault tolerance. Ensure observability … industry Expert-level proficiency in: DBT: advanced macros, Jinja, testing, exposures, dbt Cloud deployment. Databricks: Spark (PySpark, SQL), Delta Lake, Unity Catalog. Snowflake AWS: S3, Glue, Lambda, Step Functions, Datasync, EMR, Redshift, IAM and networking/security fundamentals. Data Visualization: Power BI or Tableau. Strong programming background in Python ...

Gateway (REST/HTTP), running on Lambda and containerised workloads on EC2/Fargate Model multi-tenant data across DynamoDB and RDS (PostgreSQL), using S3 for object storage and KMS for secrets and encryption Build and maintain an integrations layer including OAuth/API-key onboarding, webhook ingestion with … operating on AWS with meaningful DevOps ownership — you have shipped and run production systems Hands-on experience with Lambda, EC2/Fargate, API Gateway, S3, DynamoDB, RDS (PostgreSQL), SQS/SNS/EventBridge, CloudWatch and KMS Infrastructure as code experience with AWS SAM including templates, pipelines and parameterised stacks ...

Strong knowledge and hands on experience of the AWS Data integration stack: S3, Lambdas, Eventbridge, SQS, Step Functions etc Strong knowledge and hands on experience of Snowflake Strong knowledge and hands on experience of data transformation tools such as dbt core Strong knowledge and hands on experience with Change ...

ready to step into a leadership role with true operational ownership. Technical Literacy: You are comfortable "under the hood" of AWS (IAM, S3, VPCs) and GitHub . You don't need to be a full-time coder, but you must be able to navigate and secure our infrastructure. ...

Drive schema conversion and modernization strategies (heterogeneous migrations where applicable) Optimize performance of source and target systems pre- and post-migration Manage and govern S3-based data lakes and metadata using Glue Data Catalog Collaborate with application, infrastructure, and analytics teams for seamless migration and stabilization Implement monitoring, rollback … Strong experience in ETL/data pipeline development (Glue, PySpark, EMR, or equivalent) Deep proficiency in SQL and data modeling concepts Experience working with S3-based data lakes and Glue Data Catalog Strong understanding of CDC, transaction consistency, and migration cutover strategies Hands-on experience with performance tuning, schema ...

schema conversion and modernization strategies (heterogeneous migrations where applicable). Optimize performance of source and target systems pre- and post-migration. Manage and govern S3-based data lakes and metadata using Glue Data Catalog. Collaborate with application, infrastructure, and analytics teams for seamless migration and stabilization. Implement monitoring, rollback … experience in ETL/data pipeline development (Glue, PySpark, EMR, or equivalent). Deep proficiency in SQL and data modeling concepts. Experience working with S3-based data lakes and Glue Data Catalog. Strong understanding of CDC, transaction consistency, and migration cutover strategies. Hands-on experience with performance tuning, schema ...

using DMS and CDC patterns Ensure automation, scalability, and resilience across platform and data pipelines Enable event-driven and batch processing architectures (e.g., S3, Lambda) Enforce engineering standards and best practices across the platform Ensure data lineage, cataloguing, and governance are maintained Collaborate with stakeholders and contribute to technical … decision-making Required Skills & Experience Strong experience as a Platform Engineer/Cloud Engineer/DevOps Engineer Proven expertise in AWS (S3, Lambda, IAM, VPC, DMS) Strong hands-on experience with Terraform (Infrastructure-as-Code) Experience building and managing CI/CD pipelines Solid programming skills in Python ...

enterprise databases into AWS using DMS and CDC patterns Ensure migration pipelines are scalable, automated, and resilient Enable event-driven and batch data pipelines (S3, Lambda, orchestration) Ensure data lineage, cataloguing, and documentation are captured Coordinate backlog prioritisation, sprint planning, and delivery sequencing Validate deliverables for quality, performance, security … partners Lead knowledge transfer and upskilling of engineers Required Experience & Skills 5+ years in data/platform engineering, including leadership experience Strong AWS experience: S3, Lambda, IAM, VPC/networking, DMS Proven experience with Infrastructure-as-Code (Terraform) and CI/CD pipelines Experience delivering large-scale data migrations ...

design, data flow, and system integration Developing and integrating with .NET/C# backend services Deploying and supporting applications within AWS (CloudFront, S3, etc.) Designing performant, scalable user experiences for a high-traffic platform Staying hands-on while contributing to technical direction within your squad What theyre looking ...

Infrastructure & Cloud - Manage and evolve our AWS infrastructure via Pulumi (TypeScript): ECS/Fargate services, RDS (PostgreSQL 17), ElastiCache (Redis with read replicas), S3, SQS, ALB, Lambda - Scale infrastructure up and down for large data operations (e.g. music catalog ingestion of 1B+ rows) - Manage Cloudflare (WAF, bot management … rollout verification - Maintain test environments and cleanup automation WHAT WE'RE LOOKING FOR Must Have - Strong experience with AWS (ECS/Fargate, RDS, ElastiCache, S3, ALB, SQS at minimum) - Infrastructure-as-code experience - ideally Pulumi, but Terraform or CDK background is fine - Deep PostgreSQL knowledge: performance tuning, indexing strategies ...

Software Engineer to take ownership of their AWS infrastructure. THE ROLE: Key responsibilities include: Owning and maintaining AWS infrastructure (Lambda, Step Functions, DynamoDB, S3). Building and enhancing internal Python libraries (API design, releases, versioning). Managing trackers, Lambdas, Step Functions, DynamoDB tables, and API integrations (including Slack-based … lifecycle, from design through to production deployment. YOUR SKILLS AND EXPERIENCE: You will bring strong capability in: Python AWS services including Lambda, Step Functions, S3, DynamoDB, EC2/ECS. Infrastructure-as-code (Terraform or CloudFormation). CI/CD, testing, and software engineering best practices. THE BENEFITS: You will ...