176 to 200 of 216 Amazon S3 Jobs

high-performance data pipelines in Snowflake and Databricks (PySpark, Delta Lake, Unity Catalog) for batch and streaming workloads. Orchestration using Apache Airflow and Amazon tools. Engineer scalable data ingestion pipelines into AWS (DBT, SQL, PythonS3, Kinesis, Glue, Lambda, Step Functions) with strong monitoring and fault tolerance. Ensure observability … industry Expert-level proficiency in: DBT: advanced macros, Jinja, testing, exposures, dbt Cloud deployment. Databricks: Spark (PySpark, SQL), Delta Lake, Unity Catalog. Snowflake AWS: S3, Glue, Lambda, Step Functions, Datasync, EMR, Redshift, IAM and networking/security fundamentals. Data Visualization: Power BI or Tableau. Strong programming background in Python ...

Gateway (REST/HTTP), running on Lambda and containerised workloads on EC2/Fargate Model multi-tenant data across DynamoDB and RDS (PostgreSQL), using S3 for object storage and KMS for secrets and encryption Build and maintain an integrations layer including OAuth/API-key onboarding, webhook ingestion with … operating on AWS with meaningful DevOps ownership — you have shipped and run production systems Hands-on experience with Lambda, EC2/Fargate, API Gateway, S3, DynamoDB, RDS (PostgreSQL), SQS/SNS/EventBridge, CloudWatch and KMS Infrastructure as code experience with AWS SAM including templates, pipelines and parameterised stacks ...

Strong knowledge and hands on experience of the AWS Data integration stack: S3, Lambdas, Eventbridge, SQS, Step Functions etc Strong knowledge and hands on experience of Snowflake Strong knowledge and hands on experience of data transformation tools such as dbt core Strong knowledge and hands on experience with Change ...

product architecture Ensure consistency and best practice across data modelling and design Technical Environment & Experience Strong SQL skills (essential) Experience working with AWS (including S3 buckets) Exposure to data product architecture Understanding of raw data ingestion and standardisation Experience collaborating with data engineering/extract engineering teams Ability ...

Drive schema conversion and modernization strategies (heterogeneous migrations where applicable) Optimize performance of source and target systems pre- and post-migration Manage and govern S3-based data lakes and metadata using Glue Data Catalog Collaborate with application, infrastructure, and analytics teams for seamless migration and stabilization Implement monitoring, rollback … Strong experience in ETL/data pipeline development (Glue, PySpark, EMR, or equivalent) Deep proficiency in SQL and data modeling concepts Experience working with S3-based data lakes and Glue Data Catalog Strong understanding of CDC, transaction consistency, and migration cutover strategies Hands-on experience with performance tuning, schema ...

schema conversion and modernization strategies (heterogeneous migrations where applicable). Optimize performance of source and target systems pre- and post-migration. Manage and govern S3-based data lakes and metadata using Glue Data Catalog. Collaborate with application, infrastructure, and analytics teams for seamless migration and stabilization. Implement monitoring, rollback … experience in ETL/data pipeline development (Glue, PySpark, EMR, or equivalent). Deep proficiency in SQL and data modeling concepts. Experience working with S3-based data lakes and Glue Data Catalog. Strong understanding of CDC, transaction consistency, and migration cutover strategies. Hands-on experience with performance tuning, schema ...

using DMS and CDC patterns Ensure automation, scalability, and resilience across platform and data pipelines Enable event-driven and batch processing architectures (e.g., S3, Lambda) Enforce engineering standards and best practices across the platform Ensure data lineage, cataloguing, and governance are maintained Collaborate with stakeholders and contribute to technical … decision-making Required Skills & Experience Strong experience as a Platform Engineer/Cloud Engineer/DevOps Engineer Proven expertise in AWS (S3, Lambda, IAM, VPC, DMS) Strong hands-on experience with Terraform (Infrastructure-as-Code) Experience building and managing CI/CD pipelines Solid programming skills in Python ...

enterprise databases into AWS using DMS and CDC patterns Ensure migration pipelines are scalable, automated, and resilient Enable event-driven and batch data pipelines (S3, Lambda, orchestration) Ensure data lineage, cataloguing, and documentation are captured Coordinate backlog prioritisation, sprint planning, and delivery sequencing Validate deliverables for quality, performance, security … partners Lead knowledge transfer and upskilling of engineers Required Experience & Skills 5+ years in data/platform engineering, including leadership experience Strong AWS experience: S3, Lambda, IAM, VPC/networking, DMS Proven experience with Infrastructure-as-Code (Terraform) and CI/CD pipelines Experience delivering large-scale data migrations ...

design, data flow, and system integration Developing and integrating with .NET/C# backend services Deploying and supporting applications within AWS (CloudFront, S3, etc.) Designing performant, scalable user experiences for a high-traffic platform Staying hands-on while contributing to technical direction within your squad What theyre looking ...

Infrastructure & Cloud - Manage and evolve our AWS infrastructure via Pulumi (TypeScript): ECS/Fargate services, RDS (PostgreSQL 17), ElastiCache (Redis with read replicas), S3, SQS, ALB, Lambda - Scale infrastructure up and down for large data operations (e.g. music catalog ingestion of 1B+ rows) - Manage Cloudflare (WAF, bot management … rollout verification - Maintain test environments and cleanup automation WHAT WE'RE LOOKING FOR Must Have - Strong experience with AWS (ECS/Fargate, RDS, ElastiCache, S3, ALB, SQS at minimum) - Infrastructure-as-code experience - ideally Pulumi, but Terraform or CDK background is fine - Deep PostgreSQL knowledge: performance tuning, indexing strategies ...

Software Engineer to take ownership of their AWS infrastructure. THE ROLE: Key responsibilities include: Owning and maintaining AWS infrastructure (Lambda, Step Functions, DynamoDB, S3). Building and enhancing internal Python libraries (API design, releases, versioning). Managing trackers, Lambdas, Step Functions, DynamoDB tables, and API integrations (including Slack-based … lifecycle, from design through to production deployment. YOUR SKILLS AND EXPERIENCE: You will bring strong capability in: Python AWS services including Lambda, Step Functions, S3, DynamoDB, EC2/ECS. Infrastructure-as-code (Terraform or CloudFormation). CI/CD, testing, and software engineering best practices. THE BENEFITS: You will ...

analytics for FIA - responsible for getting the snowflake . Looking for 8-10 years of experience. Top Skills: Snowflake - data migration SQL Python AWS - S3, Lambda Nice to Have: GenAI tools experience In this position, you will be: Crafting, developing, and maintaining robust data pipelines. Collaborating with cross-functional … 3+ years of experience in data engineering, with exposure to data warehouse architecture. Proficiency in SQL & Python. Hand-on experience with AWS cloud platform (S3, Lamda, Glue, etc.) & Snowflake. Experience with DevOps, CI/CD. Experience in Agile methodologies. Strong problem-solving skills and the ability to take initiative. ...

managers to ensureour systems meet SLIs, SLOs, and SLA targets. Key Responsibilities Maintain and optimise production environments in AWS (EKS, EC2, RDS/Aurora, S3). Develop and maintain Infrastructure as Code using Terraform and configuration management with Ansible. Enhance monitoring, logging, and alerting using the Grafana stack (Prometheus … Skills & Experience Solid experience managing Kubernetes clusters (AWS EKS) in production. Proficient with AWS services relevant to production workloads (EKS, EC2, RDS/Aurora, S3, IAM). Infrastructure as Code with Terraform and configuration management with Ansible. Strong experience with observability tools (Grafana, Prometheus, Loki, Tempo). Understanding ...

managers to ensureour systems meet SLIs, SLOs, and SLA targets. Key Responsibilities Maintain and optimise production environments in AWS (EKS, EC2, RDS/Aurora, S3). Develop and maintain Infrastructure as Code using Terraform and configuration management with Ansible. Enhance monitoring, logging, and alerting using the Grafana stack (Prometheus … Skills & Experience Solid experience managing Kubernetes clusters (AWS EKS) in production. Proficient with AWS services relevant to production workloads (EKS, EC2, RDS/Aurora, S3, IAM). Infrastructure as Code with Terraform and configuration management with Ansible. Strong experience with observability tools (Grafana, Prometheus, Loki, Tempo). Understanding ...

analytics and modelling workflows Work with large and complex datasets using Python and R Build and deploy scalable data solutions within AWS environments (e.g. S3, Glue, Lambda, Redshift, or equivalent services) Develop dashboards and data visualisations to translate complex model outputs into clear, actionable insights for stakeholders Support backend … maintaining ETL pipelines and data workflows Experience with data engineering/data “plumbing” in cloud or distributed environments Working knowledge of AWS services (e.g. S3, Glue, Lambda, Redshift, or similar) Experience building dashboards using tools such as Power BI, Tableau, or similar Strong ability to manipulate, clean, and structure ...

. We are looking for an experienced senior software engineer to work within our Shared Services organisation, building out new capabilities within our Amazon Connect instances. You will work with existing teams to build, enhance, maintain and support our existing and future products and services. Primarily working with … Connect architecture, flows, routing profiles and telephony integration. Experience integrating with Salesforce or CRM platforms. Knowledge of AWS services such as Lambda, API Gateway, S3 and CloudWatch. Ability to design resilient, scalable and secure contact centre solutions. Strong stakeholder and operational support capability. Degree in Computer Science, Engineering ...

continuity processes DevOps & Infrastructure Manage CI/CD pipelines and automated release processes using Bitbucket Optimise and maintain AWS infrastructure including EC2, RDS, and S3 Improve monitoring, observability, reliability, and deployment automation Collaboration & Delivery Work closely with operational, product, and delivery teams to build user-focused solutions Collaborate with … MySQL , backend architecture, and API development Experience using Cursor to enhance development productivity and automation Strong experience with AWS services including EC2, RDS, and S3 Experience managing CI/CD pipelines , ideally using Bitbucket Advanced Git/version control knowledge Ability to work independently and take ownership of projects ...

enhancing the company's infrastructure and tooling strategy. Implementing and improving Infrastructure as Code (IaC) with Terraform Working across AWS services - particularly IAM, S3, EKS Managing containerisation and orchestration. Delivering robust monitoring and alerting solutions Contributing to and maintaining CI/CD pipelines Driving ISO 27000 implementation and supporting … such as vulnerability scanners, endpoint protection, SIEM, and cloud security monitoring solutions Requirements: Extensive experience in a DevOps team lead role using AWS, (IAM, S3, EKS). Experience with IaC such as Terraform.. Cloud formation/CDK is desirable. Expert knowledge in containerisation and orchestration technologies such as Docker ...

Terraform Role Overview Support secure integration between AWS-hosted data sources, Databricks workspaces and downstream enterprise data platforms. The role covers data held in S3, registered through Databricks Hive Metastore, governed or exposed through Unity Catalog, and consumed through approved connector-based patterns. Key Responsibilities Design and support secure … integration across AWS S3, Databricks and downstream data platforms. Configure least-privilege access to S3 using IAM roles, bucket policies, KMS permissions and approved access controls. Support Databricks access patterns where S3-backed data is registered through Hive Metastore and exposed or migrated into Unity Catalog. Configure ...

transferable Proven experience as a Data Engineer within central government or regulated environments Strong experience with AWS data services , including: Athena , Glue , and S3 Building and managing ETL/ELT pipelines Experience working with Azure data platforms (e.g. Azure Data Lake, Synapse, Data Factory) Strong SQL skills and experience … Responsibilities Build and maintain scalable, secure data pipelines across cloud platforms Develop ETL/ELT solutions using AWS Glue , storing and querying data in S3 and Athena Support downstream analytics and reporting, including Power BI consumption layers Ensure data quality, reliability, and performance across ingestion and transformation processes Implement ...

What You’ll Be Working On Building and supporting APIs and microservices in production Developing backend systems using Python + AWS (Lambda, API Gateway, S3, DynamoDB) Working with event-driven systems (Kafka, SNS/SQS, etc.) Supporting and improving existing production systems Debugging real-world issues and keeping systems … stable at scale Collaborating within an existing team + codebase (pragmatic engineering) Tech Stack Python AWS (Lambda, API Gateway, S3, DynamoDB, IAM) Event-driven systems (Kafka, SNS/SQS) Databases (Postgres, DynamoDB, Couchbase) CI/CD (Concourse, Git workflows) Observability (Prometheus, Grafana, CloudWatch) What You’ll Bring Strong backend ...

What You’ll Be Working On Building and supporting APIs and microservices in production Developing backend systems using Python + AWS (Lambda, API Gateway, S3, DynamoDB) Working with event-driven systems (Kafka, SNS/SQS, etc.) Supporting and improving existing production systems Debugging real-world issues and keeping systems … stable at scale Collaborating within an existing team + codebase (pragmatic engineering) Tech Stack Python AWS (Lambda, API Gateway, S3, DynamoDB, IAM) Event-driven systems (Kafka, SNS/SQS) Databases (Postgres, DynamoDB, Couchbase) CI/CD (Concourse, Git workflows) Observability (Prometheus, Grafana, CloudWatch) What You’ll Bring Strong backend ...

ecosystem. What You’ll Be Working On Designing and delivering scalable APIs and microservices Building backend systems using Python + AWS (Lambda, API Gateway, S3, DynamoDB) Handling event-driven architectures (Kafka, SNS/SQS, etc.) Driving system design decisions across distributed systems Improving observability, reliability, and performance in production … Debugging complex issues and leading resolution across teams Staying hands-on while setting technical direction and standards Tech Stack Python AWS (Lambda, API Gateway, S3, DynamoDB, IAM) Event-driven systems (Kafka, SNS/SQS) CI/CD (Concourse, Git workflows) Databases (Postgres, DynamoDB, Couchbase) Observability (Prometheus, Grafana, CloudWatch) What ...

React, ensuring high-quality, maintainable code Build and maintain cloud-native solutions across a comprehensive range of AWS services including Lambda, API Gateway, S3, SQS, SNS, EventBridge, Step Functions, and AWS Lex Implement Infrastructure as Code using Terraform to ensure consistent, scalable deployments Develop mobile applications using React Native … Strong proficiency in full-stack development with Node.js, TypeScript, and React Extensive hands-on experience with AWS services including Lambda, API Gateway, IAM, S3, SQS, SNS, EventBridge, and Step Functions Solid experience with Infrastructure as Code using Terraform Proficiency with Azure DevOps and GitHub for development workflows Experience with ...

Reporting Framework Add instrument and asset class coverage in our Trade Repository system Manage data exchange with third-party vendors via SFTP and AWS S3 Use AI coding assistants (Claude, Cursor, GitHub Copilot) to compress delivery timelines while maintaining full code ownership and quality accountability Collaborate with quant researchers … years in financial services (buy-side strongly preferred) Solid relational database skills; MS SQL Server a strong plus Snowflake experience required Familiarity with AWS (S3, Lambda, EC2, Glue or similar) Proficiency with Git, CI/CD pipelines, and observability tooling (e.g. Datadog) AI & Tooling: Proven, hands-on experience shipping ...