51 to 75 of 95 Amazon S3 Jobs in the North of England

Vector Search and Unity Catalog, or Azure OpenAI, Azure AI Foundry and Azure AI Search. AWS: Glue, Lambda, Step Functions, Kinesis, EMR, Athena, Redshift, S3 data lakes; and, for the AI edge, Amazon Bedrock, Knowledge Bases for Bedrock About Capgemini Hybrid working: The places that you work ...

task orchestration Argo CD for application deployments Airflow purely for job scheduling and tracking CircleCI for continuous deployment Parquet and Delta file formats on S3 for data lake storage Postgres/Aurora for our relational databases Spark for data processing dbt for data modelling SparkSQL for analytics Streamlit ...

highly beneficial Ability to quickly adapt to new tools and independently deliver scalable solutionsFamiliarity with data pipelines involving Kafka, Debezium, S3, Lambda, and Delta Lake is a plusApply now to find out more!Location:Newcastle upon Tyne Tyne and Wear Newcastle upon Tyne NE12 8BX Salary:50000 - 70000Sector: Data ...

from design through to deployment and supporting them in production. Skills: Java and Spring Boot REST APIs and Kafka event-driven systems AWS (including S3, Lambda, ECS, EKS, MSK) TDD, CI/CD and IaC Observability AI assisted engineering The money is good too – up to £100k plus benefits ...

role. Strong hands‐on experience designing and delivering cloud-based data platforms. Expertise with one or more of the following technologies: AWS (Redshift, Glue, S3, Bedrock) Microsoft Azure (Synapse, Data Factory, Azure SQL) Databricks (Delta Lake, ETL pipelines, ML workloads) Snowflake Strong data modelling experience across enterprise-scale environments. ...

reviews) Experience with CI/CD pipelines and automated testing Desirable Experience with C# Experience with the Tailwind framework Knowledge of AWS services (e.g., S3, CloudFront, Lambda, API Gateway) Experience of the Vitest testing framework Enterprise or large-scale application experience Personal Attributes Strong critical thinking and proactive problem ...

warehouse solutions on AWS. Develop data ingestion, transformation and storage pipelines to support reporting, analytics and operational use cases. Work with AWS services including S3, Redshift, Glue, Lambda, Lake Formation, Athena and EventBridge. Implement Bronze, Silver and Gold data layers using Medallion Architecture principles. Build and maintain ETL/… integration environments. Key skills and experience Proven experience designing and delivering AWS-based data platforms. Strong hands-on experience with services such as S3, Redshift, Glue, Lambda, Lake Formation, Athena and EventBridge. Experience implementing Medallion Architecture, including Bronze, Silver and Gold data layers. Strong data engineering experience across batch ...

data engineering solutions on AWS, including data pipelines, ETL/ELT processes, and data integration frameworks. Develop andoptimizedata architectures using AWS services such as S3, Glue, Lambda, Redshift, Kinesis, EMR, Amazon OpenSearch Service, and graph databases such as Amazon Neptune, and related technologies. Ensure solutions … pursue continuous professional development. Whatyou'llbring Considerable experiencein data engineeringfocused on AWS data platforms and services. Strong hands-on experience withAWS data servicesincluding S3, Glue, Lambda, Redshift, Athena, EMR, Kinesis, Amazon OpenSearch Service, and graph databases such as Amazon Neptune, and related technologies. Proficiencyin programming ...

security, and modern engineering practices Experience securing enterprise applications such as SAP, Salesforce, or Dynamics, and large-scale data platforms such as Data Lake, S3, or Databricks Knowledge of data loss prevention, data lifecycle management, and relevant regulations such as GDPR The ability to influence senior partners and provide ...

data modelling, database design, and advanced architectural patterns (e.g. Data Mesh, Data Lakehouse). • Strong knowledge of the AWS cloud data service ecosystem, including S3, Redshift, Glue, Lake Formation, and IAM, and how they integrate into a cohesive solution. • Extensive experience in defining and implementing enterprise data governance, security ...

role. Strong hands–on experience designing and delivering cloud‐based data platforms. Expertise with one or more of the following technologies: AWS (Redshift, Glue, S3, Bedrock) Snowflake Strong data modelling experience across enterprise–scale environments. Experience building modern AI–enabled data architectures. Knowledge of Retrieval–Augmented Generation (RAG), vector ...

delivery Experience working with Git Desirable Skills Experience with some of the following technologies would be advantageous: AWS & Cloud AWS Lambda API Gateway SQS S3 KMS CloudWatch X-Ray ECS/Fargate ECR EKS Infrastructure & DevOps Terraform Docker Kubernetes Kong Enterprise Gateway Databases MongoDB Amazon DocumentDB Messaging ...

automation, containerisation, and platform resilience using Kubernetes, Python, and DevOps best practices. Essential Skills & Experience Strong AWS experience, including services such as VPC, EC2, S3, IAM, KMS, Lambda, EMR, Athena, and Redshift. Hands-on experience with Terraform and CI/CD tools (GitLab CI, Concourse, GitHub). Strong Linux … administration experience. Experience with big data technologies including Hadoop, Hive, Spark, and Amazon EMR (or equivalent). Knowledge of monitoring, logging, and security tools. Desirable Skills Kubernetes/EKS or other container platforms. Python scripting and automation. Azure infrastructure experience. Experience with Kong, Vault, SonarQube, Tenable, Prometheus, Grafana ...

tested code for backend logic and data services.Build and optimise data pipelines on AWS to collect, transform, and serve large datasets. Work extensively with S3 (Hive-partitioned Parquet data lake), Athena for SQL querying and analysis, DynamoDB for low-latency caching, and Kinesis/SQS for streaming and queue … Software Engineer on large, production software applications.Strong Python engineering skills, including dependency and environment management with Poetry.Hands-on experience with AWS, particularly S3, Athena, DynamoDB, Kinesis, SQS, ECS, and CloudWatch.Experience building RESTful APIs and services with FastAPI.Hands-on experience with Infrastructure as code with Terraform.Containerisation with Docker.Data-engineering fundamentals ...

code for backend logic and data services. Build and optimise data pipelines on AWS to collect, transform, and serve large datasets. Work extensively with S3 (Hive-partitioned Parquet data lake), Athena for SQL querying and analysis, DynamoDB for low-latency caching, and Kinesis/SQS for streaming and queue … Software Engineer on large, production software applications. Strong Python engineering skills, including dependency and environment management with Poetry. Hands-on experience with AWS, particularly S3, Athena, DynamoDB, Kinesis, SQS, ECS, and CloudWatch. Experience building RESTful APIs and services with FastAPI.Hands-on experience with Infrastructure as code with Terraform. Containerisation ...

data security, and modern engineering practicesExperience securing enterprise applications such as SAP, Salesforce, or Dynamics, and large-scale data platforms such as Data Lake, S3, or DatabricksKnowledge of data loss prevention, data lifecycle management, and relevant regulations such as GDPRThe ability to influence senior partners and provide clear technical ...

setup, so if you've built your career on AWS this is one where that depth actually gets used. AWS across the board, including S3, Glue, Redshift, Lake Formation and Kinesis Databricks and Snowflake running on top of AWS Spark and distributed processing frameworks for large-scale data Streaming ...

RecoverySAP Cloud knowledge BTP, IAS/IAMSAP Cloud ALMOperating system experience (Linux and Windows), filesystems, scriptingCloud Service Providers Skills, AWS - EC2/VPC/S3/EFS, Azure - Compute/Networking/StorageNetworking: understanding of subnets and IP ranges, Routing, Firewall, Network tracingConnect to your business - Technology and TransformationDistinctive ...

Agile software delivery Experience working with Git Experience with some of the following technologies would be advantageous AWS & Cloud AWS Lambda API Gateway SQS S3 KMS CloudWatch X-Ray ECS/Fargate ECR EKS Infrastructure & DevOps Terraform Docker Databases MongoDB Amazon DocumentDB Messaging & Monitoring Kafka Confluent Schema ...

Either way, you'll thrive here if you: Have solid, hands-on AWS experience with a production estate. Comfortable with EKS, VPC, RDS, Lambda, S3, IAM, and CloudWatch Use Terraform as your primary IaC tool and think in version-controlled, automated infrastructure Understand CI/CD security, embedding checks … path has been unconventional, we'd love to hear from you. Our Stack Infrastructure & DevOps AWS (EKS, Lambda, RDS/Postgres, DynamoDB, SQS, Kinesis, S3, Cognito, Route53, VPC, EC2) Terraform, Kubernetes, Helm, Ansible, Puppet GitLab CI Observability & Security Prometheus, Grafana, OpenSearch, CloudWatch Okta (SSO/IdP) Vulnerability management, secrets ...

automation and migration projects to governance, security, and continuous improvement. Key Responsibilities Design, deploy, and maintain AWS cloud infrastructure using services such as EC2, S3, RDS, VPC, IAM, and Lambda. Optimise cloud environments for performance, availability, security, and cost efficiency. Develop and maintain Infrastructure as Code (IaC) solutions using … passion for delivering high-quality infrastructure solutions. Essential Experience Proven experience designing, implementing, and managing AWS environments. Strong knowledge of AWS services including EC2, S3, RDS, VPC, IAM, and CloudWatch. Hands-on experience with Infrastructure as Code tools such as Terraform and/or CloudFormation. Strong scripting and automation ...

automation and migration projects to governance, security, and continuous improvement. Key Responsibilities Design, deploy, and maintain AWS cloud infrastructure using services such as EC2, S3, RDS, VPC, IAM, and Lambda. Optimise cloud environments for performance, availability, security, and cost efficiency. Develop and maintain Infrastructure as Code (IaC) solutions using … passion for delivering high-quality infrastructure solutions. Essential Experience Proven experience designing, implementing, and managing AWS environments. Strong knowledge of AWS services including EC2, S3, RDS, VPC, IAM, and CloudWatch. Hands-on experience with Infrastructure as Code tools such as Terraform and/or CloudFormation. Strong scripting and automation ...

ability to work collaboratively as part of a multidisciplinary team. A proactive approach and willingness to learn. Knowledge of cloud storage solutions such as S3 would be beneficial but isn't essential. Previous DevOps experience would be an advantage, but motivation, aptitude and the desire to develop are just ...

robust ETL/ELT processes for ingesting, transforming and processing data from multiple sources Design and implement data solutions using AWS services such as S3, Glue, Lambda, Athena, Redshift, EMR and related technologies Design data models and storage approaches appropriate to analytical and operational requirements Develop solutions using Python … Data Engineer, ideally within complex enterprise environments Strong experience designing and delivering data solutions on AWS Strong knowledge of AWS data services such as S3, Glue, Lambda, Athena, Redshift and EMR, with experience selecting the appropriate services for different requirements Strong Python and SQL skills Experience designing and building ...

Federation Design, develop and maintain Python backend services Build and operate cloud-native solutions using AWS services including Lambda, API Gateway, CloudFront, WAF, DynamoDB, S3 and CloudWatch Develop infrastructure and application deployments using Infrastructure as Code (Terraform) Develop and maintain CI/CD pipelines to automate build, test … Strong hands-on experience with Python Practical experience of AWS cloud services and cloud-native architecture, particularly Lambda, API Gateway, CloudFront, WAF, DynamoDB and S3 Hands-on experience with Infrastructure as Code, particularly Terraform Experience developing and maintaining CI/CD pipelines and using Git/GitHub Experience with ...