126 to 150 of 387 Amazon S3 Jobs in the UK

them via Astronomer (Airflow), and establish governed warehousing in Databricks. Requirements Required Skills & Technologies Cloud Platforms: Hands‐on engineering experience within the AWS ecosystem (S3, IAM, Glue) and deep expertise in Databricks (SparkSQL, PySpark, governed cataloging). Modern Data Stack: Strong proficiency in dbt (Core or Cloud) for data … project managers. Job responsibilities Lakehouse Engineering: Build and maintain scalable data pipelines to migrate Consumer Risk datasets from Teradata to Amazon S3, utilising Apache Iceberg for the lakehouse layer and Databricks for governed warehousing. Code Modernisation (BTEQ to dbt): Perform complex code conversions, transforming ...

them via Astronomer (Airflow), and establish governed warehousing in Databricks. Requirements Required Skills & Technologies Cloud Platforms: Hands-on engineering experience within the AWS ecosystem (S3, IAM, Glue) and deep expertise in Databricks (SparkSQL, PySpark, governed cataloging). Modern Data Stack: Strong proficiency in dbt (Core or Cloud) for data … project managers. Job responsibilities Lakehouse Engineering: Build and maintain scalable data pipelines to migrate Consumer Risk datasets from Teradata to Amazon S3, utilizing Apache Iceberg for the lakehouse layer and Databricks for governed warehousing. Code Modernization (BTEQ to dbt): Perform complex code conversions, transforming ...

Service) for Ubuntu. K3s + KubeVirt: Build a self-provisioning VM environment to empower developers and QA engineers. Infinia & Harbor: Utilize Infinia for S3 storage services, and Harbor for container image management. GitHub Enterprise (GHE) + Actions: Collaborate using GHE, with DevOps leading the development and maintenance of workflow ...

complex service end-to-end. Technical Proficiency: Strong experience with Python for building backend services and data pipelines. Familiarity with AWS services (e.g. S3, RDS/Postgres, Kinesis, ECS, Lambda) and infrastructure tooling (Terraform).Data Ingestion: Experience designing pipelines that handle varied, schema-evolving, high-volume payloads reliably ...

data pipelines that other people relied on. Comfortable with infrastructure as code , ideally Terraform, and hands-on with AWS, for example Lambda, ECS, Glue, S3, RDS. A good grasp of ETL/ELT and orchestration . Experience building or running data integrations and connectors , especially ones that other companies ...

production data pipelines that other people relied on Comfortable with infrastructure as code, ideally Terraform Hands-on AWS experience, for example Lambda, ECS, Glue, S3, and RDS Good grasp of ETL/ELT and orchestration Experience building or running data integrations and connectors is a plus Solid software engineering ...

grasp of distributed computingBachelor's degree, preferably in Computer Science, Engineering, Mathematics, or similar technical disciplineNice to haveSnowflake SQL expertiseAWS Cloud experience – Including EC2 & S3 experienceAirflow/MWAA or equivalent job scheduler experienceKubernetes, EKS, Lambda or serverless experience in AWS as beneficialMessaging layer experience ZMQ, RabbitMQ, Kafka etc. Personal ...

maintaining and running production infrastructure using IAC (preferably Terraform); Familiarity with core AWS services, we actively use Elastic Container Service, Lambdas, CloudFront, API Gateway, S3, RDS, Route53, API Gateway, ElastiCache; Knowledge of cloud CI/CD systems, preferably GitHub Actions, with an understanding of how to handle secrets ...

Infrastructure as Code (e.g. Terraform) Observability (e.g. Grafana, Loki) Scripting and automation (e.g. Python, Bash) Cloud and networking fundamentals (e.g. AWS IAM, S3, network policies) Experience delivering within the UK Government Digital Service (GDS) lifecycle on a public sector engagement. Experience working with and leading distributed and hybrid teams. ...

Prometheus, Grafana, Datadog, Zabbix)Logging and tracing (e.g., ELK stack, Fluentd, OpenTelemetry, JaegerIdentity and access management (e.g., LDAP, Kerberos, OAuth2)Cloud-native services (e.g., S3, EBS, GKE, EKS, Cloud Functions)Git-based workflows and version controlAgile methodologies and DevOps cultureTest-driven infrastructure development and automated testing frameworksBachelor ...

solve complex infrastructure challenges. What you will do... Designing, securing, and automating our AWS cloud infrastructure, managing core services including EC2, ECS, Fargate, S3, and RDS. Progressing and establishing our foundational AWS Control Tower and Landing Zones architecture. Executing Cloud Security Posture Management (CSPM) and vulnerability management using tools ...

solve complex infrastructure challenges. What you will do... Designing, securing, and automating our AWS cloud infrastructure, managing core services including EC2, ECS, Fargate, S3, and RDS. Progressing and establishing our foundational AWS Control Tower and Landing Zones architecture. Executing Cloud Security Posture Management (CSPM) and vulnerability management using tools ...

likely bring: Experience building and supporting production data solutions. Strong knowledge of AWS cloud services, including technologies such as Amazon S3, EKS, Lambda, SNS, EventBridge, and IAM. Strong coding skills in Python and SQL, with exposure to Java or Scala being beneficial. Experience with technologies such ...

experience with SQLExperience with Data Warehouse databases like Snowflake/Redshift/BigQueryExperience with PythonPreferably have some knowledge of AWS and components such as S3, Kinesis, DMS, SNS, Glue, Athena, RDSExperience with implementing Rest APIs. Business Intelligence (BI) knowledge/experienceKnowledge on tools like Terraform, Airflow, DBT and HarnessModern ...

Engineering DegreeExperience in building complex data pipelines/ETL/ELT scriptsExtensive experience with SQLExcellent knowledge of AWS and components such as S3, Kinesis, DMS, SNS, Glue, Athena, RDSExperience with Data Warehouse databases like Snowflake/Redshift/BigQueryExperience with Python/PySparkExperience with implementing Rest APIs. Business Intelligence ...

Engineering DegreeExperience in building complex data pipelines/ETL/ELT scriptsExtensive experience with SQLExcellent knowledge of AWS and components such as S3, Kinesis, DMS, SNS, Glue, Athena, RDSExperience with Data Warehouse databases like Snowflake/Redshift/BigQueryExperience with Python/PySparkExperience with implementing Rest APIs. Business Intelligence ...

owners, and other team members to clarify requirements and ensure high-quality software delivery within iterative development cycles. AWS Familiarity: Experience with AWS services (S3, Lambda, EC2, CloudWatch) in test environments. SQL Expertise: Validating data and back-end testing using SQL; writing complex queries for functional/integration testing. ...

Jupyter Notebooks Strong understanding of predictive modelling and machine learning techniques Experience with NLP and Large Language Models (LLMs) Familiarity with AWS services, including S3, SageMaker and Lambda Experience or knowledge of Microsoft Fabric Understanding of the machine learning model development and deployment lifecycle Strong analytical and problem-solving ...

Jupyter Notebooks Strong understanding of predictive modelling and machine learning techniques Experience with NLP and Large Language Models (LLMs) Familiarity with AWS services, including S3, SageMaker and Lambda Experience or knowledge of Microsoft Fabric Understanding of the machine learning model development and deployment lifecycle Strong analytical and problem-solving ...

producing high-quality, maintainable software. Nice to Have Experience with Vue.js/Nuxt 3/JavaScript. Experience working with AWS, including EC2, RDS, Lambda, S3 or Bedrock. Experience integrating OpenAI, Anthropic or other commercial AI APIs. Experience developing AI-powered features within commercial applications. Microservices and distributed systems experience. ...

Languages & Frameworks Python (Flask, SQLAlchemy, NumPy, Pandas) for services and analytics React, Typescript, Redux for the front end Cloud & Infrastructure AWS (ECS, Lambda, RDS, S3) Docker Linux Data, Messaging & Caching MySQL RabbitMQ Redis Tooling & DevOps GitLab for source control and CI/CD AI & Automation AI Agents & Assistants used ...

before although it would be a plus. Advanced, hands-on knowledge of a wide range of AWS services, including but not limited to EC2, S3, GuardDuty, Lambda, ECS, and EKS Practical experience with Kubernetes, ideally EKS. Experience threat modelling web applications and responding to real security incidents. Experience using ...

outputs (eval sets, LLM-as-judge, regression testing).Strong backend skills in TypeScript/Node.js, with solid API design. Cloud experience (AWS: Lambda, ECS, S3, or similar).Database proficiency across SQL (Postgres) and some NoSQL exposure. Demonstrated ability to mentor and coach other engineers. Uses AI coding assistants (Copilot ...

surface is interesting. Our Tech Stack Backend: Go, TypeScript, Python Frontend: React, TypeScript Cloud: AWS (Lambda, EC2, ECS Fargate, Aurora PostgreSQL/MySQL, S3, SQS/SNS), Vercel AI Infrastructure: AWS Bedrock, Langfuse, Vercel AI Gateway Infrastructure: Terraform, GitHub Actions Data: Large-scale PostgreSQL, ClickHouse, Turbopuffer Agent tooling: Claude ...

your own experience to influence the team and platform. What you'll be doing... Design, implement, and maintain scalable infrastructure using AWS services (EC2, S3, Elastic IPs, Glacier, SQS, Lambda).Manage and orchestrate containers using Docker and KubernetesDesign and maintain a queue-based processing pipeline using RabbitMQ ...