Central London, London, United Kingdom Hybrid / WFH Options
Halian Technology Limited
ensure software quality Collaborate on system design and architecture in a distributed AWS environment Implement CI/CD pipelines and deploy applications using AWS services (e.g., ECS, Lambda, DynamoDB, S3) Participate in code reviews, sprint planning, and retrospectives Monitor and troubleshoot production systems; respond to incidents when needed Required Skills & Experience: 3+ years of professional software engineering experience Strong More ❯
Continuous Integration/Continuous Deployment. Desirable Experience extracting, loading and transforming large data sets (>100GBs). Experience with schema evolution tools such as flyway or liquibase. Experience with AWS (S3, IAM, RDS). Translate internal data user needs into building BI Dashboards to answer their key business questions. Data capabilities outside of engineering (e.g. data catalogue, data modelling, data More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Morgan Hunt Recruitment
the system components Essential Skills: Significant commercial experience with the following technology: * Java 17+ * Spring boot microservices * Data modelling and SQL development, ideally PostgreSQL * REST APIs * AWS, AWS Lambda, S3, Typescript * Modern DevOps and CI/CD practices including deployment pipelines Details:- 6 month contract Remote role (with very occasional office attendance, average 1 day every 6 months More ❯
in database technologies (SQL Server, Redshift, PostgreSQL, Oracle). Desirable Skills: Familiarity with machine learning pipelines and MLOps practices. Additional experience with Databricks and specific AWS such as Glue, S3, Lambda Proficient in Git, CI/CD pipelines, and DevOps tools (e.g., Azure DevOps) Hands-on experience with web scraping, REST API integrations, and streaming data pipelines. Knowledge of More ❯
City of London, London, United Kingdom Hybrid / WFH Options
Publicis Production
in database technologies (SQL Server, Redshift, PostgreSQL, Oracle). Desirable Skills: Familiarity with machine learning pipelines and MLOps practices. Additional experience with Databricks and specific AWS such as Glue, S3, Lambda Proficient in Git, CI/CD pipelines, and DevOps tools (e.g., Azure DevOps) Hands-on experience with web scraping, REST API integrations, and streaming data pipelines. Knowledge of More ❯
london, south east england, united kingdom Hybrid / WFH Options
Publicis Production
in database technologies (SQL Server, Redshift, PostgreSQL, Oracle). Desirable Skills: Familiarity with machine learning pipelines and MLOps practices. Additional experience with Databricks and specific AWS such as Glue, S3, Lambda Proficient in Git, CI/CD pipelines, and DevOps tools (e.g., Azure DevOps) Hands-on experience with web scraping, REST API integrations, and streaming data pipelines. Knowledge of More ❯
london (city of london), south east england, united kingdom Hybrid / WFH Options
Publicis Production
in database technologies (SQL Server, Redshift, PostgreSQL, Oracle). Desirable Skills: Familiarity with machine learning pipelines and MLOps practices. Additional experience with Databricks and specific AWS such as Glue, S3, Lambda Proficient in Git, CI/CD pipelines, and DevOps tools (e.g., Azure DevOps) Hands-on experience with web scraping, REST API integrations, and streaming data pipelines. Knowledge of More ❯
services as required Essential Requirements 3+ years consulting/managed services experience Solid Data Lake experience with AWS data solutions (Redshift, Glue, Athena, Lake Formation) Advanced AWS skills (EC2, S3, VPC, IAM, Lambda) Infrastructure as Code experience (CloudFormation/Terraform) AWS Solutions Architect Associate certification Strong communication and presentation abilities Desirable Skills Azure fundamentals knowledge FinOps and cost management More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Harnham - Data & Analytics Recruitment
CD, infrastructure-as-code, and modern data tooling Introduce and advocate for scalable, efficient data processes and platform enhancements Tech Environment: Python, SQL, Spark, Airflow, dbt, Snowflake, Postgres AWS (S3), Docker, Terraform Exposure to Apache Iceberg, streaming tools (Kafka, Kinesis), and ML pipelines is a bonus What We're Looking For: 5+ years in Data Engineering, including 2+ years More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Circle Recruitment
and a good understanding of data modelling approaches (e.g. star schema, dimensional modelling) Familiarity with Airflow or similar orchestration tools Comfortable working with AWS services such as Glue and S3, or equivalent cloud infrastructure Experience using version control and CI/CD tools like Git and GitHub Actions Confident working independently and taking ownership of problems and solutions Comfortable More ❯
and data governance processes to enable confident data self-service. Support monitoring, testing, and validation efforts to maintain data quality and reliability. Work with cloud infrastructure services, mainly AWS (S3, Glue, Lambda), and use Python scripting for automation where needed. Help identify opportunities to improve data processes, scalability, and usability. What You Bring 2-4 years experience in analytics More ❯
maintain end-to-end data flow diagrams, logical data models, and entity relationship diagrams (ERDs). * Design scalable, secure, and robust data architectures on AWS, incorporating services such as S3, Glue, Redshift, RDS, and Lambda. * Work with stakeholders to understand business and data requirements and translate them into architectural blueprints. * Ensure data architecture complies with government standards for security More ❯
Hounslow, London, United Kingdom Hybrid / WFH Options
Sky UK
issues using Linux systems and networking protocols, including packet capture analysis Design and enhance operational tools and architect DevOps solutions to optimize system performance and efficiency. Leverage AWS technologies (S3, Athena, QuickSight) to analyse data from millions of field devices, delivering insights to inform decision-making and drive operational efficiency. Develop and implement anomaly detection techniques and data-driven More ❯
applications to send logs to Open Search. Expertise in the ELS Stack (Elasticsearch, Logstash, Kibana). Designing centralized logging, building Kibana dashboards, optimizing observability with AWS services (CloudWatch, CloudTrail, S3), and automating workflows using Python or Terraform. Configure platforms/applications to forward logs to OpenSearch. Optimize log ingestion pipelines and troubleshoot issues. Collaborate with teams to integrate logging More ❯
observability, and the DevOps maturity of our data engineering function. Key Responsibilities Platform Ownership Own and manage the data platform infrastructure built on AWS services (EventBridge, Lambda, EC2, MWAA, S3). Oversee deployment and monitoring of Snowflake, and support its integration into the broader data ecosystem. Infrastructure and System Reliability Ensure platform reliability, availability, and scalability across environments. Design … and other third-party services where applicable. Essential Skills & Experience Proven experience owning and operating production data platforms within AWS. Strong understanding of AWS core services: EventBridge, Lambda, EC2, S3, and MWAA (Managed Workflows for Apache Airflow). Experience with infrastructure reliability, observability tooling, and platform automation. Solid experience with CI/CD pipelines, preferably Bitbucket Pipelines. Familiarity with More ❯
deployment, and management of AWS-based infrastructure, ensuring high availability, scalability, and security. Architect, deploy, and maintain secure cloud-based applications and solutions on AWS services such as EC2, S3, RDS, Lambda, CloudFormation, and VPC. Collaborate with development, operations, and security teams to design scalable and highly available solutions on AWS. Implement and manage cloud security best practices, including … engineering or architecture, with a focus on AWS. At least 3+ years of experience leading cloud engineering teams or projects on AWS. Experience working with AWS services, including EC2, S3, VPC, Lambda, RDS, CloudFormation, and IAM. Strong knowledge of mainframe systems and experience integrating them with AWS. Experience with payment systems and ensuring compliance with security and regulatory requirements More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
DMS Computer Recruitment
/MSc in Information Security or any other related field Minimum 1 year working experience in Information Security, with proven focus in Cloud Security Deep technical knowledge of Amazon Web … Services (AWS). Expertise in Microsoft Azure and Oracle Cloud will be considered an advantage Hands-on experience on AWS services such as IAM, Organizations, SSO, VPC, Transit Gateway, S3, EC2, RDS, ELB, CloudTrail, Config, Inspector, GuardDuty, WAF, etc Clear understanding of current threats to Cloud infrastructure and advanced knowledge of securing such environments Experience in DevSecOps methodologies is More ❯
South West London, London, United Kingdom Hybrid / WFH Options
Get Staffed Online Recruitment
via FTP (typically ~5GB) Cleaning, validating, and converting data using Ruby scripts (CSV → JSON) Writing new Ruby scripts where needed (for less structured sources) Uploading converted data to AWS S3 and scheduling import jobs Iterating on their tooling and processes to improve speed, reliability, and test coverage You'll work alongside experienced Ruby and DevOps engineers, including the original … they import from MongoDB, though don't use it internally) Experience validating, transforming, and cleaning large datasets Confident working with CSV/JSON, Postgres (for intermediate processing), and AWS S3 Experience building automated test suites (they use RSpec) Excellent spoken/written English, customer-focused mindset, and calm communication style Able to own and improve a technical function independently More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Get Staffed Online Recruitment Limited
via FTP (typically ~5GB) Cleaning, validating, and converting data using Ruby scripts (CSV JSON) Writing new Ruby scripts where needed (for less structured sources) Uploading converted data to AWS S3 and scheduling import jobs Iterating on their tooling and processes to improve speed, reliability, and test coverage You’ll work alongside experienced Ruby and DevOps engineers, including the original … they import from MongoDB, though don’t use it internally) Experience validating, transforming, and cleaning large datasets Confident working with CSV/JSON, Postgres (for intermediate processing), and AWS S3 Experience building automated test suites (they use RSpec) Excellent spoken/written English, customer-focused mindset, and calm communication style Able to own and improve a technical function independently More ❯
via FTP (typically ~5GB) Cleaning, validating, and converting data using Ruby scripts (CSV → JSON) Writing new Ruby scripts where needed (for less structured sources) Uploading converted data to AWS S3 and scheduling import jobs Iterating on our tooling and processes to improve speed, reliability, and test coverage You’ll work alongside experienced Ruby and DevOps engineers, including the original … we import from MongoDB, though don’t use it internally) Experience validating, transforming, and cleaning large datasets Confident working with CSV/JSON, Postgres (for intermediate processing), and AWS S3 Experience building automated test suites (we use RSpec) Excellent spoken/written English, customer-focused mindset, and calm communication style Able to own and improve a technical function independently More ❯
