Integration: Knowledge of Informatica ETL processes. Enterprise Systems: Familiarity with Oracle EBS or Fusion required API Development: Expertise in RESTful services. Cloud Platforms: Experience with AWS and serverless architectures, Athena Preferable Testing: Familiarity with Jest for unit testing (nice to have). Soft Skills: Attention to Detail: Hands-on principal-level engineer with meticulous approach to ensuring accuracy and More ❯
and improve pipeline performance and reliability Maintain documentation of systems, workflows, and configs Tech environment Python, SQL/PLSQL (MS SQL + Oracle), PySpark Apache Airflow (MWAA), AWS Glue, Athena AWS services (CDK, S3, data lake architectures) Git, JIRA You should apply if you have: Strong Python and SQL skills Proven experience designing data pipelines in cloud environments Hands More ❯
and maintaining data pipelines in a live environment. Data Storage Solutions: Familiarity with data lakes, warehousing, and other data storage patterns. Advanced Tools: Experience with tools like Kafka, Jenkins, Athena, or Spark. This role will require 4 days per week onsite in the office in Camden , this is not optional and you must be open to this in order More ❯
Reading, Berkshire, England, United Kingdom Hybrid / WFH Options
Opus Recruitment Solutions Ltd
data pipelines and applications that process complex datasets from multiple operational systems.Key Responsibilities: Build and maintain AWS-based ETL/ELT pipelines using S3, Glue (PySpark/Python), Lambda, Athena, Redshift, and Step Functions Develop backend applications to automate and support compliance reporting Process and validate complex data formats including nested JSON, XML, and CSV Collaborate with stakeholders to More ❯
Reading, Berkshire, United Kingdom Hybrid / WFH Options
Opus Recruitment Solutions Ltd
pipelines and applications that process complex datasets from multiple operational systems. Key Responsibilities: Build and maintain AWS-based ETL/ELT pipelines using S3, Glue (PySpark/Python), Lambda, Athena, Redshift, and Step Functions Develop backend applications to automate and support compliance reporting Process and validate complex data formats including nested JSON, XML, and CSV Collaborate with stakeholders to More ❯
engage with clients, learn domain knowledge, be proactive and curious in addition to standard tech would be ideal for the role. Tech Stack: AWS - S3 for storage, Lambda functions, Athena (thus strong SQL), Glue, Glue Data Catalog Python Current frontend is Tableau but experience with any of them will be interchangeable DevOps experience a bonus e.g. Terraform, Drone, Kubernetes More ❯
CODY TECHNOLOGY PARK, IVELY ROAD, FARNBOROUGH, England
IGNITION TECHNOLOGY LTD
on scenario training into our cyber security apprenticeships. The Project Ares platform offers a totally immersive experience, using automated features to support skills adoption with an in-game advisor, Athena, who advises our players through scenario-based challenges. The platform scenarios replicate the unpredictability and escalating levels of complexity that cyberattacks can present. It drives high levels of engagement More ❯
Portsmouth, Hampshire, England, United Kingdom Hybrid / WFH Options
Computappoint
consultants Build strong customer relationships Support managed services as required Essential Requirements 3+ years consulting/managed services experience Solid Data Lake experience with AWS data solutions (Redshift, Glue, Athena, Lake Formation) Advanced AWS skills (EC2, S3, VPC, IAM, Lambda) Infrastructure as Code experience (CloudFormation/Terraform) AWS Solutions Architect Associate certification Strong communication and presentation abilities Desirable Skills More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Sanderson
Skills & Experience: CI/CD Terraform Kafka Kubernetes (plus experience migrating away from Kubernetes to serverless) GitLab GitHub Actions (and ideally GitHub Enterprise) AWS services: Lambda, CloudWatch, S3, IAM, Athena, RDS Strong stakeholder management and communication skills Desirable Skills: FinOps Testing Cybersecurity Experience working as the sole DevOps Engineer on a project Reasonable Adjustments: Respect and equality are core More ❯
and maintaining robust, cloud-native data pipelines Automating and orchestrating workflows using tools like AWS Glue, Azure Data Factory, or Google Cloud Dataflow Working with platform services such as Amazon S3, Azure Synapse, Google BigQuery, and Snowflake Implementing Lakehouse architectures using tools like Databricks or Snowflake Collaborating closely with engineers, analysts, and client teams to deliver value-focused data … ve got solid experience working with Python, SQL, Spar and data pipeline tools such as dbt or Airflow You're comfortable working across cloud platforms - especially AWS (Glue, Lambda, Athena), Azure (Data Factory, Synapse), or GCP (Dataflow, BigQuery, Cloud Composer) You have a good understanding of data modelling, data warehousing and performance optimisation You care deeply about data quality More ❯
Collaborate with development teams to design and implement automated tests for microservices, emphasizing Spring Boot and Java-based architectures. Implement testing strategies for AWS data lakes (e.g., S3, Glue, Athena) with a focus on schema evolution, data quality rules, and performance benchmarks, prioritizing data lake testing over traditional SQL approaches. Automate data tests within CI/CD workflows to … maintain scalable test automation frameworks, with a focus on backend, API, and data systems using tools like Pytest and Postman. Expertise in Pandas, SQL, and AWS analytics services (Glue, Athena, Redshift) for data profiling, transformation, and validation within data lakes. Solid experience with AWS (S3, Lambda, EMR, ECS/EKS, CloudFormation/Terraform) and understanding of cloud-native architectures More ❯
Manchester, Lancashire, England, United Kingdom Hybrid / WFH Options
Searchability
of real-time and batch ETL processes, ensuring accuracy, integrity, and scalability across vast datasets. You'll work with Python, SQL, Apache Spark, and AWS services such as EMR, Athena, and Lambda to deliver robust, high-performance solutions.You'll also play a key role in optimising data pipeline architecture, supporting knowledge sharing within the team, and collaborating with stakeholders … our client in conjunction with this vacancy only. KEY SKILLS:Data Engineer/Python/SQL/AWS/ETL/Data Pipelines/Apache Spark/EMR/Athena/Lambda/Big Data/Manchester/Hybrid Working More ❯
Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Posting Date: 11 Aug 2025 Function: Data & AI Unit: Networks Location: Assembly, Bristol, United Kingdom Internal Closing Date: 18/08/ More ❯
Principal Data Engineer (Contract) Hybrid (London-based) | £450-£650/day A leading scientific and cultural institution is seeking a Principal Data Engineer to design and scale cloud-native data infrastructure powering biodiversity research, digitisation, and AI workflows. Key Responsibilities More ❯
Nottingham, Nottinghamshire, United Kingdom Hybrid / WFH Options
Experian Group
within the metrics framework to analyze security reporting within PowerBi Environment. Interpret data in SQL, write queries, understand stored procedures. Familiarity with AWS Environments for data storage in S3, Athena, RDS SWL Confer with systems analysts, engineers, and executive partners to update reporting and maintain PowerBi Automation Routines, Templates and internal knowledgebases. Ensure PowerBI and Power Automate Report Development … suitable for users to filter and navigate through. Qualifications Knowledge of MS Data Fabric, Power Automate, MS Forms, PowerBI, MySQL and AWS Environments for data storage in S3 i.e. Athena, RDS SWL An understanding of systems architecture and designing Power Platform Applications and reporting solutions applying business rules and data validations. Experience building both standalone and integrated apps (e.g. More ❯
Associates, Mid-level Engineers, and Senior/Principal engineers. What You'll Do: Design, build, and scale data pipelines and services using AWS Glue, Lambda, Step Functions, S3, EMR, Athena, and more. Lead projects involving serverless, event-driven architectures and CI/CD workflows (GitLab CI). Write clean, production-grade code in Python (Scala is a bonus). … using Datadog or CloudWatch. Actively mentor Data Engineers and Associates, and lead technical discussions and design sessions. Key requirements: Must-Have: Strong experience with AWS services: Glue, Lambda, S3, Athena, Step Functions, EventBridge, EMR, EKS, RDS, Redshift, DynamoDB. Strong Python development skills. Proficient with Docker , containerization, and virtualization. Hands-on experience with CI/CD , especially GitLab CI. Solid More ❯