Overview The team currently uses Kubernetes (EKS) and AWS. AWS technologies include: CloudFormation using Python Lambda DynamoDB Kinesis Data Streams S3 CloudFront CloudTrail CloudWatch Athena Grafana Prometheus CI/CD Processes GitLab is used for CI/CD processes with a strong emphasis on security. Supported Development Technologies The platform team will be initially supporting teams that develop applications More ❯
Glasgow, Scotland, United Kingdom Hybrid/Remote Options
Square One Resources
closely with data scientists to build and deploy machine learning models. Required Technical Skills Strong data engineering background with hands-on AWS experience across: S3, Lambda, Glue, Step Functions, Athena, SageMaker, VPC, ECS, IAM, KMS AWS CloudFormation (mandatory) UI development experience (mandatory) Strong SQL, Python, and PySpark Experience with GitLab and unit testing Knowledge of modern data engineering patterns More ❯
and Apache Spark (preferably PySpark). Proven track record of building and optimizing data pipelines in cloud environments. Experience with AWS services such as S3, Glue, Lambda, Step Functions, Athena, IAM, and VPC. Proficiency in Python for data engineering tasks. Familiarity with GitLab for version control and CI/CD. Strong understanding of unit testing and data validation techniques. More ❯
London, South East, England, United Kingdom Hybrid/Remote Options
Arc IT Recruitment
architecture. You will need to have skills and experience in the following: Cloud Data Architecture: Strong knowledge of modern, cloud-based data architecture and tooling (e.g., S3, Glue, Redshift, Athena, Lake Formation, Iceberg/Delta). AWS Platform Build: Demonstrable experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design More ❯
Richmond, Surrey, South East, United Kingdom Hybrid/Remote Options
Client Server
experience with some of the following technology that is also in the tech stack: data pipeline orchestration tools (e.g. Airflow, Prefect, Dagster), cloud data platforms (e.g. AWS, S3, Glue, Athena, Redshift, Kinesis), data warehouse concepts and dimensional modelling, data streaming tools (e.g. Kafka, Kinesis) You're collaborative with great communication skills What's in it for you: Salary to More ❯
needed. Skills required to contribute: Years of overall Data and Analytics experience with 2. Minimum 10+ years in AWS data platform including AWS S3, AWS Glue, AWS Redshift, AWS Athena, AWS Sagemaker, AWS Quicksight and AWS MLOPS 3. Snowflake DWH architecture, Snowflake Data Sharing, Snowpipe, Polaris catalog and data governance (meta data/business catalogs). 4. Knowledge of More ❯
leeds, west yorkshire, yorkshire and the humber, united kingdom
Entain
and awareness in the following: Cloud Platforms: AWS Programming languages: JavaScript, Typescript, Python Frameworks: React Native Databases: NoSQL (DynamoDB), SQL AWS services: Lambda, S3, API Gateway, Step Functions, SQS, Athena DevOps and monitoring tools such as Datadog, New Relic, Grafana Desirable: Experience in mobile application development. Experience in sports betting, gaming, or related high-scale transactional domains. Previous experience More ❯
and Apache Spark (preferably PySpark). • Proven track record of building and optimizing data pipelines in cloud environments. • Experience with AWS services such as S3, Glue, Lambda, Step Functions, Athena, IAM, and VPC. • Proficiency in Python for data engineering tasks. • Familiarity with GitLab for version control and CI/CD. • Strong understanding of unit testing and data validation techniques. More ❯
Glasgow, Scotland, United Kingdom Hybrid/Remote Options
Undisclosed
and Apache Spark (preferably PySpark). Proven track record of building and optimizing data pipelines in cloud environments. Experience with AWS services such as S3, Glue, Lambda, Step Functions, Athena, IAM, and VPC. Proficiency in Python for data engineering tasks. Familiarity with GitLab for version control and CI/CD. Strong understanding of unit testing and data validation techniques. More ❯
Glasgow, Lanarkshire, United Kingdom Hybrid/Remote Options
Experis IT
and Apache Spark (preferably PySpark). Proven track record of building and optimizing data pipelines in cloud environments. Experience with AWS services such as S3, Glue, Lambda, Step Functions, Athena, IAM, and VPC. Proficiency in Python for data engineering tasks. Familiarity with GitLab for version control and CI/CD. Strong understanding of unit testing and data validation techniques. More ❯
Edinburgh, Scotland, United Kingdom Hybrid/Remote Options
Addition+
AI to drive business outcomes. Broad technical expertise across digital, security, data, and application architectures. Experience with Databricks or Snowflake would be preferred. Experience with AWS Glue or AWS Athena would be advantageous. Confident stakeholder management and communication skills at all levels. Leadership capability within Agile or scaled Agile environments. Awareness of operational resilience, performance, and security best practices. More ❯
Edinburgh, Midlothian, Scotland, United Kingdom Hybrid/Remote Options
Addition
AI to drive business outcomes. Broad technical expertise across digital, security, data, and application architectures. Experience with Databricks or Snowflake would be preferred. Experience with AWS Glue or AWS Athena would be advantageous. Confident stakeholder management and communication skills at all levels. Leadership capability within Agile or scaled Agile environments. Awareness of operational resilience, performance, and security best practices. More ❯
SQL Server, Oracle, MySQL, NoSQL) to AWS cloud. Proven experience in on-prem to AWS data migration using AWS-native tools such as DMS, Glue, DataSync, Step Functions, Redshift, Athena, Lambda, RDS, EC2, S3 Data Lake, and CloudWatch. Strong knowledge of data extraction, transformation, and loading (ETL) processes, leveraging tools such as Talend, Informatica, Matillion, Pentaho, MuleSoft, Boomi, or More ❯
disruption. Collaborate with various teams to align migration processes with organisational goals and regulatory standards. Proficiency in AWS ETL technologies, including Glue, Data Sync, DMS, Step Functions, Redshift, DynamoDB, Athena, Lambda, RDS, EC2 and S3 Datalake, CloudWatch for building and optimizing ETL pipelines and data migration workflows. Working knowledge of Azure data engineering tools, including ADF (Azure Data Factory More ❯
London, South East, England, United Kingdom Hybrid/Remote Options
Sanderson
and innovating with cutting-edge innovation and leadership? We're on the look out for a Senior Data Engineer who has experience in: AWS - S3 for storage, Lambda functions, Athena (thus strong SQL). Open to interchangable Azure experience. Databricks Python Devops experience a bonus e.g. Terraform, Drone, Kubernetes cluster management for microservice style API data consumption Consultative behaviour More ❯
GitLab for version control, CI/CD, and collaboration. Strong coding background in Python and PySpark. Hands-on experience with the following AWS services: S3, Lambda, Glue, Step Functions, Athena, SageMaker, VPC, ECS, IAM, KMS Proficiency in CloudFormation for infrastructure automation. Experience with unit testing frameworks and best practices. Familiarity with GitLab for source control and CI/CD More ❯
proposal writing, solution direction, pricing, and costing. Define and implement data governance, security, and compliance strategies. Work hands-on with AWS services such as Redshift, Glue, Lake Formation, SageMaker, Athena, and more. Contribute to pre-sales activities and client bid responses. Mentor junior team members and contribute to internal capability building. Your Skills and Experience Required Skills & Experience: Proven More ❯
london, south east england, united kingdom Hybrid/Remote Options
LocalStack
and ensuring high-fidelity cloud platform emulation to help developers test locally with speed and confidence. Requirements What you will be working on/responsible for Ensure Snowflake, Redshift, Athena, Glue, and future emulators are kept up to date with the latest syntax, behaviors, and APIs. Identify and resolve bugs, edge cases, and inconsistencies across emulated services. Maintain robust … including SQL engines, query planning, storage layers, indexing, and SQL parsing/ASTs, with experience developing database features. Hands-on experience with cloud data platforms such as Snowflake, Redshift, Athena, or BigQuery, including optimization techniques and custom parsers/transpilers. Practical knowledge of distributed and analytical engines (e.g., Apache Spark, Trino, PostgreSQL, DuckDB) with skills in query engines, performance More ❯
crafting robust C# microservices to leveraging the power of AWS for cloud-native solutions. You'll work with a diverse tech ecosystem including S3, SQS, SNS, Lambda, RDS (Postgres), Athena, Step Functions, and Glue ETL, while also diving into SQL, Python, and occasionally Groovy. Strong foundations in Object-Oriented Design, SOLID principles, and CI/CD are essential. As … all development activities, adhering to industry standards and internal policies. Experience & Competencies Essential SQL Mastery : CTEs, joins, triggers, cursors, Postgres, partitioning, window functions. AWS Expertise : S3, Step Functions, Glue, Athena, data partitioning strategies. C# : Multithreading, records, IOC/DI, .NET Core, generics. Python : Solid working knowledge. CI/CD : GitLab pipelines, scripting (PowerShell/Bash), automation best practices. Containers More ❯
South West London, London, England, United Kingdom
Sanderson
Data Analyst (Athena) - Active SC essential Westminster or Croydon - approx 2 days per month on site Initial contract until the end of the financial year - extension possible We are looking for an experienced AWS/Athena Data Analyst to support a high-profile government project. The role involves designing, developing, and optimising data queries and analytics solutions using … AWS services, with a strong focus on Athena and S3-based data lakes. Key responsibilities: Develop and maintain SQL queries in AWS Athena for large-scale datasets Optimise data retrieval and ensure efficient performance across AWS environments Collaborate with stakeholders to translate business requirements into actionable insights Work with AWS services such as Glue, Lambda, and S3 for … ETL and data processing Ensure compliance with government data security and governance standards Essential skills: Strong proficiency in SQL and AWS Athena Hands-on experience with AWS data services (Glue, S3, Lambda) Knowledge of data modelling and performance tuning Excellent analytical and problem-solving skills Ability to work within secure government environments Desirable: Experience with Python for data manipulation More ❯
Staffordshire, England, United Kingdom Hybrid/Remote Options
MSA Data Analytics Ltd
that make a real impact. Key Responsibilities Design, build, and maintain robust, scalable ETL/ELT pipelines using tools such as Airflow and AWS services (S3, Redshift, Glue, Lambda, Athena). Integrate new data sources and continuously optimise performance and cost efficiency. Ensure data quality, integrity, and security across all systems. Maintain clear documentation for data processes and pipelines. … Stay up to date with new tools and trends in data engineering, particularly within the AWS ecosystem. Skills & Experience Strong hands-on experience with AWS (S3, Redshift, Glue, Lambda, Athena). Skilled in Airflow for workflow orchestration. Advanced SQL and proficient in Python for data engineering. Experience with data modelling (e.g. dimensional) and familiarity with NoSQL databases (e.g. Elasticsearch More ❯
london (king's cross), south east england, united kingdom Hybrid/Remote Options
elasticStage
quality & root-cause elimination: Establish tests, SLAs, lineage, and monitoring; run post-incident reviews and drive permanent fixes. Platform creation & optimisation (AWS): Architect and operate on AWS (S3, Glue, Athena/Redshift Serverless, Lambda, Kinesis, Aurora/RDS, IAM) optimised for cost, performance, and reliability. Pipelines (ETL/ELT): Build and maintain batch/stream pipelines unifying factory machines … platform that scales as elasticStage expands to new manufacturing sites and markets. Required Skills and Qualifications: Deep, hands-on experience designing and operating data platforms on AWS (S3, Glue, Athena/Redshift Serverless, Lambda, Kinesis, IAM) and relational stores (Aurora/RDS). SQL + Python proficiency; experience with dbt (or similar) and a modern orchestration tool. Strong data More ❯
Burntwood, England, United Kingdom Hybrid/Remote Options
Nixor
as the data champion across the business, defining how data can enhance decision-making, efficiency, and customer experience. You’ll lead the adoption of AWS technologies such as Glue, Athena, LakeFormation, and DataBrew — unlocking the full potential of the organisation’s data assets. Working confidently across both AWS and legacy systems, you’ll source, validate, and connect data into … environment. You’ll have a strong grasp of SQL and a clear understanding of how data flows through modern architectures, with proven experience using AWS tools such as Glue, Athena, LakeFormation, or DataBrew. You’ll also be adept at working across both cloud and legacy systems, with excellent communication skills that allow you to bridge technical and non-technical More ❯
Job ID: Amazon Development Centre (Scotland) Limited Do you want a role with deep meaning and the ability to make a major impact? As part of Intelligent Talent Acquisition (ITA), you'll have the opportunity to reinvent the hiring process and deliver unprecedented scale, sophistication, and accuracy for Amazon Talent Acquisition operations. ITA is an industry-leading people … of connecting the right people to the right jobs in a way that is fair and precise. Last year we delivered over 6 million online candidate assessments, and helped Amazon deliver billions of packages around the world by making it possible to hire hundreds of thousands of workers in the right quantity, at the right location and at exactly … the right time. You'll work on state-of-the-art research, advanced software tools, new AI systems, and machine learning algorithms, leveraging Amazon's in-house tech stack to bring innovative solutions to life. Join ITA in using technologies to transform the hiring landscape and make a meaningful difference in people's lives. Together, we can solve the More ❯
security, cost efficiency, and operational sustainability. Implementation & Migration Lead full-scale migrations from legacy platforms (e.g., Avaya, Cisco, Genesys) to AWS Connect. Design and deploy IVR/contact flows, Amazon Lex conversational bots, analytics tools, and agent support solutions. Integration & Ecosystem Development Architect seamless integrations with CRM and ITSM platforms (Salesforce, ServiceNow, Dynamics, Pega), WFM/QM tools, and … identity management systems. Build API-driven architectures and real-time analytics pipelines leveraging AWS services such as Lambda, EventBridge, Kinesis, Glue, Athena, and CloudWatch. Security & Compliance Implement IAM policies, KMS encryption, VPC networking, and PrivateLink to secure data and connectivity. Ensure adherence to GDPR, PCI-DSS, ISO 27001, and industry-specific standards. Develop data retention policies, privacy impact frameworks … . Hands-on experience with Infrastructure as Code (CloudFormation, Terraform, CDK) and serverless development (Node.js/Python). Preferred Qualifications AWS Solutions Architect - Professional or equivalent certification. Experience with Amazon Connect features: Contact Lens, Wisdom/Q, Voice ID, and outbound campaigns. Familiarity with regulated sectors such as healthcare or public services. Understanding of SIP, telephony routing, and telecom More ❯