strong SQL, Windows server, UNIX, and .Net. Strong research skills. Strong experience of Terraform, AWS, Airflow, Docker, Github/Github actions, Jenkins/Teamcity• Strong AWS specific skills for Athena, Lambda, ECS, ECR, S3 and IAM Strong knowledge in industry best practices in development and a security first mindset. Strong knowledge in using and developing applicable tool sets. Ability More ❯
various businesses and gaining an overview of many different sectors. What We’re Looking For 5 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best practices for data More ❯
various businesses and gaining an overview of many different sectors. What We’re Looking For 5 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best practices for data More ❯
various businesses and gaining an overview of many different sectors. What We’re Looking For 10 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best practices for data More ❯
various businesses and gaining an overview of many different sectors. What We’re Looking For 10 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best practices for data More ❯
Overview The team currently uses Kubernetes (EKS) and AWS. AWS technologies include: CloudFormation using Python Lambda DynamoDB Kinesis Data Streams S3 CloudFront CloudTrail CloudWatch Athena Grafana Prometheus CI/CD Processes GitLab is used for CI/CD processes with a strong emphasis on security. Supported Development Technologies The platform team will be initially supporting teams that develop applications More ❯
of innovation and technical excellence. Your Profile Essential skills/knowledge/experience: Deep hands-on experience with AWS Cloud-native data platforms, including: AWS Glue, Lambda, Step Functions, Athena, Redshift, S3, CloudWatch AWS SDKs, Boto3, and serverless architecture patterns Strong programming skills in Python and Apache Spark Proven experience in Snowflake data engineering, including: Snowflake SQL, Snowpipe, Streams More ❯
City of London, London, United Kingdom Hybrid/Remote Options
Tata Consultancy Services
of innovation and technical excellence. Your Profile Essential skills/knowledge/experience: Deep hands-on experience with AWS Cloud-native data platforms, including: AWS Glue, Lambda, Step Functions, Athena, Redshift, S3, CloudWatch AWS SDKs, Boto3, and serverless architecture patterns Strong programming skills in Python and Apache Spark Proven experience in Snowflake data engineering, including: Snowflake SQL, Snowpipe, Streams More ❯
Glasgow, Scotland, United Kingdom Hybrid/Remote Options
Square One Resources
closely with data scientists to build and deploy machine learning models. Required Technical Skills Strong data engineering background with hands-on AWS experience across: S3, Lambda, Glue, Step Functions, Athena, SageMaker, VPC, ECS, IAM, KMS AWS CloudFormation (mandatory) UI development experience (mandatory) Strong SQL, Python, and PySpark Experience with GitLab and unit testing Knowledge of modern data engineering patterns More ❯
and Apache Spark (preferably PySpark). Proven track record of building and optimizing data pipelines in cloud environments. Experience with AWS services such as S3, Glue, Lambda, Step Functions, Athena, IAM, and VPC. Proficiency in Python for data engineering tasks. Familiarity with GitLab for version control and CI/CD. Strong understanding of unit testing and data validation techniques. More ❯
architecture. You will need to have skills and experience in the following: Cloud Data Architecture: Strong knowledge of modern, cloud-based data architecture and tooling (e.g., S3, Glue, Redshift, Athena, Lake Formation, Iceberg/Delta). AWS Platform Build: Demonstrable experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design More ❯
City of London, London, United Kingdom Hybrid/Remote Options
ARC IT Recruitment
architecture. You will need to have skills and experience in the following: Cloud Data Architecture: Strong knowledge of modern, cloud-based data architecture and tooling (e.g., S3, Glue, Redshift, Athena, Lake Formation, Iceberg/Delta). AWS Platform Build: Demonstrable experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design More ❯
London, South East, England, United Kingdom Hybrid/Remote Options
Arc IT Recruitment
architecture. You will need to have skills and experience in the following: Cloud Data Architecture: Strong knowledge of modern, cloud-based data architecture and tooling (e.g., S3, Glue, Redshift, Athena, Lake Formation, Iceberg/Delta). AWS Platform Build: Demonstrable experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design More ❯
Richmond, Surrey, South East, United Kingdom Hybrid/Remote Options
Client Server
experience with some of the following technology that is also in the tech stack: data pipeline orchestration tools (e.g. Airflow, Prefect, Dagster), cloud data platforms (e.g. AWS, S3, Glue, Athena, Redshift, Kinesis), data warehouse concepts and dimensional modelling, data streaming tools (e.g. Kafka, Kinesis) You're collaborative with great communication skills What's in it for you: Salary to More ❯
needed. Skills required to contribute: Years of overall Data and Analytics experience with 2. Minimum 10+ years in AWS data platform including AWS S3, AWS Glue, AWS Redshift, AWS Athena, AWS Sagemaker, AWS Quicksight and AWS MLOPS 3. Snowflake DWH architecture, Snowflake Data Sharing, Snowpipe, Polaris catalog and data governance (meta data/business catalogs). 4. Knowledge of More ❯
leeds, west yorkshire, yorkshire and the humber, united kingdom
Entain
and awareness in the following: Cloud Platforms: AWS Programming languages: JavaScript, Typescript, Python Frameworks: React Native Databases: NoSQL (DynamoDB), SQL AWS services: Lambda, S3, API Gateway, Step Functions, SQS, Athena DevOps and monitoring tools such as Datadog, New Relic, Grafana Desirable: Experience in mobile application development. Experience in sports betting, gaming, or related high-scale transactional domains. Previous experience More ❯
and Apache Spark (preferably PySpark). • Proven track record of building and optimizing data pipelines in cloud environments. • Experience with AWS services such as S3, Glue, Lambda, Step Functions, Athena, IAM, and VPC. • Proficiency in Python for data engineering tasks. • Familiarity with GitLab for version control and CI/CD. • Strong understanding of unit testing and data validation techniques. More ❯
Glasgow, Scotland, United Kingdom Hybrid/Remote Options
Undisclosed
and Apache Spark (preferably PySpark). Proven track record of building and optimizing data pipelines in cloud environments. Experience with AWS services such as S3, Glue, Lambda, Step Functions, Athena, IAM, and VPC. Proficiency in Python for data engineering tasks. Familiarity with GitLab for version control and CI/CD. Strong understanding of unit testing and data validation techniques. More ❯
Glasgow, Lanarkshire, United Kingdom Hybrid/Remote Options
Experis IT
and Apache Spark (preferably PySpark). Proven track record of building and optimizing data pipelines in cloud environments. Experience with AWS services such as S3, Glue, Lambda, Step Functions, Athena, IAM, and VPC. Proficiency in Python for data engineering tasks. Familiarity with GitLab for version control and CI/CD. Strong understanding of unit testing and data validation techniques. More ❯
Senior Data Engineer (Cloud, ML & BI Pipelines) About the Company Ensemble is digitalising workforce management in ports and multimodal industries. Our platform, Athena, helps operations teams schedule smarter - blending automation, forecasting, and real-world constraints into usable tools. About the Role We’re looking for a Senior Data Engineer who loves shaping the way data flows, someone who can More ❯
Edinburgh, Scotland, United Kingdom Hybrid/Remote Options
Addition+
AI to drive business outcomes. Broad technical expertise across digital, security, data, and application architectures. Experience with Databricks or Snowflake would be preferred. Experience with AWS Glue or AWS Athena would be advantageous. Confident stakeholder management and communication skills at all levels. Leadership capability within Agile or scaled Agile environments. Awareness of operational resilience, performance, and security best practices. More ❯
Edinburgh, Midlothian, Scotland, United Kingdom Hybrid/Remote Options
Addition
AI to drive business outcomes. Broad technical expertise across digital, security, data, and application architectures. Experience with Databricks or Snowflake would be preferred. Experience with AWS Glue or AWS Athena would be advantageous. Confident stakeholder management and communication skills at all levels. Leadership capability within Agile or scaled Agile environments. Awareness of operational resilience, performance, and security best practices. More ❯