strong SQL, Windows server, UNIX, and .Net. Strong research skills. Strong experience of Terraform, AWS, Airflow, Docker, Github/Github actions, Jenkins/Teamcity• Strong AWS specific skills for Athena, Lambda, ECS, ECR, S3 and IAM Strong knowledge in industry best practices in development and a security first mindset. Strong knowledge in using and developing applicable tool sets. Ability More ❯
various businesses and gaining an overview of many different sectors. What We’re Looking For 5 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best practices for data More ❯
various businesses and gaining an overview of many different sectors. What We’re Looking For 5 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best practices for data More ❯
various businesses and gaining an overview of many different sectors. What We’re Looking For 10 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best practices for data More ❯
various businesses and gaining an overview of many different sectors. What We’re Looking For 10 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best practices for data More ❯
City of London, London, United Kingdom Hybrid/Remote Options
Tata Consultancy Services
of innovation and technical excellence. Your Profile Essential skills/knowledge/experience: Deep hands-on experience with AWS Cloud-native data platforms, including: AWS Glue, Lambda, Step Functions, Athena, Redshift, S3, CloudWatch AWS SDKs, Boto3, and serverless architecture patterns Strong programming skills in Python and Apache Spark Proven experience in Snowflake data engineering, including: Snowflake SQL, Snowpipe, Streams More ❯
of innovation and technical excellence. Your Profile Essential skills/knowledge/experience: Deep hands-on experience with AWS Cloud-native data platforms, including: AWS Glue, Lambda, Step Functions, Athena, Redshift, S3, CloudWatch AWS SDKs, Boto3, and serverless architecture patterns Strong programming skills in Python and Apache Spark Proven experience in Snowflake data engineering, including: Snowflake SQL, Snowpipe, Streams More ❯
Glasgow, Scotland, United Kingdom Hybrid/Remote Options
Square One Resources
closely with data scientists to build and deploy machine learning models. Required Technical Skills Strong data engineering background with hands-on AWS experience across: S3, Lambda, Glue, Step Functions, Athena, SageMaker, VPC, ECS, IAM, KMS AWS CloudFormation (mandatory) UI development experience (mandatory) Strong SQL, Python, and PySpark Experience with GitLab and unit testing Knowledge of modern data engineering patterns More ❯
and Apache Spark (preferably PySpark). Proven track record of building and optimizing data pipelines in cloud environments. Experience with AWS services such as S3, Glue, Lambda, Step Functions, Athena, IAM, and VPC. Proficiency in Python for data engineering tasks. Familiarity with GitLab for version control and CI/CD. Strong understanding of unit testing and data validation techniques. More ❯
helping to establish telemetry standards, efficient usage patterns, and scalable platform abstractions. Ability to make forward-looking technical decisions and lead others through ambiguity. Familiarity with ClickHouse, Grafana Loki, Athena, or equivalent systems for log and metrics querying. Contributions to open-source observability tools or communities. Experience building cost visibility or FinOps tooling for cloud compute and telemetry pipelines. More ❯
and Apache Spark (preferably PySpark). • Proven track record of building and optimizing data pipelines in cloud environments. • Experience with AWS services such as S3, Glue, Lambda, Step Functions, Athena, IAM, and VPC. • Proficiency in Python for data engineering tasks. • Familiarity with GitLab for version control and CI/CD. • Strong understanding of unit testing and data validation techniques. More ❯
scientist to build and deploy machine learning models. Hands on Skills Data engineering coding background and hands on experience on AWS services such as S3, Lambda, Glue, Step Function, Athena, SageMaker, VPC, ECS, IAM, KMS, etc. CloudFormation Python Unit testing Gitlab PySpark AI/ML knowledge (good to have More ❯
Glasgow, Scotland, United Kingdom Hybrid/Remote Options
Undisclosed
and Apache Spark (preferably PySpark). Proven track record of building and optimizing data pipelines in cloud environments. Experience with AWS services such as S3, Glue, Lambda, Step Functions, Athena, IAM, and VPC. Proficiency in Python for data engineering tasks. Familiarity with GitLab for version control and CI/CD. Strong understanding of unit testing and data validation techniques. More ❯
Glasgow, Lanarkshire, United Kingdom Hybrid/Remote Options
Experis IT
and Apache Spark (preferably PySpark). Proven track record of building and optimizing data pipelines in cloud environments. Experience with AWS services such as S3, Glue, Lambda, Step Functions, Athena, IAM, and VPC. Proficiency in Python for data engineering tasks. Familiarity with GitLab for version control and CI/CD. Strong understanding of unit testing and data validation techniques. More ❯
hands on experience in AWS Cloud serverless components and ability to build and maintain cloud data processing systems (i.e. ECS, EKS, S3, Lambda, SQS/SNS, PostgreSQL, Dynamo, Sagemaker, Athena, etc.) Experience using relational and object databases and web service development standards and practices, including RESTful APIs, micro-services, and services • Experience working in an agile development environment using More ❯
Edinburgh, Scotland, United Kingdom Hybrid/Remote Options
Addition+
AI to drive business outcomes. Broad technical expertise across digital, security, data, and application architectures. Experience with Databricks or Snowflake would be preferred. Experience with AWS Glue or AWS Athena would be advantageous. Confident stakeholder management and communication skills at all levels. Leadership capability within Agile or scaled Agile environments. Awareness of operational resilience, performance, and security best practices. More ❯
Edinburgh, Midlothian, Scotland, United Kingdom Hybrid/Remote Options
Addition
AI to drive business outcomes. Broad technical expertise across digital, security, data, and application architectures. Experience with Databricks or Snowflake would be preferred. Experience with AWS Glue or AWS Athena would be advantageous. Confident stakeholder management and communication skills at all levels. Leadership capability within Agile or scaled Agile environments. Awareness of operational resilience, performance, and security best practices. More ❯
as code •Understanding of machine learning workflows or MLOps for deploying and monitoring models in production. •Experience with cloud platforms, especially AWS and its data services (e.g., BigQuery, Redshift, Athena). •Knowledge of network protocols and programming around SSH, TCP and UDP •Development experience within secure or classified environments particularly where compliance or restricted networks are a factor. You More ❯
engage with clients, learn domain knowledge, be proactive and curious in addition to standard tech would be ideal for the role. Tech Stack: AWS - S3 for storage, Lambda functions, Athena (thus strong SQL), Glue, Glue Data Catalog Python Current frontend is Tableau but experience with any of them will be interchangeable DevOps experience a bonus e.g. Terraform, Drone, Kubernetes More ❯
SQL Server, Oracle, MySQL, NoSQL) to AWS cloud. Proven experience in on-prem to AWS data migration using AWS-native tools such as DMS, Glue, DataSync, Step Functions, Redshift, Athena, Lambda, RDS, EC2, S3 Data Lake, and CloudWatch. Strong knowledge of data extraction, transformation, and loading (ETL) processes, leveraging tools such as Talend, Informatica, Matillion, Pentaho, MuleSoft, Boomi, or More ❯
disruption. Collaborate with various teams to align migration processes with organisational goals and regulatory standards. Proficiency in AWS ETL technologies, including Glue, Data Sync, DMS, Step Functions, Redshift, DynamoDB, Athena, Lambda, RDS, EC2 and S3 Datalake, CloudWatch for building and optimizing ETL pipelines and data migration workflows. Working knowledge of Azure data engineering tools, including ADF (Azure Data Factory More ❯