strong SQL, Windows server, UNIX, and .Net. Strong research skills. Strong experience of Terraform, AWS, Airflow, Docker, Github/Github actions, Jenkins/Teamcity• Strong AWS specific skills for Athena, Lambda, ECS, ECR, S3 and IAM Strong knowledge in industry best practices in development and a security first mindset. Strong knowledge in using and developing applicable tool sets. Ability More ❯
various businesses and gaining an overview of many different sectors. What We’re Looking For 5 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best practices for data More ❯
various businesses and gaining an overview of many different sectors. What We’re Looking For 5 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best practices for data More ❯
various businesses and gaining an overview of many different sectors. What We’re Looking For 10 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best practices for data More ❯
various businesses and gaining an overview of many different sectors. What We’re Looking For 10 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best practices for data More ❯
City of London, London, United Kingdom Hybrid/Remote Options
Tata Consultancy Services
of innovation and technical excellence. Your Profile Essential skills/knowledge/experience: Deep hands-on experience with AWS Cloud-native data platforms, including: AWS Glue, Lambda, Step Functions, Athena, Redshift, S3, CloudWatch AWS SDKs, Boto3, and serverless architecture patterns Strong programming skills in Python and Apache Spark Proven experience in Snowflake data engineering, including: Snowflake SQL, Snowpipe, Streams More ❯
of innovation and technical excellence. Your Profile Essential skills/knowledge/experience: Deep hands-on experience with AWS Cloud-native data platforms, including: AWS Glue, Lambda, Step Functions, Athena, Redshift, S3, CloudWatch AWS SDKs, Boto3, and serverless architecture patterns Strong programming skills in Python and Apache Spark Proven experience in Snowflake data engineering, including: Snowflake SQL, Snowpipe, Streams More ❯
scientist to build and deploy machine learning models. Hands on Skills Data engineering coding background and hands on experience on AWS services such as S3, Lambda, Glue, Step Function, Athena, SageMaker, VPC, ECS, IAM, KMS, etc. CloudFormation Python Unit testing Gitlab PySpark AI/ML knowledge (good to have More ❯
as code •Understanding of machine learning workflows or MLOps for deploying and monitoring models in production. •Experience with cloud platforms, especially AWS and its data services (e.g., BigQuery, Redshift, Athena). •Knowledge of network protocols and programming around HTTP(s), SSH, TCP and UDP •Development experience within secure or classified environments particularly where compliance or restricted networks are a More ❯
engage with clients, learn domain knowledge, be proactive and curious in addition to standard tech would be ideal for the role. Tech Stack: AWS - S3 for storage, Lambda functions, Athena (thus strong SQL), Glue, Glue Data Catalog Python Current frontend is Tableau but experience with any of them will be interchangeable DevOps experience a bonus e.g. Terraform, Drone, Kubernetes More ❯
SQL Server, Oracle, MySQL, NoSQL) to AWS cloud. Proven experience in on-prem to AWS data migration using AWS-native tools such as DMS, Glue, DataSync, Step Functions, Redshift, Athena, Lambda, RDS, EC2, S3 Data Lake, and CloudWatch. Strong knowledge of data extraction, transformation, and loading (ETL) processes, leveraging tools such as Talend, Informatica, Matillion, Pentaho, MuleSoft, Boomi, or More ❯
disruption. Collaborate with various teams to align migration processes with organisational goals and regulatory standards. Proficiency in AWS ETL technologies, including Glue, Data Sync, DMS, Step Functions, Redshift, DynamoDB, Athena, Lambda, RDS, EC2 and S3 Datalake, CloudWatch for building and optimizing ETL pipelines and data migration workflows. Working knowledge of Azure data engineering tools, including ADF (Azure Data Factory More ❯
City of London, London, United Kingdom Hybrid/Remote Options
Sanderson Government and Defence
and innovating with cutting-edge innovation and leadership? We're on the look out for a Senior Data Engineer who has experience in: AWS - S3 for storage, Lambda functions, Athena (thus strong SQL). Open to interchangable Azure experience. Databricks Python Devops experience a bonus e.g. Terraform, Drone, Kubernetes cluster management for microservice style API data consumption Consultative behaviour More ❯
London, South East, England, United Kingdom Hybrid/Remote Options
Sanderson
and innovating with cutting-edge innovation and leadership? We're on the look out for a Senior Data Engineer who has experience in: AWS - S3 for storage, Lambda functions, Athena (thus strong SQL). Open to interchangable Azure experience. Databricks Python Devops experience a bonus e.g. Terraform, Drone, Kubernetes cluster management for microservice style API data consumption Consultative behaviour More ❯
City of London, London, United Kingdom Hybrid/Remote Options
OTA Recruitment
slow data pipelines and queries. Systems integration experience: networking, data migrations, API integration and design. Enthusiasm for clean systems, including documentation, logging, and reproducibility. Experience working with AWS S3, Athena, ECS, Cloud Formation, Lambdas & Cloudwatch. Familiar with analytics tools such as Power BI, Plotly/Dash, or similar for building interactive and impactful visualizations. Passion for TDD. More ❯
slow data pipelines and queries. Systems integration experience: networking, data migrations, API integration and design. Enthusiasm for clean systems, including documentation, logging, and reproducibility. Experience working with AWS S3, Athena, ECS, Cloud Formation, Lambdas & Cloudwatch. Familiar with analytics tools such as Power BI, Plotly/Dash, or similar for building interactive and impactful visualizations. Passion for TDD. More ❯
proposal writing, solution direction, pricing, and costing. Define and implement data governance, security, and compliance strategies. Work hands-on with AWS services such as Redshift, Glue, Lake Formation, SageMaker, Athena, and more. Contribute to pre-sales activities and client bid responses. Mentor junior team members and contribute to internal capability building. Your Skills and Experience Required Skills & Experience: Proven More ❯
and non parametric (e.g. random forest, neural net) techniques as well as wider ML techniques like clustering/random forest (desirable). Tech Stack: SQL, Python, R, Tableau, AWS Athena + More! More information: Enjoy fantastic perks like private healthcare & dental insurance, a generous work from abroad policy, 2-for 1 share purchase plans, an EV Scheme to further More ❯
or similar Cloud data ecosystem (AWS) : hands-on experience with core AWS data services. Key services include: S3 for data lake storage AWS Glue for ETL and data cataloging Amazon Redshift or Athena for data warehousing and analytics Lambda for event-driven data processing. ETL/ELT pipeline development : experience in designing, building, and maintaining robust, automated data More ❯
South West London, London, England, United Kingdom
Sanderson
Data Analyst (Athena) - Active SC essential Westminster or Croydon - approx 2 days per month on site Initial contract until the end of the financial year - extension possible We are looking for an experienced AWS/Athena Data Analyst to support a high-profile government project. The role involves designing, developing, and optimising data queries and analytics solutions using … AWS services, with a strong focus on Athena and S3-based data lakes. Key responsibilities: Develop and maintain SQL queries in AWS Athena for large-scale datasets Optimise data retrieval and ensure efficient performance across AWS environments Collaborate with stakeholders to translate business requirements into actionable insights Work with AWS services such as Glue, Lambda, and S3 for … ETL and data processing Ensure compliance with government data security and governance standards Essential skills: Strong proficiency in SQL and AWS Athena Hands-on experience with AWS data services (Glue, S3, Lambda) Knowledge of data modelling and performance tuning Excellent analytical and problem-solving skills Ability to work within secure government environments Desirable: Experience with Python for data manipulation More ❯
and maintain reliable, observable ETL/ELT workflows using Airflow and managed cloud services. Focus on Python-first implementations, high-quality SQL, Airflow orchestration, and query engines such as Athena, Trino, or ClickHouse. Required Skills: Hands-on software development and data engineering experience. Must have strong financial or trading background. Strong Python & SQL skills: writing clean, testable code following … SOLID principles. Hands-on experience using Athena, Trino, ClickHouse, or other distributed SQL engines and knowledge of cost/scan optimization. Experience with cloud platforms (AWS/Azure/GCP): working with object storage, managed query services, and data catalogs. More ❯
and maintain reliable, observable ETL/ELT workflows using Airflow and managed cloud services. Focus on Python-first implementations, high-quality SQL, Airflow orchestration, and query engines such as Athena, Trino, or ClickHouse. Required Skills: Hands-on software development and data engineering experience. Must have strong financial or trading background. Strong Python & SQL skills: writing clean, testable code following … SOLID principles. Hands-on experience using Athena, Trino, ClickHouse, or other distributed SQL engines and knowledge of cost/scan optimization. Experience with cloud platforms (AWS/Azure/GCP): working with object storage, managed query services, and data catalogs. More ❯
Staffordshire, England, United Kingdom Hybrid/Remote Options
MSA Data Analytics Ltd
that make a real impact. Key Responsibilities Design, build, and maintain robust, scalable ETL/ELT pipelines using tools such as Airflow and AWS services (S3, Redshift, Glue, Lambda, Athena). Integrate new data sources and continuously optimise performance and cost efficiency. Ensure data quality, integrity, and security across all systems. Maintain clear documentation for data processes and pipelines. … Stay up to date with new tools and trends in data engineering, particularly within the AWS ecosystem. Skills & Experience Strong hands-on experience with AWS (S3, Redshift, Glue, Lambda, Athena). Skilled in Airflow for workflow orchestration. Advanced SQL and proficient in Python for data engineering. Experience with data modelling (e.g. dimensional) and familiarity with NoSQL databases (e.g. Elasticsearch More ❯