that address complex business requirements and drive decision-making. Your skills and experience Proficiency with AWS Tools: Demonstrable experience using AWS Glue, AWS Lambda, Amazon Kinesis, Amazon EMR , AmazonAthena, Amazon DynamoDB, Amazon Cloudwatch, Amazon SNS and AWS Step Functions. Programming Skills: Strong More ❯
Develop new tools and infrastructure using Python (Flask/Fast API) or Java (Spring Boot) and relational data backend (AWS - Aurora/Redshift/Athena/S3) Support users and operational flows for quantitative risk, senior management and portfolio management teams using the tools developed Qualifications/Skills Required More ❯
engineering background Exposure to building or deploying AI/ML models into a production environment Previously used AWS data services e.g. S3, Kinesis, Glue, Athena, DynamoDB, SNS/SQS Experience using any data streaming technologies/paradigms for real-time or near-real time analytics More ❯
and automated deployments. Have excellent knowledge of AWS services (ECS, IAM, EC2, S3, DynamoDB, MSK). Our Technology Stack: Python and Scala Starburst and Athena Kafka and Kinesis DataHub ML Flow and Airflow Docker and Terraform Kafka, Spark, Kafka Streams and KSQL DBT AWS, S3, Iceberg, Parquet, Glue and More ❯
optimizing data delivery, re-designing infrastructure for greater scalability and performance. Essential Skills and Experience: ·Hands-on experience with AWS services, including Lambda, Glue, Athena, RDS, and S3. ·Strong SQL skills for data transformation, cleaning, and loading. ·Strong coding experience with Python and Pandas. ·Experience with any flavour of More ❯
london, south east england, united kingdom Hybrid / WFH Options
Datatech Analytics
optimizing data delivery, re-designing infrastructure for greater scalability and performance. Essential Skills and Experience: Hands-on experience with AWS services, including Lambda, Glue, Athena, RDS, and S3. Strong SQL skills for data transformation, cleaning, and loading. Strong coding experience with Python and Pandas. Experience with any flavour of More ❯
stack, including (but not limited to) spark/hadoop, kafka, Aerospike/Dynamodb Experience with AWS tech stack, including but not limited to EMR, Athena, EKS Expert knowledge of multi-threading, memory model, etc. Understanding of database fundamentals and MySQL knowledge Experience with CICD tools such as Jenkins, Graphite More ❯
with DBT, building and maintaining modular, scalable data models that follow best practices Strong understanding of dimensional modelling Familiarity with AWS data services (S3, Athena, Glue) Experience with Airflow for scheduling and orchestrating workflows Experience working with data lakes or modern data warehouses (Snowflake, Redshift, BigQuery) A pragmatic problem More ❯
Central London, London, United Kingdom Hybrid / WFH Options
167 Solutions Ltd
warehouse and lakehouse solutions for analytics, reporting, and machine learning. Implement ETL/ELT processes using tools such as Apache Airflow, AWS Glue, and AmazonAthena . Work with cloud-native technologies to support scalable, serverless architectures. Collaborate with data science teams to streamline feature engineering and model … Expertise in Snowflake and modern data architectures. Experience designing and managing data pipelines, ETL, and ELT workflows . Knowledge of AWS services such as Athena, Glue, and EMR. Experience working closely with data scientists and ML engineers . Strong problem-solving skills and ability to work independently. Whats on More ❯
Engineering colleagues. What you'll need Required: Experience designing and building high throughput, scalable, resilient, and secure data pipelines. Experience with AWS technologies: Glue, Athena, S3, Step Functions, Lambda, RDS (Aurora Postgres), DMS, Redshift, QuickSight, Kinesis Firehose. Expert knowledge of SQL. Hands-on experience with Kafka. Hands-on experience More ❯
Years of overall Data and Analytics experience with 10+ Years in AWS data platform including AWS S3, AWS Glue, AWS Redshift, AWS Athena, AWS Sagemaker, AWS Quicksight and AWS MLOPS Snowflake DWH architecture, Snowflake Data Sharing, Snowpipe, Polaris catalog and data governance (meta data/business catalogs). Knowledge More ❯
such as Kafka, NoSQL, Airflow, TensorFlow, or Spark. Finally, experience with cloud platforms like AWS or Azure, including data services such as Apache Airflow, Athena, or SageMaker, is essential for the Mid-level. The Role: Build and maintain scalable data pipelines. Design/implement optimised data architecture. Develop ETL More ❯
pipelines and doing transformation and ingestion in a a certain tech suite. Extensive experience in implementing solutions around the AWS cloud environment (S3, Snowflake, Athena, Glue), In depth understanding of database structure principles, Strong knowledge of database structure systems and data mining, Excellent understanding of Data Modelling (ERwin, PowerDesigner More ❯
and identify future opportunities for leveraging AWS services and implement effective metrics and monitoring processes. Your Skills and Experience Experience of AWS tools (e.g. Athena, Redshift, Glue, EMR), Java, Scala, Python, Spark. Experience of developing enterprise grade ETL/ELT data pipelines and demonstrable knowledge of applying Data Engineering More ❯
integrating and automating business workflows, including data-driven processes and system integrations. Familiarity with analytics platforms and tools such as GCP (BigQuery), AWS (Glue, Athena), or Azure Databricks. Proficiency in Python or .NET, with experience in both or the ability to quickly learn new technologies. Experience with front-end More ❯
integrating and automating business workflows, including data-driven processes and system integrations. Familiarity with analytics platforms and tools such as GCP (BigQuery), AWS (Glue, Athena), or Azure Databricks. Proficiency in Python or .NET, with experience in both or the ability to quickly learn new technologies. Experience with front-end More ❯
Computer Engineering or related field. Experience in containerization - Docker/Kubernetes. Experience in AWS cloud and services (S3, Lambda, Aurora, ECS, EKS, SageMaker, Bedrock, Athena, Secrets Manager, Certificate Manager etc.) Proven DevOps/MLOps experience provisioning and maintaining infrastructure leveraging some of the following: Terraform, Ansible, AWS CDK, CloudFormation. More ❯
services in production. Exposure to some of the following technologies (or equivalent): Apache Spark, AWS Redshift, AWS S3, Cassandra (and other NoSQL systems), AWS Athena, Apache Kafka, Apache Flink, AWS, and service-oriented architecture. What you'll get: Full responsibility for projects from day one, a collaborative team, and More ❯
TypeScript or Python A degree in Computer Science or equivalent Strong attention to detail, communication, and documentation skills Experience with AWS (Lambda, S3, DynamoDB, Athena), Linux BASH, Confluence, or JIRA Hybrid role two days at the office More ❯
Computer Science (or equivalent training) Strong attention to detail and independent working style Excellent communication and documentation skills Experience with AWS (Lambda, S3, DynamoDB, Athena) Familiarity with Linux BASH, Confluence, JIRA More ❯
Southwark, Greater London, Billingsgate, United Kingdom
Expert Employment
Computer Science (or equivalent training) Strong attention to detail and independent working style Excellent communication and documentation skills Experience with AWS (Lambda, S3, DynamoDB, Athena) Familiarity with Linux BASH, Confluence, JIRA More ❯
BDM, AutoSys, Airflow, and SQL Server Agent. Experience with cloud platforms preferably AWS. Strong knowledge of AWS cloud services, including EMR, RDS Postgres, Redshift Athena, S3, and IAM. Solid understanding of data warehousing principles and best practices. Strong proficiency in SQL for data manipulation, reporting, and optimization. Knowledge of More ❯
design reports and dashboards in Tableau Update existing dashboards as part of Data Warehouse migration Data cleansing, preparation and modelling using DBT or AWS Athena Requirement gathering and translating to business needs Cloud Infrastructure knowledge will be a big advantage for this role. Experience of managing IT Assets would More ❯
design reports and dashboards in Tableau Update existing dashboards as part of Data Warehouse migration Data cleansing, preparation and modelling using DBT or AWS Athena Requirement gathering and translating to business needs Cloud Infrastructure knowledge will be a big advantage for this role. Experience of managing IT Assets would More ❯
