a Data Architect or similar role, with a focus on AWS cloud environments. Strong knowledge of AWS services relevant to data architecture, such as Amazon Redshift, AmazonAthena, Amazon S3, AWS Glue, and AWS Lambda. Experience designing and implementing data lakes, data warehouses, and analytics solutions more »
desirable Strong skills and knowledge of Public cloud technologies to enable Cloud First delivery - AWS Elastic Kubernetes Service (EKS)/Cluster, EC2, S3 Buckets, Athena, Lambda, Glue and other services Docker – Container and Package Registry, AWS PostGres (database), Grafana dashboards to visualise test results Strong experience of setting up more »
cloud hosting provider (AWS (preferred), Google Cloud, Azure or similar). Experience using modern build tools such as Maven, Jenkins, GitHub, etc. Experience with Amazon Web Services a strong plus - CloudFormation, EMR, S3, EC2, Athena etc. Experience with scheduling services such as Airflow, Oozie. Experience with Data ETL more »
a Data Architect or similar role, with a focus on AWS cloud environments. Strong knowledge of AWS services relevant to data architecture, such as Amazon Redshift, AmazonAthena, Amazon S3, AWS Glue, and AWS Lambda. Experience designing and implementing data lakes, data warehouses, and analytics solutions more »
Greater London, England, United Kingdom Hybrid / WFH Options
CommuniTech Recruitment Group
Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience building modern more »
london, south east england, United Kingdom Hybrid / WFH Options
CommuniTech Recruitment Group
Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience building modern more »
Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience building modern more »
Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience building modern more »
Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience building modern more »
Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience building modern more »
as Flask). Familiarity with SQL Server and/or PostgreSQL database technologies. Linux experience. Cloud development experience (e.g. AWS). Familiarity with SecDB, Athena or Quartz. Team Player with Excellent Communication Skills. more »
london (croydon), south east england, United Kingdom
Janes
development (e.g. usage of Express on EKS/ECS), as well as common cloud data engineering solutions and databases (e.g. AWS Lambda functions, AWS Athena, AWS Glue, AWS Step Functions etc.). Software engineering best practices, including DevOps, CI/CD, Agile, and infrastructure-as-code (particularly Terraform). more »
london, south east england, United Kingdom Hybrid / WFH Options
BJSS
variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc. About You You're an engineer at heart and enjoy the challenge of building reliable, efficient data applications more »
SQL Significant experience with orchestration tools, ideally Airflow Strong Data Architecture experience ideally in both GCP and AWS Knowledge of MPP systems such as Athena, BigQuery, EMR, Hive, Iceberg 👍 Bonus points for: Exposure to data streaming technologies such as Kafka or Kinesis more »
Architecture & Design Enterprise Architecture and good knowledge of object-oriented programming and design patterns AWS services: API gateway, Lambda, SNS, SQS, DynamoDB, Kinesis, EC2, Athena, Elastic Beanstalk REST API Design and specification using Swagger/OpenAPI Programming Experience of both functional programming and object-orientated programming Excellent programming skills more »
Architecture & Design Enterprise Architecture and good knowledge of object-oriented programming and design patterns AWS services: API gateway, Lambda, SNS, SQS, DynamoDB, Kinesis, EC2, Athena, Elastic Beanstalk REST API Design and specification using Swagger/OpenAPI Programming Experience of both functional programming and object-orientated programming Excellent programming skills more »
london, south east england, United Kingdom Hybrid / WFH Options
83DATA
using relevant Data Architectural paradigms such as Kimball, Data Vault, Data Mesh, Lakehouse • Demonstrable knowledge of key AWS services such as S3, EMR, Redshift, Athena, Lambda • Excellent stakeholder management skills To be successfully appointed to this role, it is a requirement to obtain Security Check (SC) clearance. To obtain more »
cloud hosting provider (AWS (preferred), Google Cloud, Azure or similar). Experience using modern build tools such as Maven, Jenkins, GitHub, etc. Experience with Amazon Web Services a strong plus - CloudFormation, EMR, S3, EC2, Athena etc. Experience with scheduling services such as Airflow, Oozie. Experience with Data ETL more »
description, key responsibilities, and job description: Hands on Senior Engineer with experience of working within high performance development teams Significant AWS Engineering experience implementing Amazon well architected frameworks, serverless solutions and improving existing platforms using AWS technologies with Agile delivery methods Demonstrable experience of Python 3, Python data management … or equivalent IT related experience. Skills Deep experience of AWS solutions incl. Step Functions, Glue, Lambda, RDS, (e.g. DynamoDB, Aurora Postgres), SQS, API Gateway, Athena Experience of Python Experience of the delivery and optimization of high-performance data pipelines from ingestion to storage to distribution Comfortable with data analysis more »
using relevant Data Architectural paradigms such as Kimball, Data Vault, Data Mesh, Lakehouse Demonstrable knowledge of key AWS services such as S3, EMR, Redshift, Athena, Lambda Excellent stakeholder management skills To be successfully appointed to this role, it is a requirement to obtain Security Check (SC) clearance. To obtain more »
Greater London, England, United Kingdom Hybrid / WFH Options
BJSS
variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc. About You You're an engineer at heart and enjoy the challenge of building reliable, efficient data applications more »
