of AWS ecosystems like Lambdas, step functions and ECS services. Experience with data stack technologies, such as Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as more »
Greater London, England, United Kingdom Hybrid / WFH Options
CommuniTech Recruitment Group
ECS services. Experience of Dremio is a nice to have Experience with data stack technologies, such as Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as more »
CI/CD practices & tooling A research or mathematical background Experience working with dbt & dbt cloud Experience working with Data Orchestration tooling (e.g. Dagster, Prefect, etc) Experience working with Data Ingestion tooling (e.g. FiveTran, Keboola, etc) Experience working with Infrastructure-as-Code tooling (e.g. Terraform) Experience working with Node.js/ more »
with data stack technologies, such as Apache Iceberg & DBT. Preferred Skills • Experience on RDBMS like PostgreSQL would be a plus. Exposure to Apache Airflow, Prefect, Dagster would be beneficial. • Experience building modern enterprise-wide data and analytics systems in an asset management business and/or financial markets (Investment Banking more »
Glasgow, Scotland, United Kingdom Hybrid / WFH Options
Hypercube Consulting
Kubernetes and container services CI/CD, DevOps Additional experience with the following would be beneficial but not essential: Orchestration tools - Apache Airflow/Prefect/Azure Data Factory Containers and related services (AKS, Container Registry) Other desirable skills and experience Ability to get stuck in and grow with the more »
in data engineering, with a passion for sports. Pro-level skills in Python and Bash scripting. Experience dribbling through ETL processes with tools like Prefect or Airflow. Goal-scoring knowledge of containerization and orchestration tools like Docker and Kubernetes. Captain of the cloud with expertise in AWS, Azure, or GCP. more »
Designing and implementing real-time pipelines. * Designing and implementing data pipelines for CV/ML systems. * Experience with workflow management engines (i.e. Airflow, Luigi, Prefect, Dagster, Google Cloud Composer, AWS Step Functions, Azure Data Factory, UC4, Control-M). * Experience with data quality and validation. * Experience querying massive datasets using more »
Designing and implementing real-time pipelines. • Designing and implementing data pipelines for CV/ML systems. • Experience with workflow management engines (i.e. Airflow, Luigi, Prefect, Dagster, digdag.io, Google Cloud Composer, AWS Step Functions, Azure Data Factory, UC4, Control-M). • Experience with data quality and validation. • Experience querying massive datasets more »
Vacancy: Full Stack Engineer at Climate Policy Radar Full time | 4-day workweek | Central London-Hybrid | £60-70k DOE About us Climate Policy Radar is on a mission to organise, analyse, and democratise the world’s climate law and more »
