of AWS ecosystems like Lambdas, step functions and ECS services. Experience with data stack technologies, such as Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as more »
Greater London, England, United Kingdom Hybrid / WFH Options
CommuniTech Recruitment Group
ECS services. Experience of Dremio is a nice to have Experience with data stack technologies, such as Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as more »
CI/CD practices & tooling A research or mathematical background Experience working with dbt & dbt cloud Experience working with Data Orchestration tooling (e.g. Dagster, Prefect, etc) Experience working with Data Ingestion tooling (e.g. FiveTran, Keboola, etc) Experience working with Infrastructure-as-Code tooling (e.g. Terraform) Experience working with Node.js/ more »
in data engineering, with a passion for sports. Pro-level skills in Python and Bash scripting. Experience dribbling through ETL processes with tools like Prefect or Airflow. Goal-scoring knowledge of containerization and orchestration tools like Docker and Kubernetes. Captain of the cloud with expertise in AWS, Azure, or GCP. more »
of experience in data engineering, with a passion for sports.Pro-level skills in Python and Bash scripting.Experience dribbling through ETL processes with tools like Prefect or Airflow.Goal-scoring knowledge of containerization and orchestration tools like Docker and Kubernetes.Captain of the cloud with expertise in AWS, Azure, or GCP.This is your more »
building robust data pipelines – using the best of open-source data engineering and scientific Python toolset. Our tech stack includes Airbyte for data ingestion, Prefect for pipeline orchestration, AWS Glue for managed ETL, along with Pandas and PySpark for pipeline logic implementation. We utilize Delta Lake and PostgreSQL for data … with modern software engineering practices, including 12factor, CI/CD, and Agile methodologies. Deep understanding of Spark (PySpark), Python (Pandas), orchestration software (e.g. Airflow, Prefect) and databases, data lakes and data warehouses. Experience with cloud technologies, particularly AWS Cloud services, with a particular focus on using AWS Glue, S3, RDS more »
Vacancy: Senior Full Stack Engineer at Climate Policy Radar Full time | 4-day workweek | Central London-Hybrid | £80-90k DOE About us Climate Policy Radar is on a mission to organise, analyse, and democratise the world’s climate law more »
