of AWS ecosystems like Lambdas, step functions and ECS services. Experience with data stack technologies, such as Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as more »
building robust data pipelines – using the best of open-source data engineering and scientific Python toolset. Our tech stack includes Airbyte for data ingestion, Prefect for pipeline orchestration, AWS Glue for managed ETL, along with Pandas and PySpark for pipeline logic implementation. We utilize Delta Lake and PostgreSQL for data … with modern software engineering practices, including 12factor, CI/CD, and Agile methodologies. Deep understanding of Spark (PySpark), Python (Pandas), orchestration software (e.g. Airflow, Prefect) and databases, data lakes and data warehouses. Experience with cloud technologies, particularly AWS Cloud services, with a particular focus on using AWS Glue, S3, RDS more »
Vacancy: Full Stack Engineer at Climate Policy Radar Full time | 4-day workweek | Central London-Hybrid | £60-70k DOE About us Climate Policy Radar is on a mission to organise, analyse, and democratise the world’s climate law and more »
in data engineering, with a passion for sports. Pro-level skills in Python and Bash scripting. Experience dribbling through ETL processes with tools like Prefect or Airflow. Goal-scoring knowledge of containerization and orchestration tools like Docker and Kubernetes. Captain of the cloud with expertise in AWS, Azure, or GCP. more »
