10 of 10 Apache Airflow Jobs in the City of London

maintain scalable, cloud-based data pipelines and architectures to support advanced analytics and machine learning initiatives. Develop robust ELT workflows using tools like dbt, Airflow, and SQL (PostgreSQL, MySQL) to transform raw data into high-quality, analytics-ready datasets. Collaborate with data scientists, analysts, and software engineers to ensure … however Azure exposure is essential. Data Warehousing: Proven expertise with Snowflake – schema design, performance tuning, data ingestion, and security. Workflow Orchestration: Production experience with Apache Airflow (Prefect, Dagster or similar), including authoring DAGs, scheduling workloads and monitoring pipeline execution. Data Modeling: Strong skills in dbt, including writing modular ...

communicate clearly with technical and non-technical stakeholders Nice to Have Experience with dbt or other transformation frameworks Exposure to data orchestration tools (Airflow, etc.) Understanding of data governance, lineage, and metadata management Experience supporting BI tools (Power BI, Tableau, Looker, etc.) Python experience for data tooling or automation ...

such as React or Next.js . Experience creating and maintaining APIs, working with relational/non‐relational databases. Familiarity with data orchestration tools (e.g. Airflow ) and data warehouse/lake design. Practical knowledge of AWS or Azure cloud environments. Strong understanding of Git , CI/CD , and modern deployment ...

data modeling skills. Hands-on experience with cloud data warehouses (Snowflake, BigQuery, Databricks). Proficiency with ELT tools (dbt, Fivetran, Matillion) and orchestration frameworks (Airflow, Prefect). ...

growth, including Agentic development. Technology/Skills requirements SQL ELT/ETL Data Modelling dbt models Version control (Git) Data processing and orchestration using Airflow or similar Google BigQuery or Redshift Cloud based services: GCP (preferred) or AWS Agentic development frameworks Automations About You 4 years+ experience ...

degree of ownership Nice to Have Experience with dashboarding or data visualisation tools Exposure to TypeScript or API development Familiarity with tools such as Airflow, dbt, or Databricks Experience integrating enterprise systems (ERP, CRM, operational platforms) What’s On Offer Join a category-defining, rapidly scaling startup Work closely ...

programming skills in Python; experience with ML libraries such as Snowpark, PySpark, or PyTorch Experience with containerization tools like Docker and orchestration tools like Airflow or Astronomer Familiarity with cloud platforms (AWS, Azure) and ML services (e.g., SageMaker, Vertex AI) Experience with CI/CD pipelines and automation tools ...

PyTorch and TensorFlow. Experience with cloud platforms (AWS, EMR, Kubernetes, Docker) and ML platforms (Databricks, SageMaker). Familiarity with workflow management tools (e.g., Airflow). Strong understanding of software design principles, data structures, and design patterns. Ability to debug, test, and monitor complex systems effectively. Preferred: qualifications: Experience with ...

Linux environment. - Experience in building automation tools and managing system configurations. - Knowledge of C++, KDB/q, and experience with technologies like Slurm, Airflow, Kafka, or AMPS. - Background in enhancing system stability, scalability, and performance while conducting root cause analyses to resolve incidents efficiently. - Observability skillset, monitoring and analysis ...

Desired Skills (Bonus Points) Experience with MLOps tooling (MLflow, Kubeflow, Weights & Biases, or similar) Building data pipelines (real-time or batch) using tools like Apache Spark, Kafka, Airflow, or dbt Familiarity with recommender systems, transformers, or graph neural networks Exposure to model optimisation techniques (quantisation, distillation, efficient inference ...