17 of 17 Apache Airflow Jobs in Central London

highly regulated financial settings. Key Technologies & Tools Core ML: scikit-learn, PyTorch, TensorFlow, XGBoost, LightGBM Data Manipulation: Pandas, NumPy, LangGraph MLOps & Orchestration: MLflow, Apache Airflow Databases: Neo4j, MongoDB API Development: FastAPI Big Data (Beneficial): Apache Hadoop, Apache Spark (PySpark) What We Need From ...

industry. Strong full-stack experience with Python , Java (Spring Boot) , React , SQL, and relational databases. Hands-on experience with modern data engineering tools (e.g. Airflow, Spark, Kafka, dbt, Snowflake or similar). Experience with cloud platforms , containerisation (Docker/Kubernetes) , and CI/CD pipelines . Solid understanding ...

communicate clearly with technical and non-technical stakeholders Nice to Have Experience with dbt or other transformation frameworks Exposure to data orchestration tools (Airflow, etc.) Understanding of data governance, lineage, and metadata management Experience supporting BI tools (Power BI, Tableau, Looker, etc.) Python experience for data tooling or automation ...

such as React or Next.js . Experience creating and maintaining APIs, working with relational/non‐relational databases. Familiarity with data orchestration tools (e.g. Airflow ) and data warehouse/lake design. Practical knowledge of AWS or Azure cloud environments. Strong understanding of Git , CI/CD , and modern deployment ...

downstream users consume data Experience working in cloud environments (AWS or GCP) Familiarity with data quality testing, deployment workflows, and orchestration concepts (e.g. Airflow) Experience working in Agile, cross-functional product or platform teams Python experience for automation or data tooling is a plus ...

with hands on Snowflake experience • Proven dbt experience at scale • Strong dimensional modelling using Kimball principles • Python for data engineering tasks • Experience with Airflow or similar orchestration tools • Git based workflows • Familiarity with BI tools such as Tableau, Looker, or Power BI • Experience working in cloud environments including ...

Data Engineer in a consultancy or complex delivery environment Deep, hands-on expertise with Snowflake Experience with the modern data stack, including dbt, Airflow (or similar) and Python Solid experience with AWS and/or Azure Strong SQL skills and performance optimisation experience Familiarity with CI/CD, DevOps ...

analytical skills. Strong communication, and collaboration abilities. Preferred Qualifications Experience with columnar DB engines like Clikchouse, KDB/Q or similar Experience with Airflow, Dagster or similar tools. Exposure to container technologies: Docker, Podman etc Knowledge of 'big data' technologies (Hadoop, Spark, Parquet) Experience with TAQ data, and exchange ...

data modeling skills. Hands-on experience with cloud data warehouses (Snowflake, BigQuery, Databricks). Proficiency with ELT tools (dbt, Fivetran, Matillion) and orchestration frameworks (Airflow, Prefect). ...

project roadmaps, proposals, and PoCs, collaborating with Data and AI Engineers on full lifecycle delivery Build scalable, production-ready solutions using ETL/Airflow pipelines, containerization (Docker), and cloud platforms (AWS, Azure, GCP) Support clients through all phases of AI implementation, from EDA and model validation to responsible, ethics ...

degree of ownership Nice to Have Experience with dashboarding or data visualisation tools Exposure to TypeScript or API development Familiarity with tools such as Airflow, dbt, or Databricks Experience integrating enterprise systems (ERP, CRM, operational platforms) What’s On Offer Join a category-defining, rapidly scaling startup Work closely ...

programming skills in Python; experience with ML libraries such as Snowpark, PySpark, or PyTorch Experience with containerization tools like Docker and orchestration tools like Airflow or Astronomer Familiarity with cloud platforms (AWS, Azure) and ML services (e.g., SageMaker, Vertex AI) Experience with CI/CD pipelines and automation tools ...

experience, managing dependencies and build pipelines without internet access, experience building APIs for data enrichment services, Orchestration and Data Pipeline experience with Prefect or Airflow and K8s or Swarm, experience with Configuration and Automation of business workflow tooling e.g. within Jira; experience with a range of Database and Storage ...

with engineers, architects, and product managers on data solutions. Support deployment, testing, and documentation of data products. Work with cloud-based tools, including BigQuery, Airflow, Terraform, DBT, and GIT. Continuously learn new tools and technologies, contributing to team knowledge and best practices. Key Skills & Experience: 1–3 years' experience … roles. Strong SQL and Python skills. Exposure to cloud platforms (GCP preferred; Azure/AWS acceptable) . Familiarity with data tooling: DBT, GIT, Terraform, Airflow, Docker (nice to have). Good problem-solving skills, attention to detail, and collaborative mindset. Interested in Agile practices, Test-Driven Design, and modern ...

Desired Skills (Bonus Points) Experience with MLOps tooling (MLflow, Kubeflow, Weights & Biases, or similar) Building data pipelines (real-time or batch) using tools like Apache Spark, Kafka, Airflow, or dbt Familiarity with recommender systems, transformers, or graph neural networks Exposure to model optimisation techniques (quantisation, distillation, efficient inference ...

security. Drive modernisation by transitioning from legacy systems to a lean, scalable platform. Act as a lead expert for technologies such as AWS, DBT, Airflow, and Databricks. Establish best practices for data modelling, ingestion, storage, streaming, and APIs. Governance & Standards Ensure all technical decisions are well-justified, documented … engineering, including data ingestion, transformation, and storage. Significant hands-on experience with AWS and its data services. Expert-level skills in SQL, Python, DBT, Airflow and Redshift. Confidence in coding, scripting, configuring, versioning, debugging, testing, and deploying. Ability to guide and mentor others in technical best practices. A product ...

Uses Python day-to-day Has operated BigQuery at scale , and understands how queries behave across hundreds of terabytes Has built production systems with Airflow/Composer , DBT , Terraform and Docker Is comfortable with GKE , Cloud Run or Cloud Functions Has worked with streaming systems built on Dataflow/… Apache Beam Has experience working in regulated environments and alongside security teams, ideally with exposure to ISO27001 Can work closely with non-technical stakeholders and shape solutions rather than just execute tickets *Visa sponsorship is not available, so please only apply if you have full UK working rights ...