21 of 21 Part-Time Apache Airflow Jobs in London

Build and optimize batch and streaming data pipelines with strong performance, fault tolerance, and observability \n Develop and operate workflow orchestration (e.g., Apache Airflow) to schedule, monitor, and manage data movement and transformations \n Model and transform data for analytics using SQL and dbt to support business intelligence … Hudi, or similar) \n Strong SQL skills and experience with SQL-based transformation tooling (e.g., dbt) \n Experience designing and operating orchestration pipelines using Airflow or similar tools \n Experience designing and building streaming pipelines using Kafka, Pub/Sub, or similar messaging systems \n\n Preferred qualifications, capabilities ...

operate batch and streaming data pipelines with strong scalability, performance, and fault tolerance \n Develop and manage workflow orchestration using tools such as Apache Airflow to support reliable, observable, and well-scheduled data movement and transformations \n Implement and optimize data models and warehouse structures to support analytics … testing practices \n Experience with SQL and familiarity with SQL-based workflow management tools such as dbt \n Experience with orchestration tools such as Airflow (or similar) \n Understanding of messaging/streaming systems such as Kafka or Pub/Sub (or similar) \n Familiarity with infrastructure-as-code ...

with distributed event stores and stream-processing platforms such as Kafka of Kinesis. ● Experience working with batch processing frameworks, such as DBT, Argo Workflows, Apache Airflow, etc. ● Familiarity with Docker, Kubernetes, Amazon EKS ● Familiarity with Continuous Integration with GitHub Actions ● Familiarity with Test-Driven Development ...

Flink etc. \n Solid grasp of Kubernetes, CI/CD and Terraform. \n Working knowledge of ETL and ELT frameworks and orchestration tools like Airflow and dbt. \n Ability to provide clear input, guide, empower junior members of the team to achieve desired outcomes. \n Familiarity with machine learning ...

Data Warehousing (we use Databricks but experience with other platforms is fine) \n \n MLOps implementation (desirable but not required) \n \n Airflow (or other orchestration tooling) \n \n Governance \n\n Why else you'll love it here \n \n Wondering what the salary for this role ...

Streamlit, FastAPI, or Flask, enabling business stakeholders to interact directly with model outputs. \n Experience with orchestration or transformation tooling such as dbt, Airflow, or Prefect, demonstrating an ability to build reproducible and maintainable pipelines. \n A tech-agnostic mindset, open to selecting the right tool for each problem ...

Streamlit, FastAPI, or Flask, enabling business stakeholders to interact directly with model outputs. \n Experience with orchestration or transformation tooling such as dbt, Airflow, or Prefect, demonstrating an ability to build reproducible and maintainable pipelines. \n A tech-agnostic mindset, open to selecting the right tool for each problem ...

support business requirements \n Develop and maintain data ingestion and processing systems using various tools and technologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. \n Implement data storage solutions using different types of databases, such as relational, non-relational, or cloud-based. \n Working collaboratively with … PostgreSQL) \n You have framework experience within either Flask, Tornado or Django, Docker \n Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo \n Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. \n Data acquisition and development of data sets ...

Databricks data platform with Delta Lake \n Lightdash as our BI tool and semantic layer \n Streamlit for interactive data applications \n Airflow for orchestration \n Kubernetes for application deployment \n CI/CD with GitHub and CircleCI \n Infrastructure on AWS, deployed with Terraform/Spacelift ...

complex datasets. You can write optimized SQL queries to extract "financial truth". Exposure to other technical skills considered a plus (Dbt, Python, Airflow, BI tools). \n \n Foundational Finance Literacy: You don’t need to have a finance/accounting background, but you are comfortable with basic ...

Looker, Grafana, Lightdash, or Superset \n \n Ability to build and manage data pipelines that are modularised and scalable, using tools like DBT and Airflow \n \n Familiarity with observability/reliability concepts (SLIs, SLOs, incidents) \n \n Some experience with Python/data transformation (DBT, etc.) is helpful ...

exposed to LLM-based agents. \n Experience with search relevance & recommendation systems - ranking algorithms, semantic search, personalisation. \n Hands-on with Snowflake, Databricks, Airflow, Kafka. \n\n Why Join Us \n \n Work on firm-wide platforms used by thousands of data scientists, ML engineers, and analysts across JPMC ...

support business requirements \n Develop and maintain data ingestion and processing systems using various tools and technologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. \n Implement data storage solutions using different types of databases, such as relational, non-relational, or cloud-based. \n Working collaboratively with … PostgreSQL) \n You have framework experience within either Flask, Tornado or Django, Docker \n Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo \n Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. \n Data acquisition and development of data sets ...

Technical Mastery: You bring expert-level SQL skills and are fully comfortable building and maintaining your own robust data pipelines using dbt, Airflow, and Snowflake. Beyond querying, you use Python for advanced automation and forecasting, and you apply statistical rigor (e.g., Bayesian statistics, causal inference) to solve complex product ...

analysis and get things done. \n\n Good to have: \n \n \n Experience in Fintech domain \n \n Knowledge of utilities like Airflow/Github/DBT \n \n Experience with user-facing products and data \n\n *** Please note we are not able to offer visa sponsorship ...

model work. \n Strong software engineering fundamentals - you build reliable, well-tested, maintainable systems. Python, Kotlin/Java, SQL. \n Experience with ML orchestration (Airflow, Kubeflow, or equivalent), model registries (MLflow or similar), and container-based deployment \n End-to-end understanding of the ML lifecycle - data ingestion through ...

liquidity management domains. \n \n You are proficient with SQL and know your way around data pipeline management tools such as Snowflake, dbt, Git, Airflow, Python, and Lightdash. You're comfortable owning analytics from data transformation through to delivering actionable insights. \n \n You are commercially minded. Able ...

impact of what you shipped; recommending changes and new initiatives. \n \n Analytical thinker with strong analysis skills (SQL, Python), data modelling (e.g. airflow, dbt) and experience using event data (e.g. Mixpanel). \n \n Hands-on experience designing and running experiments. You know how to design an experiment ...

analysis and get things done. \n\n Good to have: \n \n \n Experience in the Fintech domain \n \n Knowledge of utilities like Airflow/Github/DBT \n \n Experience with user-facing products and data \n\n Additional Information \n Some of our benefits: \n Base ...

Standards and Engineering Effectiveness within development squads. \n \n • Technical Experience: Demonstrate expertise in using SQL (Spark, Dremio), Python, GitHub and data orchestration tools (Airflow, Oozie) for data wrangling, building data pipelines and developing analytical interfaces. \n \n • AI-Assisted Analytics: Bring experience and curiosity towards AI-assisted analytics … knowledge and experience of using business intelligence, ETL frameworks and visualisation tools such as Tableau. \n • Experience with Python, GitHub, data orchestration tools (Oozie, Airflow) for data wrangling, building data pipelines and building analytical/web interfaces. \n • Good understanding of the full data lifecycle and understanding of typical ...

Job Description hackajob is collaborating with Wise to connect them with exceptional professionals for this role. \n Company Description \n Wise is a global technology company, building the best way to move and manage the ...