151 to 175 of 314 Apache Airflow Jobs in London

business environments is a plusWhile we advocate using the right tech for the right task, we often leverage: Python, PySpark, the PyData stack, SQL, Airflow, Databricks, Kedro (our open-source data pipelining framework), Dask/RAPIDS, Docker, Kubernetes, and cloud solutions such as AWS, GCP, and AzureFamiliarity with Generative ...

languages and database querying languagesExperience in large-scale data processing, microservices, API design, Kafka, Redis, MemCached, Observability tools (Dynatrace, Splunk, Grafana), and Orchestration tools (Airflow, Temporal)Demonstrated experience leading effective use of enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, code review, test ...

data challengesWhile we advocate using the right tech for the right task, we often leverage the following technologies: Python, PySpark, the PyData stack, SQL, Airflow, Databricks, Kedro (our open-source data pipelining framework), Dask/RAPIDS, Docker, Kubernetes, and cloud solutions such as AWS, GCP, and AzureExperience with Generative ...

notebooks for analysis dbt and Databricks data platform with Delta Lake Lightdash as our BI tool and semantic layer Streamlit for interactive data applications Airflow for orchestration Kubernetes for application deployment CI/CD with GitHub and CircleCI Infrastructure on AWS, deployed with Terraform/Spacelift Why else ...

stakeholders to the right data solutions Familiarity with using AI tools to accelerate your workflow Nice to Have Experience with orchestration tools like Dagster, Airflow, or similar Experience building real-time or near-real-time data pipelines Familiarity with machine learning workflows and feature engineering Experience embedded in teams ...

using dbt Core, with a strong grasp of top-down/bottom-up data modelling methodologies (Kimball, OBT, or equivalent). Build and maintain Airflow-orchestrated ELT workflows across the retail media data platform, including attribution pipelines supporting campaign performance and incrementality measurement. Contribute to Retail Media event tracking … design: batch vs. streaming, ETL/ELT, schema design, partitioning, and efficient storage patterns. Hands-on experience with dbt Core (or dbt Cloud) and Airflow for orchestration and transformation at scale. Solid grounding in data warehouse and data lake architecture, including dimensional modelling and layered architectures (Gold/Silver ...

Familiarity with PostgreSQL and Snowflake Preferred: Familiarity with Web Frameworks such as Django, Flask or FastAPI Preferred: Familiarity with event streaming platforms such as Apache Kafka Preferred: Familiarity with data pipeline platforms such as Apache Airflow Preferred: Familiarity with Java Preferred: Experience in one or more relevant ...

Familiarity with PostgreSQL and Snowflake Preferred: Familiarity with Web Frameworks such as Django, Flask or FastAPI Preferred: Familiarity with event streaming platforms such as Apache Kafka Preferred: Familiarity with data pipeline platforms such as Apache Airflow Preferred: Familiarity with Java Benefits and Perks We value the total ...

well as present complex findings clearly to both technical and non-technical audiencesProficient in using Tech Stack such as Amazon S3, Lambda function, Kafka, Apache Airflow or Bloomberg Teck Stack in production environmentExceptional problem-solving skills, numerical proficiency and high attention to detailAbility to work independently as well ...

preferred knowledge of AI infrastructure. Proficiency in programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem-solving skills and ability to work in a fast-paced environment. Excellent communication and collaboration skills. Proven experience ...

asubject, preferred knowledge of AI infrastructure. Proficiencyin programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem-solving skills and ability to work in a fast-paced environment. Excellent communication and collaboration skills. Proven experience ...

knowledge of AI infrastructure. Good proficiency in programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem-solving skills and ability to work in a fast-paced environment. Excellent communication and collaboration skills. Significant experience ...

preferred knowledge of AI infrastructure. Good proficiencyin programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem-solving skills and ability to work in a fast-paced environment. Excellent communication and collaboration skills. Significant experience ...

/silver/gold layers, and partner with analytics, ML, and trading teams to deliver trusted data assets. You will work with dbt, Spark, Airflow, Kafka, and streaming technologies to ensure data quality, governance, and efficient storage. #J-18808-Ljbffr ...

Commercial Data to build scalable data products supporting AI/ML, analytics, and commercial insights. ✅ Snowflake ✅ SQL & Python ✅ Collibra ✅ IQVIA/Veeva ✅ dbt/Airflow ✅ Pharma Commercial Data 📩 Interested candidates can share their updated resume to manasa@cygnuspro.com ...

Commercial Data to build scalable data products supporting AI/ML, analytics, and commercial insights. ✅ Snowflake ✅ SQL & Python ✅ Collibra ✅ IQVIA/Veeva ✅ dbt/Airflow ✅ Pharma Commercial Data 📩 Interested candidates can share their updated resume to manasa@cygnuspro.com ...

equivalent. Experience with big data sets and big data warehouses Experience with proxies, anti-bot measures and scraper monitoring. Experience with Dagster, Airflow, Prefect or another data orchestrator. Comfort working with TypeScript/Node.js. A pragmatic, hands-on approach and strong problem-solving skills. Desirable: Geospatial data experience (PostGIS ...

/S3 and SQL Server. You have several years of strong experience with ETL/ELT processes and APIs with tools such as dbt, Airflow, and Talend. You are proficient in using BI visualisation tools, in particular Power BI, Tableau & Metabase. You have good knowledge of data modelling & transformation ...

agentic solutions Graph modeling Personalization: propensity/uplift modeling, bandits, causal inference Libraries: scikit‐learn, XGBoost, LightGBM, CatBoost, CausalML, Keras, DoWhy Experience with dbt, Airflow, Looker or Metabase, AWS services such as S3 and Lambda Experience in designing and implementing model/metric endpoints as part of a platform ...

including approval, versioning and deployment standards. Build and maintain a portfolio of AI-first APIs across platform services including our core platform components, KDB, Airflow, configuration services, observability tooling, storage platforms and alerting systems. Develop agentic applications, including conversational assistants and autonomous support agents capable of investigating operational issues ...

scraper health A fast, pragmatic builder mindset, fluent with AI-assisted coding tools (e.g. Claude Code) Experience with a data orchestrator - Dagster ideally, or Airflow/Prefect Nice to have UK planning or property domain knowledge Time Off Rest properly. 37 days off in total, including your birthday ...

success, and field teams. Bias for action, strong ownership, and comfort operating in ambiguous, fast-moving environments. Nice to Have Experience with Snowflake, dbt, Airflow, BI platforms, semantic layers, or adjacent cloud data platform ecosystems. Experience creating technical enablement for SQL developers, analytics engineers, or modern data teams. Familiarity ...

advanced analytics — ideally in a hybrid PLG/sales-led SaaS environment Strong Python and SQL; experience with data modelling and pipeline tools (dbt, Airflow, Dagster) Deep expertise in predictive modelling, causal inference, survival analysis, and experimentation (A/B, diff-in-diff, instrumental variables) Experience working directly with ...

advanced analytics — ideally in a hybrid PLG/sales-led SaaS environmentStrong Python and SQL; experience with data modelling and pipeline tools (dbt, Airflow, Dagster)Deep expertise in predictive modelling, causal inference, survival analysis, and experimentation (A/B, diff-in-diff, instrumental variables)Experience working directly with product ...

multi-TB or PB scale Strong software engineering skills Experience delivering & maintaining production systems Experience with workflow orchestration for parallelised jobs; Flyte preferred, but Airflow, Prefect or similar tools are also relevant Experience building reliable, observable data systems, including retry strategies, backfills, data integrity checks, lifecycle/state tracking ...