101 to 125 of 281 Apache Airflow Jobs in London

scripts and CI/CD automationWorking knowledge of modern MLOps stacks including experiment tracking and artifact managementHands-on experience with orchestration tools (e.g., Kubeflow, Apache Airflow, Metaflow or Prefect)Demonstrated skills with Docker, Kubernetes and distributed deploymentsPractical knowledge of Infrastructure-as-Code (Terraform) and a major cloud provider ...

validate transformations and trace data across platforms. Tooling/Delivery Methods Working knowledge of scheduling/orchestration tools such as Autosys and/or Apache Airflow (monitoring schedules, reruns, failure triage). Experience with CI/CD and release controls (Git, Harness, UrbanCode Deploy (UCD), Red Hat OpenShift ...

data Experience with data visualization tools to create dashboards and reports Understanding of data engineering concepts (ETL, data pipelines) and automation tools such as Apache Airflow Familiarity with cloud based computing resources such as AWS Interviewing with Veeva We value your time and believe in a transparent hiring ...

need both skillsets below - strength in one is enough: Hands-on: building AI/ML pipelines or prototypes; vector databases; prompt engineering; orchestration tools (Airflow/Prefect); Git Advisory: designing AI/data architectures; Agentic AI principles (LangGraph, CrewAI, AutoGen); mentoring specialists without formal authority; AI governance (security, privacy ...

support critical systems Core Skills and Technologies Experience running distributed data and analytics systems at scale using tools such as Spark, Kafka, Trino or Airflow Strong Linux skills and proficiency in Python for automation and integration Familiarity with infrastructure as code, using Terraform or Ansible Deep understanding ...

Experience with cloud platforms and services for data storage and compute (for example AWS, Google Cloud Platform, or Azure) Experience with orchestration technologies like Airflow Knowledge of/experience with langraph/langchain or similar frameworks, embedding models, vector, graph databases is a plus A strong drive to staying ...

looking for? Core skills and technologies Experience running distributed data and analytics systems at scale using tools such as Spark, Kafka, Trino or Airflow Strong Linux skills and proficiency in Python for automation and integration Familiarity with infrastructure as code, using Terraform or Ansible Deep understanding of AWS analytics ...

with everything else prioritised alongside planned engineering work. Technical Requirements Cloud Platform: Hands-on experience with GCP (Pub/Sub, BigQuery, Dataflow, Composer/Airflow, Cloud Functions, GKE and Cloud Build), or equivalent experience on another cloud and a willingness to go deep on GCP. Languages: Strong ...

with everything else prioritised alongside planned engineering work. Technical Requirements Cloud Platform: Hands-on experience with GCP (Pub/Sub, BigQuery, Dataflow, Composer/Airflow, Cloud Functions, GKE and Cloud Build), or equivalent experience on another cloud and a willingness to go deep on GCP. Languages: Strong ...

scalable data assets that can be used in BI and other user facing tools. Experience working with data pipeline orchestration tools like Prefect or Airflow and comfortable working with Python for data orchestration. Ability to communicate clearly with both technical and non-technical stakeholders, translating data into business value. ...

wait to be told what to analyze next. Nice to Have Experience in crypto, payments, banking, fraud, or compliance. Familiarity with dbt, Airflow, or similar data-stack tooling. Exposure to causal inference (difference-in-differences, propensity scoring, uplift modeling). Experience deploying models to production (batch or real-time ...

debug a feature pipeline with an engineer in the same afternoon. **Nice-to-have*** Experience with n8n or other workflow automation tools (Airflow, Prefect, Dagster).* Exposure to payments, fintech, SaaS, or other recurring-revenue businesses.* DBT experience for analytics engineering.* Experience integrating LLMs or GenAI into commercial workflows. ...

environments is a plus While we advocate using the right tech for the right task, we often leverage: Python, PySpark, the PyData stack, SQL, Airflow, Databricks, Kedro (our open-source data pipelining framework), Dask/RAPIDS, Docker, Kubernetes, and cloud solutions such as AWS, GCP, and Azure Familiarity with ...

metrics layers. Experience applying AI to Analytics Engineering workflows or developing AI-ready data products. Knowledge of orchestration and ingestion tools such as Airflow,DagsterorFivetran. Python experience for automation or data engineering tasks. Experience working in regulated financial services or another highly data-driven organisation. Snowflake experience, given ...

models, schemas to support business requirements Develop and maintain data ingestion and processing systems using various tools andtechnologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. Implement data storage solutions using different types of databases, such asrelational, non-relational, or cloud-based. Working collaboratively with the client …/Azure SQL, PostgreSQL) You have framework experience within either Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving ...

Engineering Strong experience working with AWS in data engineering environments. Hands‐on experience with AWS Glue for data integration and processing. Strong experience using Apache Airflow for workflow orchestration and pipeline management. Advanced Python development skills. Experience with Apache Spark or similar distributed data processing technologies would ...

with Linux and networking. Experience with build tooling such as Bazel would be beneficial. Exposure to analytics, workflow or distributed‐compute technologies, such as Apache Airflow, Dask, JupyterHub or comparable tools, would be helpful. An interest in applying AI to software engineering, with experience of AI‐assisted development ...

times series data, they use TimescaleDB but other experience with similar platforms is fine You have experience with Orchestration platforms such as Dagster or Airflow You're collaborative with great communication skills What's in it for you: Salary to £85k + bonus X3 weeks per year work anywhere ...

large tables. Python for data transformation and pipeline orchestration. Experience with a distributed query engine (Presto, Spark, Hive or similar) and a workflowscheduler (Airflow or similar). Comfortable working in a code review based workflow with Git. Ability to work as part of a team, as well as work ...

database querying languages Experience in large‐scale data processing, microservices, API design, Kafka, Redis, MemCached, Observability tools (Dynatrace, Splunk, Grafana), and Orchestration tools (Airflow, Temporal) Demonstrated experience leading effective use of enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, code review, test acceleration ...

data ecosystem, particularly BigQuery. Advanced SQL skills and strong experience with Python. Strong experience with modern data engineering and orchestration technologies such as dbt, Airflow/Cloud Composer, and related tools. Experience designing scalable data platforms, pipelines, data models, and integration patterns. Strong understanding of data governance, security, quality ...

with Postgres plus a warehouse or analytics store such as BigQuery or ClickHouse. Experience with streaming (Kafka, Pub/Sub or similar) and orchestration (Airflow, Dagster or similar). Data modelling for audit trails, lineage and multi-tenant isolation. Security-minded handling of sensitive data. Nice to have Data ...

data scientists in the "PyData" ecosystem (Numpy, Pandas) is desirable. Familiarity with some of the other tools in our stack is desirable: Redis Postgres Airflow Spark This is a hybrid role based in London, UK. About Arrive Arrive, including brands like EasyPark, Flowbird, RingGo, ParkMobile and Parkopedia ...

/fine-tuning trade-offs, transformers and major model families, LangChain or similar Marketplace or B2B dynamics; AWS/GCP/Azure ML infra; Airflow, Docker, dbt, Snowflake, Lightdash or similar #J-18808-Ljbffr ...

data modelling Databricks as our datalake platform Kubernetes for data services Orchestra for task orchestration Terraform for infrastructure Lightdash for data applications Airflow and Astronomer for job scheduling and tracking Circle CI for continuous deployment Parquet and Delta file formats on S3 for data lake storage Spark for data ...