101 to 125 of 312 Apache Airflow Jobs in London

production problems and taking responsibility for critical infrastructure. Startup Mindset: Proactive, resourceful and comfortable taking ownership in a fast-moving engineering environment. Bonus : with Apache Airflow, real-time data platforms, AI/ML infrastructure, LLM agents, GPU infrastructure or financial-market systems. Why Permutable Real Ownership: Take significant ...

Comfortable building from scratch in a fast-moving, product-led environment Experience with vector databases and vector search in modern AI systems Desirable: Spark, Airflow, Kafka, Elasticsearch/OpenSearch, event-driven architectures Cloud experience (AWS, GCP or Azure), GCP is a plus Why join High impact and ownership ...

Comfortable building from scratch in a fast-moving, product-led environment Experience with vector databases and vector search in modern AI systems Desirable: Spark, Airflow, Kafka, Elasticsearch/OpenSearch, event-driven architectures Cloud experience (AWS, GCP or Azure), GCP is a plus Why join High impact and ownership ...

database querying languages Experience in large-scale data processing, microservices, API design, Kafka, Redis, MemCached, Observability tools (Dynatrace, Splunk, Grafana), and Orchestration tools (Airflow, Temporal) Proficiency in automation, continuous delivery methods, and all aspects of the Software Development Life Cycle Advanced understanding of agile methodologies, CI/CD, application ...

debugging, the advanced stuff that separates architects from diagram-drawers. Lakehouse fluency — Medallion architecture, Delta Lake, Unity Catalog, governance, orchestration (Workflows, DLT/Lakeflow, Airflow, ADF); Microsoft Fabric exposure a bonus. Battle-tested in migrations — you've led large transformation programs and have the scars and success stories ...

compliance requirements Excellent stakeholder engagement and communication skills Nice to have Experience in financial markets or market data platforms Knowledge of BPM tools (e.g., Airflow, Step Functions) Familiarity with observability tools (e.g., Grafana) Exposure to AI/ML or GenAI-driven automation capabilities We offer EPAM Employee Stock Purchase ...

triaging, escalating, and driving incidents to resolution under pressure. What you'll do: Design, develop, and maintain high-performance, product-centric data pipelines using Airflow, DBT, and Python. Architect and optimize the massive-scale data warehouse and lakehouse that serves as our single source of truth for all customer ...

data technology such as BigQuery, Snowflake, Redshift, Hive, Spark, Vertica, or StarRocks; Experience with ETL/ELT tools or orchestration frameworks such as Airflow, dbt, or internal frameworks; Proficiency in at least one programming language for data and services, such as Python, Java, Golang, Kotlin, or JavaScript/TypeScript ...

/ELT frameworks, and cloud data platforms such as Azure, AWS, or GCP. Data modelling and pipeline orchestration using tools such as Airflow, Data Factory, dbt, or similar. Integrate CDP data sources across digital, CRM, transactional, and behavioural data; support identity resolution, consent handling, audience activation, journey events, trigger ...

systems, inventory extraction from application metadata tables (reporting opening). Columnar and lake formats (Parquet or similar), large object stores, orchestration platforms (Airflow or similar). Working-level knowledge of graph databases; data contracts and data quality frameworks; catalogue platforms (DataHub or similar) on the ingestion side. ...

ontologies, and versioned/temporal data. Understanding of how data structures feed RAG and LLM retrieval quality. SQL proficiency; experience with orchestration tools (e.g., Airflow) and cloud data services. Familiarity with data governance, security, and privacy practices. Strong documentation and cross-team communication skills. WHO YOU ARE You think ...

Snowflake and dbt experience: modelling, semantic layers, agents & skills, testing, performance and cost tuning. Production experience with a pipeline orchestrator, ideally Dagster (or similar Airflow, Prefect), including dependent workloads, partial failures, and observability. Modern cloud infrastructure (Azure/AWS/GCP) and Kubernetes experience deploying and operating containerised workloads ...

comparable transformation framework – is a strong advantage and an area we’d invest in developing. Experience with data orchestration tools such as Airflow or equivalent. Python or another scripting language for data manipulation and automation. Background in consumer lending, payments, or embedded finance products. Experience working in an Analytics ...

metrics layers. Experience applying AI to Analytics Engineering workflows or developing AI-ready data products. Knowledge of orchestration and ingestion tools such as Airflow, Dagster or Fivetran. Python experience for automation or data engineering tasks. Experience working in regulated financial services or another highly data-driven organisation. Snowflake experience ...

data platforms, or significantly evolving existing ones. Experience with data quality and observability, using dbt or complementary tooling. Familiarity with orchestration tools such as Airflow, Dagster, or Prefect. Experience with semantic layers, metrics frameworks, or analytics consumption patterns. Exposure to data governance, access control, or analytics enablement at scale. ...

various platforms Experience briefing, designing and implementing ETL solutions end-to-end, from requirements gathering through to deployment Experience with data orchestration tools (e.g. Airflow, Prefect) and building scalable data pipelines Strong Git and collaborative development skills (e.g. GitHub, GitLab) Strong understanding of data fundamentals: MDM, data integrity best ...

find to improve model and system performance. Build reliable ML infrastructure Develop and maintain data and machine learning workflows using technologies such as Apache Airflow. Help improve CI/CD, automated testing, monitoring and reproducibility across our ML stack. Engineer on AWS Build and improve cloud infrastructure using services … expect you to know everything: PyTorch, TensorFlow or JAX Hugging Face LLM APIs and open-source models RAG and vector databases Apache Airflow AWS S3 ECS/EKS Redshift Docker Kubernetes GitHub Actions Pulumi or Terraform SQL Model monitoring and observability Distributed processing Financial markets, economics or commodities ...

tooling, automated testing and reliable deployment processes. Startup Mindset: Proactive, resourceful and comfortable taking responsibility in a small, fast‐moving engineering team. Experience with Apache Airflow, Kubernetes, real‐time data platforms, AI/ML infrastructure, LLM agents, GPU infrastructure or financial‐market systems would be useful ...

validate transformations and trace data across platforms. Tooling/Delivery Methods Working knowledge of scheduling/orchestration tools such as Autosys and/or Apache Airflow (monitoring schedules, reruns, failure triage). Experience with CI/CD and release controls (Git, Harness, UrbanCode Deploy (UCD), Red Hat OpenShift ...

times series data, they use TimescaleDB but other experience with similar platforms is fine You have experience with Orchestration platforms such as Dagster or Airflow You're collaborative with great communication skills What's in it for you: Salary to £120k + bonus X3 weeks per year work anywhere ...

support critical systems Core Skills and Technologies Experience running distributed data and analytics systems at scale using tools such as Spark, Kafka, Trino or Airflow Strong Linux skills and proficiency in Python for automation and integration Familiarity with infrastructure as code, using Terraform or Ansible Deep understanding ...

technologies CI/CD and DevOps practices Docker/containerisation, ECS, Fargate or Kubernetes Kafka/Kinesis, Flink or other real-time data technologies Airflow and data engineering pipelines Data visualisation and dashboarding Datadog or similar monitoring/logging platforms Automated testing, TDD, BDD and performance testing Low-latency ...

scalable data assets that can be used in BI and other user facing tools. Experience working with data pipeline orchestration tools like Prefect or Airflow and comfortable working with Python for data orchestration. Ability to communicate clearly with both technical and non-technical stakeholders, translating data into business value. ...

wait to be told what to analyze next. Nice to Have Experience in crypto, payments, banking, fraud, or compliance. Familiarity with dbt, Airflow, or similar data-stack tooling. Exposure to causal inference (difference-in-differences, propensity scoring, uplift modeling). Experience deploying models to production (batch or real-time ...

database querying languages Experience in large‐scale data processing, microservices, API design, Kafka, Redis, MemCached, Observability tools (Dynatrace, Splunk, Grafana), and Orchestration tools (Airflow, Temporal) Demonstrated experience leading effective use of enterprise‐authorized AI‐assist­ed software development tools within the work environment (e.g., for coding, code review, test acceleration ...