151 to 175 of 477 Apache Airflow Jobs in the UK

pipelines Strong programming skills in Python and SQL or similar Experience with technologies such as Spark, Databricks, AWS, Azure, GCP and/or Airflow Strong focus on data quality, testing and reliability Solid software engineering fundamentals and high engineering standards Strong communication and collaborative skills Comfortable working with ambiguity ...

pipelines Strong programming skills in Python and SQL or similar Experience with technologies such as Spark, Databricks, AWS, Azure, GCP and/or Airflow Strong focus on data quality, testing and reliability Solid software engineering fundamentals and high engineering standards Strong communication and collaborative skills Comfortable working with ambiguity ...

maintaining data pipelines at scale Experience with a modern data stack (e.g. Snowflake, dbt, Fivetran, Debezium or similar) Experience with orchestration tools such as Airflow, Dagster or Prefect Proficiency in Python for building production data workflows Familiarity with data warehousing concepts and modelling patterns Experience working with cloud platforms ...

every day. Extensive experience in SQL/Python/Pyspark and/or other languages relevant to data processingExtensive experience in dbt and ideally Airflow (or other orchestration tools)Extensive experience in Entity-Relationship modelling and Dimensional modellingExperience with Cloud Data Warehousing (eg Snowflake, Databricks or BigQuery) and Cloud ...

modeling skills for analytical/transactional data systems. Managing infrastructure, networking, and security on AWS using Terraform. In-depth knowledge about workflow orchestrators, specifically Airflow or Dagster. In-depth knowledge of Python and building data systems using Python. An understanding of API frameworks such as FastAPI and libraries such ...

leave and bring them back with offers that match what they actually want. Snowflake (with Snowpipe and Cortex Analyst LLM agent). dbt, Python. Airflow (Astronomer), AWS (S3, Lambda), Terraform, GitHub Actions. Omni BI on top. Reverse ETL into marketing platforms. We’re early in the build ...

agile environments at scale Domain expertise in retail, hospitality or consumer technology is valuable Familiarity with modern data stack tooling (e.g. Snowflake, dbt, Looker, Airflow, or #J-18808-Ljbffr ...

using: Kafka as our message transport Flink for (near) real time processing Datahub as our catalog BigQuery as our warehouse Airflow (GCP Composer) for scheduling DBT for data transformation Montecarlo for monitoring The platform here encompasses the end-to-end, first for real time/streaming use cases ...

Application Resiliency, and Security. Preferred qualifications, capabilities, and skills Production experience with Databricks (Delta Lake, Unity Catalog, MLflow, Databricks Jobs) and workflow orchestration with Apache Airflow. Strong working knowledge of both supervised and unsupervised techniques, including tree-based and kernel methods (gradient boosting, random forest, SVM) and anomaly-detection ...

. Knowledge of regulatory reporting and treasury operations in retail bankingExposure to Python, Go or similar languages. Experience working with orchestration frameworks such as Airflow/LuigiHave previously used dbt, dataform or similar tooling. Used to AGILE ways of working (Kanban, Scrum)The Interview Process: Our interview process involves ...

. Knowledge of regulatory reporting and treasury operations in retail bankingExposure to Python, Go or similar languages. Experience working with orchestration frameworks such as Airflow/LuigiHave previously used dbt, dataform or similar tooling. Used to AGILE ways of working (Kanban, Scrum)The Interview Process: Our interview process involves ...

implementation of modern data architectures and concepts such as cloud services (e.g., AWS, Azure, GCP), real-time data distribution (e.g., Kafka, Kinesis, DataFlow, Airflow), NoSQL (e.g., MongoDB, DynamoDB, HBase, CosmosDB), GraphQL and modern data warehouse tools including Snowflake and DataBricks* Ability to think strategically and relate architectural decisions ...

Backstage experience - software catalog configuration, scaffolder templates, or plugin development* Familiarity with data platform concepts - medallion architecture, lakehouse patterns, or orchestration tools such as Airflow or dbt* Exposure managing Databricks* Practical experience with AI coding assistants (Claude Code, GitHub Copilot, Cursor, or similar) in a professional engineering context* Experience ...

Data Engineer within GCP environments Hands-on experience with BigQuery, Dataflow and Spanner Strong programming capability in Python, Java or Scala Experience with Apache Beam/Dataflow and distributed processing frameworks Experience designing and managing ETL/ELT pipelines Solid understanding of data modelling and database design Experience with … workflow orchestration tools such as Apache Airflow Strong understanding of data governance, security and scalability Desirable Skills for the GCP Data Engineer: Experience with Pub/Sub, Cloud Composer or Cloud Data Fusion Exposure to CI/CD, DevOps and Infrastructure as Code Experience with real-time streaming ...

operating ETL/ELT pipelines and large‐scale data architectures. Hands‐on experience with modern data stacks — our tech includes Python, SQL, Snowflake, Apache Iceberg, AWS S3, PostgresDB, Airflow, dbt, and Apache Spark, deployed via AWS, Docker, and Terraform (experience with similar technologies is essential). Ability ...

skills; experience with Oracle databases . Experience designing and supporting ETL/ELT pipelines and data quality frameworks . Working knowledge of Autosys& Apache Airflow Experience with CI/CD tools (Git, Harness, UrbanCode Deploy (UCD), Red Hat OpenShift) Familiarity with AWS S3 for large-scale data storage. ...

production problems and taking responsibility for critical infrastructure. Startup Mindset: Proactive, resourceful and comfortable taking ownership in a fast-moving engineering environment. Bonus : with Apache Airflow, real-time data platforms, AI/ML infrastructure, LLM agents, GPU infrastructure or financial-market systems. Why Permutable Real Ownership: Take significant ...

modelling practices and building models that stand the test of time Nice to Have: Experience working with Snowflake Familiarity with orchestration tools such as Airflow Experience with TDD, DevOps and CI/CD within data or analytics engineering environments Python experience Experience working with AI coding tools to support ...

Comfortable building from scratch in a fast-moving, product-led environment Experience with vector databases and vector search in modern AI systems Desirable: Spark, Airflow, Kafka, Elasticsearch/OpenSearch, event-driven architectures Cloud experience (AWS, GCP or Azure), GCP is a plus Why join High impact and ownership ...

Comfortable building from scratch in a fast-moving, product-led environment Experience with vector databases and vector search in modern AI systems Desirable: Spark, Airflow, Kafka, Elasticsearch/OpenSearch, event-driven architectures Cloud experience (AWS, GCP or Azure), GCP is a plus Why join High impact and ownership ...

skills with exceptional attention to detail. Excellent communication and collaboration skills. Preferred Qualifications Experience with ETL/ELT tools and data orchestration frameworks (e.g., Airflow, dbt). Familiarity with cloud environments such as AWS, Azure, or Google Cloud Platform. Exposure to CI/CD tools (e.g., Jenkins, GitHub Actions ...

database querying languages Experience in large-scale data processing, microservices, API design, Kafka, Redis, MemCached, Observability tools (Dynatrace, Splunk, Grafana), and Orchestration tools (Airflow, Temporal) Proficiency in automation, continuous delivery methods, and all aspects of the Software Development Life Cycle Advanced understanding of agile methodologies, CI/CD, application ...

debugging, the advanced stuff that separates architects from diagram-drawers. Lakehouse fluency — Medallion architecture, Delta Lake, Unity Catalog, governance, orchestration (Workflows, DLT/Lakeflow, Airflow, ADF); Microsoft Fabric exposure a bonus. Battle-tested in migrations — you've led large transformation programs and have the scars and success stories ...

compliance requirements Excellent stakeholder engagement and communication skills Nice to have Experience in financial markets or market data platforms Knowledge of BPM tools (e.g., Airflow, Step Functions) Familiarity with observability tools (e.g., Grafana) Exposure to AI/ML or GenAI-driven automation capabilities We offer EPAM Employee Stock Purchase ...

triaging, escalating, and driving incidents to resolution under pressure. What you'll do: Design, develop, and maintain high-performance, product-centric data pipelines using Airflow, DBT, and Python. Architect and optimize the massive-scale data warehouse and lakehouse that serves as our single source of truth for all customer ...