51 to 75 of 367 Apache Airflow Jobs in England

Senior Data Engineer: Passionfor building scalable, resilient cloud data platforms Strongexperience with Databricks or Snowflake on AWS ProvenPython skills, including Spark and Airflow expertise AdvancedSQL skills and end-to-end data modelling experience Experiencebuilding batch and real-time data integrations Hands-onCICD skills with Git, Jenkins or similar Abilityto ...

cloud data warehouses (e.g. BigQuery, Snowflake, Redshift, ADW), including performance, cost, and data layout considerations. Proficiency with data integration and orchestration tools (e.g. Fivetran, Airflow, managed ELT platforms), and an understanding of how ingestion, transformation, and orchestration fit together. Experience building and maintaining an analytics or semantic modelling layer ...

data modelling Python, Git, Docker ETL pipelines and data platforms Relational database engines, including PostgreSQL and DuckDB Orchestration (e.g. Step Functions, Airflow) AI-accelerated development workflows and tools including Claude Code and Codex AWS cloud infrastructure, including Lambda and ECS End-to-end data pipeline testing strategy and implementation ...

Kubernetes Spark & distributed computing dbt Terraform Data Warehousing (we use Databricks but experience with other platforms is fine) MLOps implementation (desirable but not required) Airflow (or other orchestration tooling) Governance Things to note Just to let you know, we are dog friendly company ...

technical concepts clearly to both technical and non-technical audiences.Desirables:Experience within engineering consultancy, AEC, or professional services environments.Exposure to orchestration tools such as Airflow, Prefect, or Azure Data Factory.An interest in AI, machine learning, or emerging data technologies.Experience supporting user adoption, training, or analytics enablement initiativesWhy Join Buro ...

Kanban. Strong analytical and problem‐solving skills, with a focus on delivering high-quality solutions. Experience with modern data engineering tools such as Airflow, dbt, Dataform, or similar technologies. Excellent communication and stakeholder management skills, with the ability to explain technical concepts to non‐technical audiences. What we offer ...

Google Cloud Platform ecosystem, like Cloud Run, Cloud Functions, Cloud Storage, Pub/Sub, and Cloud Scheduler Data orchestration tools such as Cloud Composer (Airflow), Prefect, or equivalent Looker/Data Studio and “Conventional analytics” (aka. BQ agenta) Building or maintaining a data warehouse in a regulated or healthcare ...

data engineering, with demonstrated expertise in designing and implementing scalable, flexible modern data architectures Experience building modern data lake/lakehouse architectures (e.g., Apache Iceberg) in cloud environments Strong knowledge of AWS (S3, Redshift) or Azure data services Experience with ETL/ELT processes and data ingestion Proven expertise … using transformation tools such as dbt Experience with data pipeline orchestration tools (such as Apache Airflow) Experience with best practices applied to data (e.g., testing, CI/CD) Advantageous Experience developing dashboards and reporting solutions using data visualization tools such as Power BI or Amazon QuickSight Experience with ...

Snowflake and Databricks, Python and SQL, ETL development and data modelling. Experience with cloud-based data platforms and data governance. Nice to have: Apache Airflow, Spark, AWS/Azure, data visualisation and experience delivering solutions within Defence or secure Government environments. Clearance: Due to the sensitive nature ...

workflows Skills and experience: Passionfor building scalable, resilient cloud data platforms Strongexperience with Databricks or Snowflake on AWS ProvenPython skills, including Spark and Airflow expertise AdvancedSQL skills and end‐to‐end data modelling experience Experiencebuilding batch and real-time data integrations Hands-onCICD skills with Git, Jenkins or similar ...

members Required qualifications, capabilities and skills Proven experience in designing and building data pipelines (ETL/ELT) using modern technologies (e.g., Python, SQL, Spark, Airflow, etc.). Strong analytical skills with the ability to interpret complex data and deliver business value. Experience integrating data from multiple sources and systems. ...

Hadoop, Flink) and cloud platforms (AWS, GCP, or Azure). Familiarity with data warehouse technologies (e.g., Snowflake, Redshift, BigQuery) and workflow orchestration tools (e.g., Airflow, Luigi). Strong knowledge of data security, compliance, and governance frameworks. Effective communication in English. Preferred Qualifications Experience in e‐commerce or consumer‐facing ...

similar cloud data warehouse, including designing downstream data models Have used a cloud platform, ideally Azure, and orchestration tooling like Azure Data Factory, Airflow or Prefect Have a STEM or quantitative background and can engage confidently with researchers on modelling assumptions Can explain a technical problem ...

model on hybrid/on-prem environments. Hard Skills Experience in data engineering, ideally aerospace/defence or industrial sectors. ETL/ELT tools (Airflow, Azure, Microsoft SSIS), streaming (Spark, Kafka). Strong Python and SQL; C++, C#, or MATLAB a plus. Databases: PostgreSQL, SQL Server, Oracle, Snowflake, Iceberg ...

formats like Parquet. MLOps Exposure: Experience with tools and frameworks for training, tracking, deploying, and monitoring models in production (e.g., MLflow, Optuna, Prefect, or Airflow). Background in supply chain forecasting, enterprise AI, or retail analytics M.S. or Ph.D. in Computer Science, Artificial Intelligence, Statistics, Data Science ...

formats like Parquet. MLOps Exposure: Experience with tools and frameworks for training, tracking, deploying, and monitoring models in production (e.g., MLflow, Optuna, Prefect, or Airflow). Background in supply chainforecasting, enterprise AI, or retail analytics M.S. or Ph.D. in Computer Science, Artificial Intelligence, Statistics, Data Science, or a related ...

Data Underpinnings Vector Databases: Experience with high-dimensional data retrieval using Milvus, Weaviate, or Pinecone (essential for RAG architectures). Data Orchestration: Familiarity with Airflow, Prefect, or Dagster for managing complex data movement and model training pipelines. Search & Discovery: Advanced ElasticSearch/OpenSearch for semantic search and large-scale ...

Data Underpinnings Vector Databases: Experience with high-dimensional data retrieval using Milvus, Weaviate, or Pinecone (essential for RAG architectures). Data Orchestration: Familiarity with Airflow, Prefect, or Dagster for managing complex data movement and model training pipelines. Search & Discovery: Advanced ElasticSearch/OpenSearch for semantic search and large-scale ...

platforms (AWS, GCP, Azure) and familiarity with containerization (Docker, Kubernetes). Familiarity with the modern data stack (e.g., Snowflake, Databricks) and workflow orchestrators (e.g., Airflow, Prefect). Knowledge of graph data technologies (Neo4j, TigerGraph) and their corresponding query languages. Exposure to machine learning applications, particularly in NLP or entity ...

coupled with rigorous validation of code, data transformations and analytical conclusions. Desirable Skills and Experience Experience with Azure Data Lake, Azure Data Factory, dbt, Airflow, MLflow, Power BI, Microsoft Purview or comparable tools. Experience with search indexes, vector databases, graph databases, knowledge graphs, ontologies or master-data-management techniques. ...

Strong hands-on experience building and operating data platforms on GCP. Working experience with GCP data services such as BigQuery, Dataflow, Dataproc, Cloud Composer (Airflow), Pub/Sub, Cloud Storage, Bigtable, and Cloud SQL. Proficiency in Python and SQL, with experience in Spark or Apache Beam. Experience designing ...

Ansible for repeatable, automated provisioning of GPU clusters and AI platform environments; GitOps (ArgoCD) for continuous, declarative platform delivery. Pipeline orchestration: Kubeflow Pipelines, Apache Airflow, or Argo Workflows to orchestrate multi-stage training, fine-tuning, and inference pipelines. Cluster & workload scheduling: Slurm, Run:ai, and NVIDIA Base Command ...

Strong Python and SQL skills, with experience building production-grade data pipelines• Data Platform Experience: Hands-on experience with modern data tools (e.g. Snowflake, Airflow, dbt) and cloud environments (preferably AWS)• Engineering Best Practice: Knowledge of CI/CD, testing, version control and infrastructure as code• Data Quality & Governance ...

Jira and Agile development environments Desirable Experience Exposure to any of the following would be beneficial: Databricks or Snowflake AWS or other cloud environments Airflow or AWS Glue SSIS/SSRS Financial markets or financial data FinTech, SaaS, credit or data analytics environments Wider development technologies such as Python ...

Strong Python and SQL skills, with experience building production-grade data pipelines • Data Platform Experience: Hands-on experience with modern data tools (e.g. Snowflake, Airflow, dbt) and cloud environments (preferably AWS) • Engineering Best Practice: Knowledge of CI/CD, testing, version control and infrastructure as code • Data Quality & Governance ...