76 to 100 of 367 Apache Airflow Jobs in England

members Required qualifications, capabilities and skills Proven experience in designing and building data pipelines (ETL/ELT) using modern technologies (e.g., Python, SQL, Spark, Airflow, etc.). Strong analytical skills with the ability to interpret complex data and deliver business value. Experience integrating data from multiple sources and systems. ...

Following Distributed computing technologies such as Spark and Databricks Cloud platforms including AWS, Azure, or GCP Workflow orchestration tools such as Airflow CI/CD, version control, and infrastructure as code Experience within financial services, consulting, or risk environments What’s on Offer Opportunity to make an impact from ...

Strong Python and SQL skills, with experience building production-grade data pipelines Data Platform Experience: Hands-on experience with modern data tools (e.g. Snowflake, Airflow, dbt) and cloud environments (preferably AWS) Engineering Best Practice: Knowledge of CI/CD, testing, version control and infrastructure as code Data Quality & Governance ...

marketing teams to align data solutions with business needs Requirements Strong SQL skills and experience with ETL/ELT and pipeline orchestration tools (e.g., Airflow, dbt, Data Factory) Experience with cloud data platforms (e.g., Azure, AWS, or GCP) Proficiency in data modelling (dimensional, entity-relationship, event-driven) Understanding ...

with data pipelines, ELT workflows, and contemporary cloud data architectures.Experience with current cloud data platforms such as Snowflake, Azure Data Lake, Azure SQL, dbt, Airflow, or similar tools.Ability to understand and work with SQL queries and data models.Knowledge of data governance, privacy, security, regulatory reporting, and responsible data ...

marketing teams to align data solutions with business needs. Requirements Strong SQL skills and experience with ETL/ELT and pipeline orchestration tools (e.g., Airflow, dbt, Data Factory). Experience with cloud data platforms (e.g., Azure, AWS, or GCP). Proficiency in data modelling (dimensional, entity-relationship, event-driven ...

maintaining scalable data platforms. Strong SQL and data modelling skills, with experience designing analytical datasets. Experience with modern data stack tools (e.g. dbt, Spark, Airflow, or similar orchestration and transformation frameworks). Experience with cloud‐based data platforms, ideally AWS. Understanding of medallion architecture or similar data layering approaches. ...

analyse large datasets and communicate insights effectively. Experience with LLMs, generative AI, and prompt engineering. Knowledge of MLOps tools and frameworks (MLflow, Kubeflow, Airflow). Familiarity with SQL, NoSQL, and distributed data technologies. Experience deploying AI models in production environments. Publications, patents, or open-source contributions in ML/ ...

experience you need Strong experience in Data Engineering and cloud-based data platforms. Hands-on knowledge of Databricks, Spark, SQL and Python. Understanding of Airflow, Terraform and modern engineering practices. Experience building large-scale batch and real-time data pipelines. Strong problem-solving and decision-making skills. Ability ...

with modern data warehouse technologies, particularly Snowflake.* Exposure to technologies such as Azure Data Factory, Synapse Analytics, Databricks, Spark, SQL, and Python. Experience with Airflow would be advantageous.Data Engineering* Proven experience applying data engineering techniques to design and develop scalable solutions.* Ability to build and maintain robust data pipelines ...

relational databases (e.g., PostgreSQL, DuckDB). Experience with the modern data stack, building data ingestion pipelines and working with ETL and orchestration tools (e.g., Airflow, Luigi, Argo, dbt), big data technologies (Spark, Kafka, Parquet), and web frameworks for model serving (e.g. Flask or FastAPI). Data Science: Familiarity ...

experience you need Strong experience in Data Engineering and cloud-based data platforms. Hands-on knowledge of Databricks, Spark, SQL and Python. Understanding of Airflow, Terraform and modern engineering practices. Experience building large-scale batch and real-time data pipelines. Strong problem-solving and decision-making skills. Ability ...

coupled with rigorous validation of code, data transformations and analytical conclusions. Desirable Skills and Experience Experience with Azure Data Lake, Azure Data Factory, dbt, Airflow, MLflow, Power BI, Microsoft Purview or comparable tools. Experience with search indexes, vector databases, graph databases, knowledge graphs, ontologies or master-data-management techniques. ...

safe to challenge ideas, learn, and grow. Nice to have Hands-on familiarity with the modern data stack — for example, Spark, Flink, Kafka, Debezium, Airflow, dbt, or similar — and with cloud platforms (AWS/GCP or equivalent) and modern DevOps practices. Experience leading teams that built data platforms used ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern ...

pipelines and data quality frameworks (rules, thresholds, exception handling). Working knowledge of scheduling/orchestration tools such as Autosys and/or Apache Airflow (monitoring schedules, reruns, failure triage). Experience with CI/CD and release controls (Git, Harness, UrbanCode Deploy (UCD), Red Hat OpenShift ...

Oracle databases. Experience designing and supporting ETL/ELT pipelines and data quality frameworks (rules, thresholds, exception handling). Working knowledge of Autosys and Apache Airflow (monitoring schedules, reruns, failure triage). Experience with CI/CD and release controls (Git, Harness, UrbanCode Deploy (UCD), Red Hat OpenShift ...

models. Ideal candidates are hands-on Data Engineers with strong SQL and Python, ETL/ELT, orchestration, streaming, and warehousing experience across Spark, Kafka, Airflow, dbt, Snowflake, BigQuery or Databricks on AWS, GCP or Azure. #J-18808-Ljbffr ...

Jira and Agile development environments Desirable Experience Exposure to any of the following would be beneficial: Databricks or Snowflake AWS or other cloud environments Airflow or AWS Glue SSIS/SSRS Financial markets or financial data FinTech, SaaS, credit or data analytics environments Wider development technologies such as Python ...

data modeling, and data integrationSkilled in data manipulation, processing, and orchestration frameworksHands-on experience with Data Factory, Databricks, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis, Redshift, SonarQube, and PyTestProficiency with GitHub, GitHub Actions, and Azure DevOpsStrong communication and collaboration skills to align technical and business stakeholdersProven ability ...

maintaining data pipelines at scale Experience with a modern data stack (e.g. Snowflake, dbt, Fivetran, Debezium or similar) Experience with orchestration tools such as Airflow, Dagster or Prefect Proficiency in Python for building production data workflows Familiarity with data warehousing concepts and modelling patterns Experience working with cloud platforms ...

ADLS, and Azure Functions. Proven track record of designing and implementing metadata‐driven data pipelines. Deep expertise in orchestration and data workflow automation e.g. Airflow, DBT. Strong understanding of CI/CD practices for data engineering. Experience with infrastructure as code (Terraform, Bicep, or ARM templates) (preferred). Solid ...

including ADF, ADLS, and Azure Functions.Proven track record of designing and implementing metadata-driven data pipelines.Deep expertise in orchestration and data workflow automation e.g. Airflow, DBT.Strong understanding of CI/CD practices for data engineering.Experience with infrastructure as code (Terraform, Bicep, or ARM templates) (preferred).Solid development and coding ...