51 to 75 of 353 Apache Airflow Jobs in England

. Strong technical knowledge of SQL and Python . Experience with modern data technologies and tooling such as Microsoft Fabric, Power BI, Snowflake, dbt, Airflow, Databricks or Looker . Experience designing data pipelines, ETL/ELT processes and modern data models. Practical understanding of modern data architecture approaches, including ...

production-quality ETL/ELT pipelines and automated data workflows. Experience integrating heterogeneous data sources, databases and APIs. Experience with workflow orchestration tooling (e.g. Airflow, Dagster or dbt) for scheduling and operating production data pipelines. Good understanding of data quality, metadata, lineage, testing and reproducibility. Ability to evaluate technical ...

need to have: AWS Data tooling such as S3/Glue,Redshift. Familiarity with containerization (e.g. Docker/ec2), Orchestraion in enterprise environment (Airflow), Infrastructure automation (Terraform), and CI/CD platform (Github Actions and Admin), Password/Secret Management (hashicorp vault). Strong Data related programming skills ...

test, and deploy ETL pipelines to source, cleanse, and optimise data at scale. Automate and orchestrate data workflows: Develop and maintain orchestration solutions (e.g. Apache Airflow), implementing testing, alerting, monitoring, and data quality checks as first‐class concerns. Ensure data quality and observability: Embed data testing and validation … event streaming platforms including Kafka and its core concepts on topics, messages, and consumers. Experience building and operating automated data workflows using tools like Apache Airflow. Experience implementing data quality and validation checks throughout pipelines to ensure accuracy, completeness, consistency, and reliability. Practical experience implementing monitoring, observability and alerting ...

Experience building scalable data pipelines and distributed data platforms Knowledge of Kafka, Spark and modern data processing technologies Experience with orchestration tools such as Airflow, Dagster or Prefect Hands-on experience with Docker, Kubernetes and containerised deployments CI/CD experience with a focus on production ownership and reliability ...

Hadoop, Flink) and cloud platforms (AWS, GCP, or Azure). Familiarity with data warehouse technologies (e.g., Snowflake, Redshift, BigQuery) and workflow orchestration tools (e.g., Airflow, Luigi). Strong knowledge of data security, compliance, and governance frameworks. Effective communication in English. Preferred Qualifications Experience in e‐commerce or consumer‐facing ...

practices. Strong hands-on Snowflake experience, including SQL optimisation and data pipeline development. Experience building and orchestrating data pipelines using tools such as dbt, Airflow or similar. Strong SQL skills and proficiency in Python or another data engineering language. Experience implementing automated data quality checks, monitoring and validation frameworks. ...

skills in SQL experience with Snowflake and DBT. Proficiency in SQL and NoSQL databases. Experience with containerization tools like Docker and orchestration tools like Airflow or Astronomer. Familiarity with cloud platforms (AWS, Azure). Experience with CI/CD pipelines and automation tools like GitHub Actions. Experience with data ...

skills in SQL; experience with Snowflake and DBT. Proficiency in SQL and NoSQL databases. Experience with containerization tools like Docker and orchestration tools like Airflow or Astronomer. Familiarity with cloud platforms (AWS, Azure). Experience with CI/CD pipelines and automation tools like GitHub Actions. Experience with data ...

Kanban. Strong analytical and problem‐solving skills, with a focus on delivering high-quality solutions. Experience with modern data engineering tools such as Airflow, dbt, Dataform, or similar technologies. Excellent communication and stakeholder management skills, with the ability to explain technical concepts to non‐technical audiences. What we offer ...

Experience with cloud data platforms and warehouses, for example Snowflake, Databricks, BigQuery or Redshift. Exposure to modern data engineering tooling and practices, including dbt, Airflow, Git-based version control and CI/CD for data. Experience with IT cost management strategies, models and tooling, including chargeback and cost recovery ...

data engineering, with demonstrated expertise in designing and implementing scalable, flexible modern data architectures Experience building modern data lake/lakehouse architectures (e.g., Apache Iceberg) in cloud environments Strong knowledge of AWS (S3, Redshift) or Azure data services Experience with ETL/ELT processes and data ingestion Proven expertise … using transformation tools such as dbt Experience with data pipeline orchestration tools (such as Apache Airflow) Experience with best practices applied to data (e.g., testing, CI/CD) Advantageous Experience developing dashboards and reporting solutions using data visualization tools such as Power BI or Amazon QuickSight Experience with ...

Following Distributed computing technologies such as Spark and Databricks Cloud platforms including AWS, Azure, or GCP Workflow orchestration tools such as Airflow CI/CD, version control, and infrastructure as code Experience within financial services, consulting, or risk environments What’s on Offer Opportunity to make an impact from ...

Areas Such As KYC AML Transaction Monitoring Screening Risk Ratings Compliance Case Management Strong data governance, lineage and data quality experience Experience with dbt, Airflow, Azure Data Factory, Dagster or similar tooling CI/CD, Git and modern engineering practices Strong stakeholder engagement and communication skills #J-18808-Ljbffr ...

areas such as: KYC AML Transaction Monitoring Screening Risk Ratings Compliance Case Management Strong data governance, lineage and data quality experience Experience with dbt, Airflow, Azure Data Factory, Dagster or similar tooling CI/CD, Git and modern engineering practices Strong stakeholder engagement and communication skills Why Apply? Opportunity ...

Redshift), and data transformation tools (such as dbt). Pipeline mastery: Practical experience building and operating batch or streaming pipelines using orchestration tools like Airflow, Prefect, or Dagster. Strong communicator: Skilled at writing clear technical specifications and explaining complex trade-offs to both technical and non-technical colleagues. Growth ...

automated testing and data quality practice. A collaborative mindset and a genuine interest in building things well. Desirable Experience with orchestration tools such as Airflow, Dagster, Prefect or Azure Data Factory. Experience working within AWS, Azure, GCP or another enterprise cloud ecosystem. Experience with complex customer, transactional, digital ...

data modelling Python, Git, Docker ETL pipelines and data platforms Relational database engines, including PostgreSQL and DuckDB Orchestration (e.g. Step Functions, Airflow) AI-accelerated development workflows and tools including Claude Code and Codex AWS cloud infrastructure, including Lambda and ECS End-to-end data pipeline testing strategy and implementation ...

Kubernetes Spark & distributed computing dbt Terraform Data Warehousing (we use Databricks but experience with other platforms is fine) MLOps implementation (desirable but not required) Airflow (or other orchestration tooling) Governance Why else you'll love it here Wondering what the salary for this role is? Just ...

formats like Parquet. MLOps Exposure: Experience with tools and frameworks for training, tracking, deploying, and monitoring models in production (e.g., MLflow, Optuna, Prefect, or Airflow). Background in supply chain forecasting, enterprise AI, or retail analytics M.S. or Ph.D. in Computer Science, Artificial Intelligence, Statistics, Data Science ...

Kubernetes Spark & distributed computing dbt Terraform Data Warehousing (we use Databricks but experience with other platforms is fine) MLOps implementation (desirable but not required) Airflow (or other orchestration tooling) Governance Things to note Just to let you know, we are dog friendly company ...

certifications are a plus!). Containerization: Familiarity with Docker or the concept of containerized applications. Data Tools: Exposure to any data processing tools like Airflow, Kafka, or Spark. Infrastructure as Code: A desire to learn tools like Terraform/Terragrunt. Financial Tech Interest: An interest in Open Banking ...

frameworks for large-scale batch and near real-time processing, with hands-on experience using orchestration and transformation technologies such as Airflow and dbt. Strong knowledge of software engineering best practices, including coding standards, code reviews, testing strategies, version control systems such as Git, and CI/CD processes. ...

relational databases (e.g., PostgreSQL, DuckDB). Experience with the modern data stack, building data ingestion pipelines and working with ETL and orchestration tools (e.g., Airflow, Luigi, Argo, dbt), big data technologies (Spark, Kafka, Parquet), and web frameworks for model serving (e.g. Flask or FastAPI). Data Science: Familiarity ...

data platforms (AWS, GCP, or Azure) Technical credibility with data engineering practices: strong grasp of SQL, data modeling, pipeline design, and tools like dbt, Airflow, Fivetran, and similar Hands-on experience with cloud data warehouses (BigQuery, Redshift, or Snowflake); understanding of performance optimization, partitioning, and data quality patterns Ability ...