501 to 525 of 534 Apache Airflow Jobs in England

data solutions. Provide hands-on technical guidance on data design, modelling, and integration, ensuring alignment with architectural standards. Drive the adoption of tools such as Alation, Monte Carlo, and Airflow to improve data lineage, quality, and reliability. Ensure data security, privacy, and compliance are integral to all architecture and integration designs. Act as a bridge between business and technology … Glue, Azure Blob Storage, Google BigQuery). Expertise in data modelling (Dimensional, Data Vault, Enterprise). Experience designing and implementing modern data architectures. Proficiency with integration/orchestration tools (Airflow, dbt, Glue). Strong communication and stakeholder management skills. Experience with metadata, cataloguing, and data quality tools, and knowledge of data governance and GDPR. Benefits: Opportunity to work in More ❯

code and testing principles. Develop tools and frameworks for data governance, privacy, and quality monitoring, ensuring full compliance with data protection standards. Create resilient data workflows and automation within Airflow, Databricks, and other modern big data ecosystems. Implement and manage data observability and cataloguing tools (e.g., Monte Carlo, Atlan, DataHub) to enhance visibility and reliability. Partner with ML engineers … deploy, and scale production-grade data platforms and backend systems. Familiarity with data governance frameworks, privacy compliance, and automated data quality checks. Hands-on experience with big data tools (Airflow, Databricks) and data observability platforms. Collaborative mindset and experience working with cross-functional teams including ML and analytics specialists. Curiosity and enthusiasm for continuous learning - you stay up to More ❯

and operational reporting needs. Define best practices for Snowflake usage, data ingestion, transformation, and performance tuning. Develop and optimize ETL/ELT pipelines using tools such as Snowpipe, dbt, Airflow, Informatica, or Talend . Collaborate with data engineers, BI developers, and data scientists to ensure consistent and efficient data access. Implement data governance, security, and compliance standards (RBAC, masking … end Snowflake data architecture, including schema design, data modeling (3NF, star/snowflake, data vault), and ELT frameworks. Define data ingestion, transformation, and consumption patterns leveraging tools like DBT, Airflow, Matillion, Fivetran, or Informatica. Establish architecture blueprints for multi-region, multi-tenant, and secure Snowflake deployments. Lead migration from legacy data warehouses (Teradata, Oracle, SQL Server, Redshift, BigQuery, etc. More ❯

and operational reporting needs. Define best practices for Snowflake usage, data ingestion, transformation, and performance tuning. Develop and optimize ETL/ELT pipelines using tools such as Snowpipe, dbt, Airflow, Informatica, or Talend . Collaborate with data engineers, BI developers, and data scientists to ensure consistent and efficient data access. Implement data governance, security, and compliance standards (RBAC, masking … end Snowflake data architecture, including schema design, data modeling (3NF, star/snowflake, data vault), and ELT frameworks. Define data ingestion, transformation, and consumption patterns leveraging tools like DBT, Airflow, Matillion, Fivetran, or Informatica. Establish architecture blueprints for multi-region, multi-tenant, and secure Snowflake deployments. Lead migration from legacy data warehouses (Teradata, Oracle, SQL Server, Redshift, BigQuery, etc. More ❯

rollback/recovery processes. Using MLOps tools (e.g., Vertex Pipelines, Kubeflow, Weights & Biases) for experiment tracking, model registry, and automated deployment. Leveraging Docker/Kubernetes and workflow orchestration tools (Airflow, Prefect, Dagster). Collaborating with product, design, and engineering teams to deliver ML features that directly impact customer experience. Translating model performance into business metrics (e.g., accuracy vs cost … mature organizations or teams operating at significant scale (e.g., web-scale, distributed systems, cloud-native environments). Brings expertise in MLOps: CI/CD pipelines, Docker, Kubernetes, workflow orchestration (Airflow, Prefect), and automation. Has experience across and understands the full ML lifecycle. Can design for long-term scalability, reliability, and resilience. Has strong programming skills with Python – essential. Has More ❯

rollback/recovery processes. Using MLOps tools (e.g., Vertex Pipelines, Kubeflow, Weights & Biases) for experiment tracking, model registry, and automated deployment. Leveraging Docker/Kubernetes and workflow orchestration tools (Airflow, Prefect, Dagster). Collaborating with product, design, and engineering teams to deliver ML features that directly impact customer experience. Translating model performance into business metrics (e.g., accuracy vs cost … mature organizations or teams operating at significant scale (e.g., web-scale, distributed systems, cloud-native environments). Brings expertise in MLOps: CI/CD pipelines, Docker, Kubernetes, workflow orchestration (Airflow, Prefect), and automation. Has experience across and understands the full ML lifecycle. Can design for long-term scalability, reliability, and resilience. Has strong programming skills with Python – essential. Has More ❯

rollback/recovery processes. Using MLOps tools (e.g., Vertex Pipelines, Kubeflow, Weights & Biases) for experiment tracking, model registry, and automated deployment. Leveraging Docker/Kubernetes and workflow orchestration tools (Airflow, Prefect, Dagster). Collaborating with product, design, and engineering teams to deliver ML features that directly impact customer experience. Translating model performance into business metrics (e.g., accuracy vs cost … mature organizations or teams operating at significant scale (e.g., web-scale, distributed systems, cloud-native environments). Brings expertise in MLOps: CI/CD pipelines, Docker, Kubernetes, workflow orchestration (Airflow, Prefect), and automation. Has experience across and understands the full ML lifecycle. Can design for long-term scalability, reliability, and resilience. Has strong programming skills with Python – essential. Has More ❯

Data & Insight Engineer Salary: £55,000-£60,000 + Share Options + Biannual Bonus Location: Central London (3 days in office) About the Company/Role Fast-growing food-tech scale-up founded by leaders from high-growth consumer brands. More ❯

Data & Insight Engineer Salary: £55,000-£60,000 + Share Options + Biannual Bonus Location: Central London (3 days in office) About the Company/Role Fast-growing food-tech scale-up founded by leaders from high-growth consumer brands. More ❯

Data & Insight Engineer Salary: £55,000-£60,000 + Share Options + Biannual Bonus Location: Central London (3 days in office) About the Company/Role Fast-growing food-tech scale-up founded by leaders from high-growth consumer brands. More ❯

Data & Insight Engineer Salary: £55,000-£60,000 + Share Options + Biannual Bonus Location: Central London (3 days in office) About the Company/Role Fast-growing food-tech scale-up founded by leaders from high-growth consumer brands. More ❯

Data & Insight Engineer Salary: £55,000-£60,000 + Share Options + Biannual Bonus Location: Central London (3 days in office) About the Company/Role Fast-growing food-tech scale-up founded by leaders from high-growth consumer brands. More ❯

deployment . 🔧 What You’ll Do Architect and develop backend systems (Python, FastAPI, Flask, NodeJS) Design and implement RAG pipelines (LangChain, Qdrant, embeddings) Build ETL & CI/CD workflows (Airflow, dbt, MLFlow) Integrate AI/LLM components into backend services Ensure reliability, scalability, and maintainability across systems Collaborate with a small, elite team of engineers and AI researchers 💼 About … You 4+ years of backend experience (Python, distributed systems, async APIs) Proven experience integrating AI or LLM systems (LangChain, vector DBs, etc.) Hands-on with some of Airflow, dbt, MLFlow, ETL, and CI/CD workflows Experience in early-stage startup environments — self-starter mindset Excited by ambiguity, ownership, and building from zero to one Ideally: background in workflow More ❯

deployment . 🔧 What You’ll Do Architect and develop backend systems (Python, FastAPI, Flask, NodeJS) Design and implement RAG pipelines (LangChain, Qdrant, embeddings) Build ETL & CI/CD workflows (Airflow, dbt, MLFlow) Integrate AI/LLM components into backend services Ensure reliability, scalability, and maintainability across systems Collaborate with a small, elite team of engineers and AI researchers 💼 About … You 4+ years of backend experience (Python, distributed systems, async APIs) Proven experience integrating AI or LLM systems (LangChain, vector DBs, etc.) Hands-on with some of Airflow, dbt, MLFlow, ETL, and CI/CD workflows Experience in early-stage startup environments — self-starter mindset Excited by ambiguity, ownership, and building from zero to one Ideally: background in workflow More ❯

deployment . 🔧 What You’ll Do Architect and develop backend systems (Python, FastAPI, Flask, NodeJS) Design and implement RAG pipelines (LangChain, Qdrant, embeddings) Build ETL & CI/CD workflows (Airflow, dbt, MLFlow) Integrate AI/LLM components into backend services Ensure reliability, scalability, and maintainability across systems Collaborate with a small, elite team of engineers and AI researchers 💼 About … You 4+ years of backend experience (Python, distributed systems, async APIs) Proven experience integrating AI or LLM systems (LangChain, vector DBs, etc.) Hands-on with some of Airflow, dbt, MLFlow, ETL, and CI/CD workflows Experience in early-stage startup environments — self-starter mindset Excited by ambiguity, ownership, and building from zero to one Ideally: background in workflow More ❯

deployment . 🔧 What You’ll Do Architect and develop backend systems (Python, FastAPI, Flask, NodeJS) Design and implement RAG pipelines (LangChain, Qdrant, embeddings) Build ETL & CI/CD workflows (Airflow, dbt, MLFlow) Integrate AI/LLM components into backend services Ensure reliability, scalability, and maintainability across systems Collaborate with a small, elite team of engineers and AI researchers 💼 About … You 4+ years of backend experience (Python, distributed systems, async APIs) Proven experience integrating AI or LLM systems (LangChain, vector DBs, etc.) Hands-on with some of Airflow, dbt, MLFlow, ETL, and CI/CD workflows Experience in early-stage startup environments — self-starter mindset Excited by ambiguity, ownership, and building from zero to one Ideally: background in workflow More ❯

deployment . 🔧 What You’ll Do Architect and develop backend systems (Python, FastAPI, Flask, NodeJS) Design and implement RAG pipelines (LangChain, Qdrant, embeddings) Build ETL & CI/CD workflows (Airflow, dbt, MLFlow) Integrate AI/LLM components into backend services Ensure reliability, scalability, and maintainability across systems Collaborate with a small, elite team of engineers and AI researchers 💼 About … You 4+ years of backend experience (Python, distributed systems, async APIs) Proven experience integrating AI or LLM systems (LangChain, vector DBs, etc.) Hands-on with some of Airflow, dbt, MLFlow, ETL, and CI/CD workflows Experience in early-stage startup environments — self-starter mindset Excited by ambiguity, ownership, and building from zero to one Ideally: background in workflow More ❯

to PostgreSQL. 1. Develop & Schedule SQL Views via DAGs Design and implement SQL views aligned with business needs, prioritizing clarity, reusability, and efficiency. Build and manage workflow orchestrations (e.g., Airflow DAGs) to automate those views, ensuring reliable execution on daily, weekly, or customized schedules. 2. Execute Cross‐Platform ETL with AWS Glue Develop, deploy, and maintain AWS Glue jobs … Set up secure connectivity, schedule jobs via cron or trigger mechanisms, and ensure data pipelines are reliable and idempotent. 3. Monitor, Troubleshoot & Resolve Incidents Continuously oversee ETL workflows in Airflow and AWS Glue, proactively responding to alerts and errors. Conduct root cause analysis for pipeline failures—whether due to schema mismatches or performance bottlenecks—and apply robust fixes. Document More ❯

Responsibilities/Skills Develop & Schedule SQL Views via DAGs Design and implement SQL views aligned with business needs, prioritizing clarity, reusability, and efficiency. Build and manage workflow orchestrations (e.g., Airflow DAGs) to automate those views, ensuring reliable execution on daily, weekly, or customized schedules. Execute Cross‐Platform ETL with AWS Glue Develop, deploy, and maintain AWS Glue jobs to … PostgreSQL. Set up secure connectivity, schedule jobs via cron or trigger mechanisms, and ensure data pipelines are reliable and idempotent. Monitor, Troubleshoot & Resolve Incidents Continuously oversee ETL workflows in Airflow and AWS Glue, proactively responding to alerts and errors. Conduct root cause analysis for pipeline failures—whether due to schema mismatches or performance bottlenecks—and apply robust fixes. Document More ❯

Responsibilities/Skills Develop & Schedule SQL Views via DAGs Design and implement SQL views aligned with business needs, prioritizing clarity, reusability, and efficiency. Build and manage workflow orchestrations (e.g., Airflow DAGs) to automate those views, ensuring reliable execution on daily, weekly, or customized schedules. Execute Cross‐Platform ETL with AWS Glue Develop, deploy, and maintain AWS Glue jobs to … PostgreSQL. Set up secure connectivity, schedule jobs via cron or trigger mechanisms, and ensure data pipelines are reliable and idempotent. Monitor, Troubleshoot & Resolve Incidents Continuously oversee ETL workflows in Airflow and AWS Glue, proactively responding to alerts and errors. Conduct root cause analysis for pipeline failures—whether due to schema mismatches or performance bottlenecks—and apply robust fixes. Document More ❯

to PostgreSQL. 1. Develop & Schedule SQL Views via DAGs Design and implement SQL views aligned with business needs, prioritizing clarity, reusability, and efficiency. Build and manage workflow orchestrations (e.g., Airflow DAGs) to automate those views, ensuring reliable execution on daily, weekly, or customized schedules. 2. Execute Cross‐Platform ETL with AWS Glue Develop, deploy, and maintain AWS Glue jobs … Set up secure connectivity, schedule jobs via cron or trigger mechanisms, and ensure data pipelines are reliable and idempotent. 3. Monitor, Troubleshoot & Resolve Incidents Continuously oversee ETL workflows in Airflow and AWS Glue, proactively responding to alerts and errors. Conduct root cause analysis for pipeline failures—whether due to schema mismatches or performance bottlenecks—and apply robust fixes. Document More ❯

to PostgreSQL. 1. Develop & Schedule SQL Views via DAGs Design and implement SQL views aligned with business needs, prioritizing clarity, reusability, and efficiency. Build and manage workflow orchestrations (e.g., Airflow DAGs) to automate those views, ensuring reliable execution on daily, weekly, or customized schedules. 2. Execute Cross Platform ETL with AWS Glue Develop, deploy, and maintain AWS Glue jobs … Set up secure connectivity, schedule jobs via cron or trigger mechanisms, and ensure data pipelines are reliable and idempotent. 3. Monitor, Troubleshoot & Resolve Incidents Continuously oversee ETL workflows in Airflow and AWS Glue, proactively responding to alerts and errors. Conduct root cause analysis for pipeline failures-whether due to schema mismatches or performance bottlenecks-and apply robust fixes. Document More ❯

Responsibilities/Skills Develop & Schedule SQL Views via DAGs Design and implement SQL views aligned with business needs, prioritizing clarity, reusability, and efficiency. Build and manage workflow orchestrations (e.g., Airflow DAGs) to automate those views, ensuring reliable execution on daily, weekly, or customized schedules. Execute Cross‐Platform ETL with AWS Glue Develop, deploy, and maintain AWS Glue jobs to … PostgreSQL. Set up secure connectivity, schedule jobs via cron or trigger mechanisms, and ensure data pipelines are reliable and idempotent. Monitor, Troubleshoot & Resolve Incidents Continuously oversee ETL workflows in Airflow and AWS Glue, proactively responding to alerts and errors. Conduct root cause analysis for pipeline failures—whether due to schema mismatches or performance bottlenecks—and apply robust fixes. Document More ❯

Responsibilities/Skills Develop & Schedule SQL Views via DAGs Design and implement SQL views aligned with business needs, prioritizing clarity, reusability, and efficiency. Build and manage workflow orchestrations (eg, Airflow DAGs) to automate those views, ensuring reliable execution on daily, weekly, or customized schedules. Execute Cross Platform ETL with AWS Glue Develop, deploy, and maintain AWS Glue jobs to … PostgreSQL. Set up secure connectivity, schedule jobs via cron or trigger mechanisms, and ensure data pipelines are reliable and idempotent. Monitor, Troubleshoot & Resolve Incidents Continuously oversee ETL workflows in Airflow and AWS Glue, proactively responding to alerts and errors. Conduct root cause analysis for pipeline failures-whether due to schema mismatches or performance bottlenecks-and apply robust fixes. Document More ❯

their data operations and business intelligence initiatives. Key Responsibilities: Oversee the daily operations of BI data pipelines, reporting platforms, and cloud-based ETL/ELT workflows (AWS, Redshift, Glue, Airflow). Develop and maintain monitoring dashboards to track system health, availability, and operational performance. Manage and resolve Level 2 incidents Conduct root cause analyses and implement corrective actions to … to coordinate system fixes, enhancements, and improvements. Essential Skills & Experience: A minimum of 3 years in AWS-based BI/Data Engineering production support. AWS BI Stack: Redshift, Glue, Airflow, S3, Step Functions. Experience in data modeling, ETL pipelines, and reverse engineering. Proficiency in Power BI (preferred), Business Objects, or Qlik. Strong SQL scripting, optimisation, and troubleshooting capabilities. Previous More ❯