126 to 150 of 156 Remote Apache Airflow Jobs

be doing: Managing and maintaining a Python-based data warehouse , ensuring reliable data ingestion and transformation. Developing and monitoring data pipelines using Meltano and orchestration tools like Dagster or Airflow . Designing and optimising SQL transformations (DBT experience a plus). Working within Azure cloud infrastructure following Infrastructure-as-Code (IaC) principles. Managing Power BI semantic models , DAX measures … data stack for ETL/ELT processes and data warehousing. Strong SQL and Python skills, with an understanding of Kimball-style data modelling . Experience with DBT, Dagster, or Airflow for transformation and orchestration. Hands-on experience with Azure (preferred), or other cloud environments (GCP/AWS). Familiarity with Git-based version control , CI/CD, and DevOps More ❯

be doing: Managing and maintaining a Python-based data warehouse , ensuring reliable data ingestion and transformation. Developing and monitoring data pipelines using Meltano and orchestration tools like Dagster or Airflow . Designing and optimising SQL transformations (DBT experience a plus). Working within Azure cloud infrastructure following Infrastructure-as-Code (IaC) principles. Managing Power BI semantic models , DAX measures … data stack for ETL/ELT processes and data warehousing. Strong SQL and Python skills, with an understanding of Kimball-style data modelling . Experience with DBT, Dagster, or Airflow for transformation and orchestration. Hands-on experience with Azure (preferred), or other cloud environments (GCP/AWS). Familiarity with Git-based version control , CI/CD, and DevOps More ❯

management to analyze and improve our business processes Conduct workload and complexity assessments Design, plan and implement new efficient software solutions in Python and Go Maintain and enhance our Airflow data pipelines Improve observability and scalability to support our constantly growing client base Continuously adapt to changing requirements in a business driven environment Build and extend knowledge of financial … innate curiosity to learn new things Preferred qualifications Background in traditional finance or digital assets, ideally in trading domain Hands-on experience with Python libraries and frameworks (NumPy, Pandas, Airflow, FastAPI, Flask, SQLAlchemy) Highly proficient in asynchronous, event driven distributed systems Working knowledge of cloud-native architectures, GCP preferred Experience in Go and working with real-time data streams More ❯

management to analyze and improve our business processes Conduct workload and complexity assessments Design, plan and implement new efficient software solutions in Python and Go Maintain and enhance our Airflow data pipelines Improve observability and scalability to support our constantly growing client base Continuously adapt to changing requirements in a business driven environment Build and extend knowledge of financial … innate curiosity to learn new things Preferred qualifications Background in traditional finance or digital assets, ideally in trading domain Hands-on experience with Python libraries and frameworks (NumPy, Pandas, Airflow, FastAPI, Flask, SQLAlchemy) Highly proficient in asynchronous, event driven distributed systems Working knowledge of cloud-native architectures, GCP preferred Experience in Go and working with real-time data streams More ❯

Location: London – Hybrid (2-3 days/week onsite, plus client visits). Salary: From £90,000 + bonus, negotiable. Term: Permanent/Full-time (flexible working arrangements). About the Company Our client is a next-generation Data & AI More ❯

Location: London – Hybrid (2-3 days/week onsite, plus client visits). Salary: From £90,000 + bonus, negotiable. Term: Permanent/Full-time (flexible working arrangements). About the Company Our client is a next-generation Data & AI More ❯

Senior Data Engineer - FinTech Unicorn - Python, SQL, DBT, Airflow, AWS/GCP OB have partnered with a UK FinTech Unicorn, who's Data function is undergoing rapid growth, and in-turn are looking to grow their Data team, with 2 highly skilled Data Engineers. You'll be working on shaping the companies Data function, driving Data best practices, and … collaborate with a variety of stakeholders to ensure the company are making Data driven decisions. Senior Data Engineer - FinTech Unicorn - Python, SQL, DBT, Airflow, AWS/GCP Tech Stack: Python & SQL DBT, AirFlow & BigQuery AWS/GCP ETL Pipelines Base salary of £90k-£115k depending on skills and experience Excellent overall package including a sizeable bonus and stock … options Hybrid working in Central London You must be UK based, and sadly sponsorship is unavailable Senior Data Engineer - FinTech Unicorn - Python, SQL, DBT, Airflow, AWS/GCP More ❯

Senior Data Engineer - FinTech Unicorn - Python, SQL, DBT, Airflow, AWS/GCP OB have partnered with a UK FinTech Unicorn, who's Data function is undergoing rapid growth, and in-turn are looking to grow their Data team, with 2 highly skilled Data Engineers. You'll be working on shaping the companies Data function, driving Data best practices, and … collaborate with a variety of stakeholders to ensure the company are making Data driven decisions. Senior Data Engineer - FinTech Unicorn - Python, SQL, DBT, Airflow, AWS/GCP Tech Stack: Python & SQL DBT, AirFlow & BigQuery AWS/GCP ETL Pipelines Base salary of £90k-£115k depending on skills and experience Excellent overall package including a sizeable bonus and stock … working in Central London with 1-2 days a week required You must be UK based, and sadly sponsorship is unavailable Senior Data Engineer - FinTech Unicorn - Python, SQL, DBT, Airflow, AWS/GCP More ❯

Senior Data Engineer - FinTech Unicorn - Python, SQL, DBT, Airflow, AWS/GCP OB have partnered with a UK FinTech Unicorn, who's Data function is undergoing rapid growth, and in-turn are looking to grow their Data team, with 2 highly skilled Data Engineers. You'll be working on shaping the companies Data function, driving Data best practices, and … collaborate with a variety of stakeholders to ensure the company are making Data driven decisions. Senior Data Engineer - FinTech Unicorn - Python, SQL, DBT, Airflow, AWS/GCP Tech Stack: Python & SQL DBT, AirFlow & BigQuery AWS/GCP ETL Pipelines Base salary of £90k-£115k depending on skills and experience Excellent overall package including a sizeable bonus and stock … working in Central London with 1-2 days a week required You must be UK based, and sadly sponsorship is unavailable Senior Data Engineer - FinTech Unicorn - Python, SQL, DBT, Airflow, AWS/GCP More ❯

Senior Data Engineer - FinTech Unicorn - Python, SQL, DBT, Airflow, AWS/GCP OB have partnered with a UK FinTech Unicorn, who's Data function is undergoing rapid growth, and in-turn are looking to grow their Data team, with 2 highly skilled Data Engineers. You'll be working on shaping the companies Data function, driving Data best practices, and … collaborate with a variety of stakeholders to ensure the company are making Data driven decisions. Senior Data Engineer - FinTech Unicorn - Python, SQL, DBT, Airflow, AWS/GCP Tech Stack: Python & SQL DBT, AirFlow & BigQuery AWS/GCP ETL Pipelines Base salary of £90k-£115k depending on skills and experience Excellent overall package including a sizeable bonus and stock … working in Central London with 1-2 days a week required You must be UK based, and sadly sponsorship is unavailable Senior Data Engineer - FinTech Unicorn - Python, SQL, DBT, Airflow, AWS/GCP More ❯

Lead Data Engineer - Python, SQL, DBT, Airflow, BigQuery, AWS/GCP OB are partnered with a UK FinTech Unicorn, undergoing huge growth within their Data function, and are therefore looking for a Lead Data Engineer to join their Data team. This is a key role, where you'll be leading a team of up to 6 engineers, helping set … the technical direction, collaborating with a variety of stakeholders across the business, working on several exciting greenfield projects and scaling their data systems. Lead Data Engineer - Python, SQL, DBT, Airflow, BigQuery, AWS/GCP Key skills and experience: 2+ years of experience in a Leadership role Python/SQL DBT, BigQuery, Airflow AWS/GCP, Terraform Data warehousing … ETL Hybrid working with offices based in Central London Base salary of £120k-£140k + Bonus up to 15% and stock options Lead Data Engineer - Python, SQL, DBT, Airflow, BigQuery, AWS/GCP More ❯

Lead Data Engineer - Python, SQL, DBT, Airflow, BigQuery, AWS/GCP OB are partnered with a UK FinTech Unicorn, undergoing huge growth within their Data function, and are therefore looking for a Lead Data Engineer to join their Data team. This is a key role, where you'll be leading a team of up to 6 engineers, helping set … the technical direction, collaborating with a variety of stakeholders across the business, working on several exciting greenfield projects and scaling their data systems. Lead Data Engineer - Python, SQL, DBT, Airflow, BigQuery, AWS/GCP Key skills and experience: 2+ years of experience in a Leadership role Python/SQL DBT, BigQuery, Airflow AWS/GCP, Terraform Data warehousing … ETL Hybrid working with offices based in Central London Base salary of £120k-£140k + Bonus up to 15% and stock options Lead Data Engineer - Python, SQL, DBT, Airflow, BigQuery, AWS/GCP More ❯

Senior Data Engineer - Python, SQL, Airflow, Redshift, Snowflake I've partnered with a high-growth start-up looking to expand their Data function, by bringing on a Senior Data Engineer on a contract basis - more info below: Senior Data Engineer: Tech stack - Python, SQL, ETL Pipelines, Airflow, BigQuery, Redshift, Snowflake, AWS/GCP Experience with event-stream and … Modelling Hybrid working in Central London - Monday in the office is essential Pays £450-£500 p/d Outside IR35 3-month initial engagement Senior Data Engineer - Python, SQL, Airflow, Redshift, Snowflake More ❯

Senior Data Engineer - Python, SQL, Airflow, Redshift, Snowflake I've partnered with a high-growth start-up looking to expand their Data function, by bringing on a Senior Data Engineer on a contract basis - more info below: Senior Data Engineer: Tech stack - Python, SQL, ETL Pipelines, Airflow, BigQuery, Redshift, Snowflake, AWS/GCP Experience with event-stream and … Modelling Hybrid working in Central London - Monday in the office is essential Pays £450-£500 p/d Outside IR35 3-month initial engagement Senior Data Engineer - Python, SQL, Airflow, Redshift, Snowflake More ❯

platform, ensuring scalability, reliability, and security. Drive modernisation by transitioning from legacy systems to a lean, scalable platform. Act as a lead expert for technologies such as AWS, DBT, Airflow, and Databricks. Establish best practices for data modelling, ingestion, storage, streaming, and APIs. Governance & Standards Ensure all technical decisions are well-justified, documented, and aligned with business needs. Lead … in data engineering and cloud engineering, including data ingestion, transformation, and storage. Significant hands-on experience with AWS and its data services. Expert-level skills in SQL, Python, DBT, Airflow and Redshift. Confidence in coding, scripting, configuring, versioning, debugging, testing, and deploying. Ability to guide and mentor others in technical best practices. A product mindset, focusing on user needs More ❯

platform, ensuring scalability, reliability, and security. Drive modernisation by transitioning from legacy systems to a lean, scalable platform. Act as a lead expert for technologies such as AWS, DBT, Airflow, and Databricks. Establish best practices for data modelling, ingestion, storage, streaming, and APIs. Governance & Standards Ensure all technical decisions are well-justified, documented, and aligned with business needs. Lead … in data engineering and cloud engineering, including data ingestion, transformation, and storage. Significant hands-on experience with AWS and its data services. Expert-level skills in SQL, Python, DBT, Airflow and Redshift. Confidence in coding, scripting, configuring, versioning, debugging, testing, and deploying. Ability to guide and mentor others in technical best practices. A product mindset, focusing on user needs More ❯

and governance through robust access controls, including RBAC, SSO, token policies, and pseudonymisation frameworks. Develop resilient data flows for both batch and streaming workloads using technologies such as Kafka, Airflow, DBT, and Terraform. Shape data strategy and standards by contributing to architectural decisions, authoring ADRs, and participating in reviews, data councils, and platform enablement initiatives. What we’d love … requirements Direct exposure to cloud-native data infrastructures (Databricks, Snowflake) especially in AWS environments is a plus Experience in building and maintaining batch and streaming data pipelines using Kafka, Airflow, or Spark Familiarity with governance frameworks, access controls (RBAC), and implementation of pseudonymisation and retention policies Exposure to enabling GenAI and ML workloads by preparing model-ready and vector More ❯

Lead Data Engineer - Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey OB have partnered with a leading scale-up business in the AdTech space, where Data is at the forefront of everything they do, and they are currently hiring for a Lead Data Engineer to join their team and work on the development of their Data platform. This will … on experience working in Data heavy environments, with Real-Time Data Pipelines, Distributed Streaming Pipelines and strong knowledge of Cloud Environments. Lead Data Engineer - Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey Key Skills and Experience: Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey Prior experience working as a Lead Engineer or Tech Lead Pays £100k-£130k + … in Central London To be considered, you must be UK based and unfortunately visa sponsorship is unavailable 2-stage interview process! Lead Data Engineer - Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey More ❯

Lead Data Engineer - Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey OB have partnered with a leading scale-up business in the AdTech space, where Data is at the forefront of everything they do, and they are currently hiring for a Lead Data Engineer to join their team and work on the development of their Data platform. This will … on experience working in Data heavy environments, with Real-Time Data Pipelines, Distributed Streaming Pipelines and strong knowledge of Cloud Environments. Lead Data Engineer - Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey Key Skills and Experience: Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey Prior experience working as a Lead Engineer or Tech Lead Pays £100k-£130k + … in Central London To be considered, you must be UK based and unfortunately visa sponsorship is unavailable 2-stage interview process! Lead Data Engineer - Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey More ❯

Lead Data Engineer - Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey OB have partnered with a leading scale-up business in the AdTech space, where Data is at the forefront of everything they do, and they are currently hiring for a Lead Data Engineer to join their team and work on the development of their Data platform. This will … on experience working in Data heavy environments, with Real-Time Data Pipelines, Distributed Streaming Pipelines and strong knowledge of Cloud Environments. Lead Data Engineer - Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey Key Skills and Experience: Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey Prior experience working as a Lead Engineer or Tech Lead Pays £100k-£130k + … in Central London To be considered, you must be UK based and unfortunately visa sponsorship is unavailable 2-stage interview process! Lead Data Engineer - Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey More ❯

rollback/recovery processes. Using MLOps tools (e.g., Vertex Pipelines, Kubeflow, Weights & Biases) for experiment tracking, model registry, and automated deployment. Leveraging Docker/Kubernetes and workflow orchestration tools (Airflow, Prefect, Dagster). Collaborating with product, design, and engineering teams to deliver ML features that directly impact customer experience. Translating model performance into business metrics (e.g., accuracy vs cost … mature organizations or teams operating at significant scale (e.g., web-scale, distributed systems, cloud-native environments). Brings expertise in MLOps: CI/CD pipelines, Docker, Kubernetes, workflow orchestration (Airflow, Prefect), and automation. Has experience across and understands the full ML lifecycle. Can design for long-term scalability, reliability, and resilience. Has strong programming skills with Python – essential. Has More ❯

deployment . 🔧 What You’ll Do Architect and develop backend systems (Python, FastAPI, Flask, NodeJS) Design and implement RAG pipelines (LangChain, Qdrant, embeddings) Build ETL & CI/CD workflows (Airflow, dbt, MLFlow) Integrate AI/LLM components into backend services Ensure reliability, scalability, and maintainability across systems Collaborate with a small, elite team of engineers and AI researchers 💼 About … You 4+ years of backend experience (Python, distributed systems, async APIs) Proven experience integrating AI or LLM systems (LangChain, vector DBs, etc.) Hands-on with some of Airflow, dbt, MLFlow, ETL, and CI/CD workflows Experience in early-stage startup environments — self-starter mindset Excited by ambiguity, ownership, and building from zero to one Ideally: background in workflow More ❯

deployment . 🔧 What You’ll Do Architect and develop backend systems (Python, FastAPI, Flask, NodeJS) Design and implement RAG pipelines (LangChain, Qdrant, embeddings) Build ETL & CI/CD workflows (Airflow, dbt, MLFlow) Integrate AI/LLM components into backend services Ensure reliability, scalability, and maintainability across systems Collaborate with a small, elite team of engineers and AI researchers 💼 About … You 4+ years of backend experience (Python, distributed systems, async APIs) Proven experience integrating AI or LLM systems (LangChain, vector DBs, etc.) Hands-on with some of Airflow, dbt, MLFlow, ETL, and CI/CD workflows Experience in early-stage startup environments — self-starter mindset Excited by ambiguity, ownership, and building from zero to one Ideally: background in workflow More ❯

to PostgreSQL. 1. Develop & Schedule SQL Views via DAGs Design and implement SQL views aligned with business needs, prioritizing clarity, reusability, and efficiency. Build and manage workflow orchestrations (e.g., Airflow DAGs) to automate those views, ensuring reliable execution on daily, weekly, or customized schedules. 2. Execute Cross‐Platform ETL with AWS Glue Develop, deploy, and maintain AWS Glue jobs … Set up secure connectivity, schedule jobs via cron or trigger mechanisms, and ensure data pipelines are reliable and idempotent. 3. Monitor, Troubleshoot & Resolve Incidents Continuously oversee ETL workflows in Airflow and AWS Glue, proactively responding to alerts and errors. Conduct root cause analysis for pipeline failures—whether due to schema mismatches or performance bottlenecks—and apply robust fixes. Document More ❯

.000 € per year Requirements: Minimum 1 to 2 years of proven experience in ML-Ops, including end-to-end machine learning lifecycle management Familiarity with MLOps tools like MLFlow, Airflow, Kubeflow or custom implemented solutions. Experience designing and managing CI/CD pipelines for machine learning projects with experience in CI/CD tools (e.g., Github actions, Bitbucket Pipelines … workflows Automate repetitive and manual processes involved in machine learning operations to improve efficiency Implement and manage in-cloud ML-Ops solutions, leveraging Terraform for infrastructure as code Technologies: Airflow AWS BitBucket CI/CD Cloud Embedded GitHub Support Kubeflow Machine Learning Mobile Python Terraform C++ DevOps More: Cinemo is a global provider of highly innovative infotainment products that More ❯