51 to 58 of 58 Apache Airflow Jobs in Central London

models for ML, insights, and search pipelines Design production-ready data pipelines delivering high-quality datasets to partner teams Work with Databricks, AWS, dbt, Airflow, and Looker to implement robust solutions Lead technically complex initiatives and contribute to the team’s roadmap Improve engineering efficiency through internal tooling … Requirements Proven track record delivering production-ready data engineering projects end-to-end Strong SQL and Python skills, with experience on platforms like Databricks, Airflow, dbt, and Looker Experience in data modelling, data warehousing, and performance/cost optimisation Skilled in stakeholder management, documentation, and project planning Experience developing ...

fast-paced, challenging environment. Key Responsibilities: Design, implement, and debug ETL pipelines to process and manage complex datasets. Leverage big data tools, including Apache Kafka, Spark, and Airflow, to deliver scalable solutions. Collaborate with stakeholders to ensure data quality and alignment with business goals. Utilize programming expertise … data engineering projects Good hands-on experience of designing, implementing, debugging ETL pipeline Expertise in Python, PySpark and SQL languages Expertise with Spark and Airflow Experience of designing data pipelines using cloud native services on AWS Extensive knowledge of AWS services like API Gateway, Lambda, Redshift, Glue, Cloudwatch, etc. ...

focused dashboards that power decision-making across the organisation Driving the build-out of automated workflows and data pipelines using cloud tooling (e.g. Databricks, Airflow) and the Microsoft Power Platform Shaping the direction of analytics architecture and ensuring data products align with broader Group standards Empowering store teams with … Confident SQL ability Experience working with cloud analytics platforms such as Databricks, Snowflake, or BigQuery Background delivering automated workflows or pipelines using tools like Airflow or Databricks Previous experience leading teams within agile frameworks, managing priorities, and working closely with stakeholders Strong understanding of data governance, version control ...

focused dashboards that power decision-making across the organisation Driving the build-out of automated workflows and data pipelines using cloud tooling (e.g. Databricks, Airflow) and the Microsoft Power Platform Shaping the direction of analytics architecture and ensuring data products align with broader Group standards Empowering store teams with … Confident SQL ability Experience working with cloud analytics platforms such as Databricks, Snowflake, or BigQuery Background delivering automated workflows or pipelines using tools like Airflow or Databricks Previous experience leading teams within agile frameworks, managing priorities, and working closely with stakeholders Strong understanding of data governance, version control ...

Lead Data Engineer - Python, SQL, DBT, Airflow, BigQuery, AWS/GCP OB are partnered with a UK FinTech Unicorn, undergoing huge growth within their Data function, and are therefore looking for a Lead Data Engineer to join their Data team. This is a key role, where … variety of stakeholders across the business, working on several exciting greenfield projects and scaling their data systems. Lead Data Engineer - Python, SQL, DBT, Airflow, BigQuery, AWS/GCP Key skills and experience: 3+ years of experience in a Leadership role Python/SQL DBT, BigQuery, Airflow AWS/ ...

Data Engineering Lead - Python, SQL, DBT, Airflow, BigQuery, AWS/GCP OB are partnered with a UK FinTech Unicorn, undergoing huge growth within their Data function, and are therefore looking for a Lead Data Engineer to join their Data team. This is a key role, where … variety of stakeholders across the business, working on several exciting greenfield projects and scaling their data systems. Data Engineering Lead - Python, SQL, DBT, Airflow, BigQuery, AWS/GCP Key skills and experience: 3+ years of experience in a Leadership role Python/SQL DBT, BigQuery, Airflow AWS/ ...

setting. MSc in Computer Science, Machine Learning, or a related field. Experience building data pipelines (realtime or batch) & data quality using modern toolchain (e.g., Apache Spark, Kafka, Airflow, dbt). Strong foundational knowledge of machine learning and deep learning algorithms, including deep neural networks, supervised/unsupervised learning ...

Architect and develop backend systems (Python, FastAPI, Flask, NodeJS) Design and implement RAG pipelines (LangChain, Qdrant, embeddings) Build ETL & CI/CD workflows (Airflow, dbt, MLFlow) Integrate AI/LLM components into backend services Ensure reliability, scalability, and maintainability across systems Collaborate with a small, elite team of engineers … backend experience (Python, distributed systems, async APIs) Proven experience integrating AI or LLM systems (LangChain, vector DBs, etc.) Hands-on with some of Airflow, dbt, MLFlow, ETL, and CI/CD workflows Experience in early-stage startup environments — self-starter mindset Excited by ambiguity, ownership, and building from zero ...