1 to 25 of 65 Apache Airflow Jobs in the City of London

and contribute to technical roadmap planning Technical Skills: Great SQL skills with experience in complex query optimization Strong Python programming skills with experience in data processing libraries (pandas, NumPy, Apache Spark) Hands-on experience building and maintaining data ingestion pipelines Proven track record of optimising queries, code, and system performance Experience with open-source data processing frameworks (Apache Spark, Apache Kafka, Apache Airflow) Knowledge of distributed computing concepts and big data technologies Experience with version control systems (Git) and CI/CD practices Experience with relational databases (PostgreSQL, MySQL or similar) Experience with containerization technologies (Docker, Kubernetes) Experience with data orchestration tools (Apache Airflow or Dagster) Understanding of data warehousing concepts and More ❯

and contribute to technical roadmap planning Technical Skills: Great SQL skills with experience in complex query optimization Strong Python programming skills with experience in data processing libraries (pandas, NumPy, Apache Spark) Hands-on experience building and maintaining data ingestion pipelines Proven track record of optimising queries, code, and system performance Experience with open-source data processing frameworks (Apache Spark, Apache Kafka, Apache Airflow) Knowledge of distributed computing concepts and big data technologies Experience with version control systems (Git) and CI/CD practices Experience with relational databases (PostgreSQL, MySQL or similar) Experience with containerization technologies (Docker, Kubernetes) Experience with data orchestration tools (Apache Airflow or Dagster) Understanding of data warehousing concepts and More ❯

staying current with emerging data technologies. Technical Requirements Proficiency in SQL , including complex query design and optimisation. Strong Python programming skills, particularly with libraries such as pandas , NumPy , and Apache Spark . Experience building and maintaining data ingestion pipelines and optimising performance. Hands-on experience with open-source data frameworks such as Apache Spark , Apache Kafka , or … Apache Airflow . Knowledge of distributed computing and big data concepts. Experience using version control systems (Git) and CI/CD practices. Familiarity with relational databases (PostgreSQL, MySQL, or similar). Experience with containerisation technologies ( Docker , Kubernetes ). Understanding of data orchestration tools (e.g., Airflow or Dagster). Knowledge of data warehousing principles and dimensional modelling . More ❯

staying current with emerging data technologies. Technical Requirements Proficiency in SQL , including complex query design and optimisation. Strong Python programming skills, particularly with libraries such as pandas , NumPy , and Apache Spark . Experience building and maintaining data ingestion pipelines and optimising performance. Hands-on experience with open-source data frameworks such as Apache Spark , Apache Kafka , or … Apache Airflow . Knowledge of distributed computing and big data concepts. Experience using version control systems (Git) and CI/CD practices. Familiarity with relational databases (PostgreSQL, MySQL, or similar). Experience with containerisation technologies ( Docker , Kubernetes ). Understanding of data orchestration tools (e.g., Airflow or Dagster). Knowledge of data warehousing principles and dimensional modelling . More ❯

of ETL/ELT processes and database fundamentals. A motivated, proactive mindset with a strong desire to learn and grow. Nice to Have: Exposure to data pipeline tools (e.g. Apache Airflow, dbt). Experience with containerisation tools like Docker. Familiarity with version control and CI/CD practices. Knowledge of BI tools (Looker, Tableau, or similar). If More ❯

of ETL/ELT processes and database fundamentals. A motivated, proactive mindset with a strong desire to learn and grow. Nice to Have: Exposure to data pipeline tools (e.g. Apache Airflow, dbt). Experience with containerisation tools like Docker. Familiarity with version control and CI/CD practices. Knowledge of BI tools (Looker, Tableau, or similar). If More ❯

frameworks, and clear documentation within your pipelines Experience in the following areas is not essential but would be beneficial: Data Orchestration Tools: Familiarity with modern workflow management tools like Apache Airflow, Prefect, or Dagster Modern Data Transformation: Experience with dbt (Data Build Tool) for managing the transformation layer of the data warehouse BI Tool Familiarity : An understanding of More ❯

skills with the ability to interact effectively with both technical and trading stakeholders. Desirable: Previous front-office or systematic trading desk experience. Familiarity with modern MLOps (Docker, Kubernetes, MLflow, Airflow) and distributed computing (Spark, Ray). Experience with alpha signal generation, regime detection, or portfolio optimization. Exposure to alternative/ESG datasets, macroeconomic indicators, and sentiment analysis. More ❯

skills with the ability to interact effectively with both technical and trading stakeholders. Desirable: Previous front-office or systematic trading desk experience. Familiarity with modern MLOps (Docker, Kubernetes, MLflow, Airflow) and distributed computing (Spark, Ray). Experience with alpha signal generation, regime detection, or portfolio optimization. Exposure to alternative/ESG datasets, macroeconomic indicators, and sentiment analysis. More ❯

Science, Computer Science, or a related field. 5+ years of experience in data engineering and data quality. Strong proficiency in Python/Java, SQL, and data processing frameworks including Apache Spark. Knowledge of machine learning and its data requirements. Attention to detail and a strong commitment to data integrity. Excellent problem-solving skills and ability to work in a More ❯

Science, Computer Science, or a related field. 5+ years of experience in data engineering and data quality. Strong proficiency in Python/Java, SQL, and data processing frameworks including Apache Spark. Knowledge of machine learning and its data requirements. Attention to detail and a strong commitment to data integrity. Excellent problem-solving skills and ability to work in a More ❯

or GCP native stacks) Experience with platform observability and CI/CD for data platforms Hands-on experience with modern data engineering tools such as dbt, Fivetran, Matillion or Airflow History of supporting pre-sales activities in a product or consultancy-based business What Kubrick offers: A fast moving and fast growth business which is doing something seriously innovative More ❯

or GCP native stacks) Experience with platform observability and CI/CD for data platforms Hands-on experience with modern data engineering tools such as dbt, Fivetran, Matillion or Airflow History of supporting pre-sales activities in a product or consultancy-based business What Kubrick offers: A fast moving and fast growth business which is doing something seriously innovative More ❯

This role requires someone who can visit office 5 days a week. The ideal candidate: Extensive experience of software development & data engineering. Strong experience with Python & SQL. Experience with Airflow Experience with cloud platforms (AWS/Azure/GCP). If this sounds like an interesting opportunity to you, feel free to apply for this position or drop me More ❯

This role requires someone who can visit office 5 days a week. The ideal candidate: Extensive experience of software development & data engineering. Strong experience with Python & SQL. Experience with Airflow Experience with cloud platforms (AWS/Azure/GCP). If this sounds like an interesting opportunity to you, feel free to apply for this position or drop me More ❯

following skills: Extensive hands-on experience with Snowflake data platform. Proficiency in SQL and ETL/ELT processes. Strong programming skills in Python. Extended skills across AWS, Azure, dbt, Airflow etc. Could this be of interest? If so, please get in touch with Alex at iO Associates. On this occasion, we cannot accept applications from candidates outside of the More ❯

following skills: Extensive hands-on experience with Snowflake data platform. Proficiency in SQL and ETL/ELT processes. Strong programming skills in Python. Extended skills across AWS, Azure, dbt, Airflow etc. Could this be of interest? If so, please get in touch with Alex at iO Associates. On this occasion, we cannot accept applications from candidates outside of the More ❯

frameworks (Pandas, NumPy, Scikit-learn, TensorFlow, PyTorch). Hands-on experience implementing end-to-end ML pipelines (data ingestion, training, validation, serving). Familiarity with ML workflow orchestration tools (Airflow, Prefect, Kubeflow) and feature/data platforms (Databricks, Tecton, etc.). Strong experience with cloud platforms (AWS, GCP, or Azure), Docker, and Kubernetes. Solid coding practices, including Git, automated More ❯

role, you will: Lead, mentor, and inspire analytics and data engineering teams, fostering technical excellence and a culture of innovation. Architect and optimise ELT pipelines and workflows using dbt, Airflow, SQL, and Python. Oversee the design and evolution of large-scale analytics platforms and data warehouses (Snowflake, BigQuery, Redshift). Ensure best practices in governance, modelling, data quality, and More ❯

role, you will: Lead, mentor, and inspire analytics and data engineering teams, fostering technical excellence and a culture of innovation. Architect and optimise ELT pipelines and workflows using dbt, Airflow, SQL, and Python. Oversee the design and evolution of large-scale analytics platforms and data warehouses (Snowflake, BigQuery, Redshift). Ensure best practices in governance, modelling, data quality, and More ❯

Solid understanding of data modeling concepts (star/snowflake schemas, normalization). Experience with version control systems (e.g., Git) and CI/CD practices. Familiarity with orchestration tools (e.g., Airflow, dbt Cloud, Prefect) is a plus. About Capgemini Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable More ❯

Solid understanding of data modeling concepts (star/snowflake schemas, normalization). Experience with version control systems (e.g., Git) and CI/CD practices. Familiarity with orchestration tools (e.g., Airflow, dbt Cloud, Prefect) is a plus. About Capgemini Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable More ❯

/AI, with strong proficiency in Python, SQL, and distributed data processing (e.g., PySpark). Hands-on experience with cloud data platforms (GCP, AWS, or Azure), orchestration frameworks (e.g., Airflow), and ELT/ETL tools. Familiarity with 2D and 3D data formats (e.g., OBJ, FBX, glTF), point clouds, and large-scale computer vision datasets-or the ability to quickly More ❯

/AI, with strong proficiency in Python, SQL, and distributed data processing (e.g., PySpark). Hands-on experience with cloud data platforms (GCP, AWS, or Azure), orchestration frameworks (e.g., Airflow), and ELT/ETL tools. Familiarity with 2D and 3D data formats (e.g., OBJ, FBX, glTF), point clouds, and large-scale computer vision datasets-or the ability to quickly More ❯

JIRA project tracking, maintain Confluence documentation, and oversee code design for efficient development and collaboration. - Lead technical design and implementation of data models, ETL processes, and visualisation tools (BigQuery, Airflow, SSIS, Tableau, SSRS). - Define and implement best practices in data modeling, including data warehouse and lakehouse integration (Medallion Architecture). Skills and Experience: - Strong understanding of structured data … operational dashboards. - Advanced proficiency with Microsoft BI Stack: SSIS, SSRS - Strong SQL Server skills and SQL querying experience - Hands-on experience with Google Cloud Platform tools including: BigQuery; Composer; Apache Airflow; Stream; Informatica; Vertex AI - Tableau dashboard development and reporting - Python programming for data analysis - Data modelling (warehouse, lakehouse, medallion architecture) - Understanding of financial and insurance data models More ❯