10 of 10 Apache Airflow Jobs in the North of England

pipelines and warehouses. Strong SQL skills and proficiency in Python or another relevant programming language. Experience with modern data engineering tools, such as dbt, Airflow or Spark. Experience with cloud data warehouses, such as Snowflake, BigQuery or Amazon Redshift. A solid understanding of data modelling, ETL/ ...

automated deployments, infrastructure management, monitoring, and scaling Coaching and mentoring junior engineers and promoting engineering best practices Skills & Experience: Understanding of data processing using Apache Spark and Apache Airflow for task orchestration Use of Python, SQL, and familiarity with PySpark Understanding of EMR and reviewing output logs ...

Python and SQL programming skills, with experience developing and maintaining data pipelines Familiarity with ETL/ELT technologies and data streaming tools such as Airflow, Azure, SSIS, Spark or Kafka Experience working with databases and data platforms such as PostgreSQL, SQL Server, Oracle, Snowflake or similar technologies Knowledge ...

pipelines Strong programming skills in Python and SQL or similar Experience with technologies such as Spark, Databricks, AWS, Azure, GCP and/or Airflow Strong focus on data quality, testing and reliability Solid software engineering fundamentals and high engineering standards Strong communication and collaborative skills Comfortable working with ambiguity ...

concepts, experience with LLMs, prompt engineering, or integrating AI capabilities into applications • Data Technologies – Experience with Kafka, PySpark, Parquet and Avro data formats, Apache Airflow for workflow management, or Streamlit for building interactive data applications • Advanced Data Management – Strong SQL design, query optimization, and database architecture expertise • Observability ...

degree in Computer Science, Mathematics, Engineering, Physics or a related discipline from a Russell Group university. Desirable Experience Spark and/or Databricks. Airflow or similar orchestration tools. Distributed computing and large-scale data processing. Defence or National Security experience. Essential Requirements UK national and eligible to obtain ...

building data pipelines Proficient in SQL, Python, AWS and other data management technologies Familiarity with version control systems like Git and orchestration tools like Airflow Ability to test and troubleshoot data platforms reliably. A track record of improving data reliability and quality Excellent communication skills and the ability ...

with product squads and business stakeholders Develop robust, production-quality software in Python and build large-scale data workflows using orchestration platforms such as Airflow, while driving technical execution across complex initiatives. Use expertise in cloud computing (AWS and Azure) to build and optimize AI infrastructure Champion ML governance ...

field Production ML engineering excellence – Deep understanding of ML operations, including containerization (Docker, Kubernetes/AWS EKS), cloud platforms (AWS/Azure), workflow orchestration (Airflow), automated testing for ML systems, and API development for model deployment Technical leadership and influence – Track record of mentoring and coaching engineers, driving ...

Companys hybrid work from home policy. Qualifications Commercial GCP background including BigQuery, Dataform and GCS Knowledge of Data Lake technologies such as Airflow, Kafka, Flink and Python Relational set-based processing through complex SQL queries Proven ability to leverage AI within a production workflow Background working within a Data ...