101 to 125 of 239 Apache Airflow Jobs in the UK

analysis, extraction, transformation, and loading, data intelligence, data security and proven experience in their technologies (e.g. Spark, cloud-based ETL services, Python, Kafka, SQL, Airflow) You have experience in assessing the relevant data quality issues based on data sources & uses cases, and can integrate the relevant data quality checks More ❯

data platform (PaaS) Ensure scalable storage solutions (data lakes, data warehouses) to handle structured and unstructured data. Implement ETL/ELT pipelines using Dagster, Airflow, or similar tools. Optimize performance and scalability for large data volumes. Govern data security, compliance, and access controls. Development & DevOps: Strong programming and scripting More ❯

development lifecycle and agile methodologies. Proven experience designing, developing, and deploying machine learning models. Experience with debugging ML models. Experience with orchestration frameworks (e.g. Airflow, MLFlow, etc). Experience deploying machine learning models to production environments. Knowledge of MLOps practices and tools for model monitoring and maintenance. Familiarity with More ❯

data platform (PaaS) Ensure scalable storage solutions (data lakes, data warehouses) to handle structured and unstructured data. Implement ETL/ELT pipelines using Dagster, Airflow, or similar tools. Optimize performance and scalability for large data volumes. Govern data security, compliance, and access controls. Development & DevOps: Strong programming and scripting More ❯

High attention to detail. Strong project management skills, capable of independently delivering projects. Excellent client-facing communication skills. Nice to Have: Knowledge of dbt, Airflow, and CI/CD pipelines. Experience with dashboard solutions such as Looker, PowerBI, etc. Experience with marketing platforms and understanding of marketing data. Pre More ❯

sky is never the limit. We are looking for talented Principal Data Engineers with deep technical data platform engineering skills including SQL, AWS, Snowflake, Airflow, Git, and Python. As a Principal Data Engineer, you'll serve as a technical lead overseeing Senior Data Engineers, driving industry best practices to More ❯

routine issues and identify improvements in the testing and validation of data accuracy. Extensive experience with Snowflake is essential and working knowledge of DBT, Airflow and AWS is highly desirable. Strong background developing, constructing, testing, and maintaining practical data architectures and drive improvements in data reliability, efficiency, and quality. More ❯

Cloud products (BigQuery, GCS, Cloud Composer, Dataflow etc.) or similar products from other cloud platforms Experience with open-source data-stack tools such as Airflow, Airbyte, DBT, Kafka etc. Experience with data visualisation tools such as PowerBI, Tableau and/or Looker Knowledge of Teradata, Mainframe and/or More ❯

experience analysis Knowledge of dashboard design and data visualization best practices Experience with cloud-based data infrastructure (AWS) Familiarity with modern data stack tools (Airflow, dbt, etc.) Why This Role Matters Judge.me is at an inflection point. As the market leader in Shopify reviews, we've chosen to build More ❯

in data pipelines across cloud/on-premises, using Azure and other technologies. Experienced in orchestrating data workflows and Kubernetes clusters on AKS using Airflow, Kubeflow, Argo, Dagster or similar. Skilled with data ingestion tools like Airbyte, Fivetran, etc. for diverse data sources. Expert in large-scale data processing More ❯

the user experience. Key skills: Senior Data Scientist experience Commercial experience in Generative AI and recommender systems Strong Python and SQL experience Spark/Apache Airflow LLM experience MLOps experience AWS Additional information: This role offers a strong salary of up to 95,000 (Depending on experience/ More ❯

the user experience. Key skills: ** Senior Data Scientist experience ** Commercial experience in Generative AI and recommender systems ** Strong Python and SQL experience ** Spark/Apache Airflow ** LLM experience ** MLOps experience ** AWS Additional information: This role offers a strong salary of up to £95,000 (Depending on experience/ More ❯

the user experience. Key skills: ** Senior Data Scientist experience ** Commercial experience in Generative AI and recommender systems ** Strong Python and SQL experience ** Spark/Apache Airflow ** LLM experience ** MLOps experience ** AWS Additional information: This role offers a strong salary of up to £95,000 (Depending on experience/ More ❯

responsibilities Architecture design and implementation of next generation data pipelines and BI solutions Manage AWS resources including EC2, RDS, Redshift, Kinesis, EMR, Lambda, Glue, Apache Airflow etc. Build and deliver high quality data architecture and pipelines to support business analyst, data scientists, and customer reporting needs. Interface with More ❯

tuning and optimisation Solid understanding of data warehousing principles, data modelling practice, Excellent knowledge of creation and maintenance of data pipelines - ETL Tools (e.g. Apache Airflow) and Streaming processing tools (e.g. Kinesis) Strong problem-solving and analytical skills, with the ability to troubleshoot and resolve complex data-related More ❯

tuning and optimisation Solid understanding of data warehousing principles, data modelling practice, Excellent knowledge of creation and maintenance of data pipelines - ETL Tools (e.g. Apache Airflow) and Streaming processing tools (e.g. Kinesis) Strong problem-solving and analytical skills, with the ability to troubleshoot and resolve complex data-related More ❯

tuning and optimisation ·Solid understanding of data warehousing principles, data modelling practice, ·Excellent knowledge of creation and maintenance of data pipelines - ETL Tools (e.g. Apache Airflow) and Streaming processing tools (e.g. Kinesis) ·Strong problem-solving and analytical skills, with the ability to troubleshoot and resolve complex data-related More ❯

tuning and optimisation Solid understanding of data warehousing principles, data modelling practice, Excellent knowledge of creation and maintenance of data pipelines - ETL Tools (e.g. Apache Airflow) and Streaming processing tools (e.g. Kinesis) Strong problem-solving and analytical skills, with the ability to troubleshoot and resolve complex data-related More ❯

and ML scientists to plan the architecture for end-to-end machine learning workflows. Implement scalable training and deployment pipelines using tools such as Apache Airflow and Kubernetes. Perform comprehensive testing to ensure reliability and accuracy of deployed models. Develop instrumentation and automated alerts to manage system health More ❯

commodities markets (e.g., oil, gas). The PM is keen to get someone from a data engineering background. Tech: Python, SQL, Pandas, AWS, ETL, Airflow Please apply if this fits. More ❯

commodities markets (e.g., oil, gas). The PM is keen to get someone from a data engineering background. Tech: Python, SQL, Pandas, AWS, ETL, Airflow Please apply if this fits. More ❯

Requirements: Significant experience designing and scaling cloud-based data lake architectures (ideally Delta Lake on Databricks or similar) Deep expertise in workflow orchestration using Airflow, with production-grade DAGs and solid dependency management, knowledge of dbt is preferable Strong background in building reliable, scalable batch and streaming pipelines using More ❯

Experience with cloud platforms (AWS, Azure or GCP) and infrastructure-as-code tools Proficiency in spatial databases (e.g., PostGIS) and data pipeline tools (e.g., Airflow) Familiarity with geospatial APIs, formats (GeoJSON, WKT) and data services Security Clearance: Candidates must be eligible to pass Baseline Personnel Security Standard (BPSS) checks. More ❯

SQL expertise designing and maintaining ETL/data pipelines ideally proficiency in multiple cloud infrastructures, databases and data warehousing solutions - AWS and GCP being Airflow 👍 Bonus points for: Experience working in a small, fast-growing start-up, comfortable navigating unstructured/fuzzy environments Experience with RudderStack, Expo and/ More ❯

with cloud-based data warehouses (e.g., Databricks, Snowflake, Redshift). Ability to optimize queries and pipelines for efficiency and reliability. Bonus: Experience with dbt, Airflow, or visualization tools like Tableau. Excellent communication skills and ability to document technical solutions effectively. For this position you need to be eligible to More ❯