8 of 8 Remote Apache Airflow Jobs in the West Midlands

automation to ensure successful project delivery, adhering to client timelines and quality standards. Implement and manage real-time and batch data processing frameworks (e.g., Apache Kafka, Apache Spark, Google Cloud Dataproc) in line with project needs. Build and maintain robust monitoring, logging, and alerting systems for client projects … languages like Python, Bash, or Go to automate tasks and build necessary tools. Expertise in designing and optimising data pipelines using frameworks like Apache Airflow or equivalent. Demonstrated experience with real-time and batch data processing frameworks, including Apache Kafka, Apache Spark, or Google Cloud Dataflow. ...

automation to ensure successful project delivery, adhering to client timelines and quality standards. Implement and manage real-time and batch data processing frameworks (e.g., Apache Kafka, Apache Spark, Google Cloud Dataproc) in line with project needs. Build and maintain robust monitoring, logging, and alerting systems for client projects … languages like Python, Bash, or Go to automate tasks and build necessary tools. Expertise in designing and optimising data pipelines using frameworks like Apache Airflow or equivalent. Demonstrated experience with real-time and batch data processing frameworks, including Apache Kafka, Apache Spark, or Google Cloud Dataflow. ...

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

similar language. Proficiency in database technologies (SQL, NoSQL, time-series databases) and data modelling. Strong understanding of data pipeline orchestration tools (e.g., Apache Airflow, Kubernetes). You thrive when working as part of a team Comfortable in a fast-paced environment Have excellent written and verbal English skills ...

maintain highly reliable and well-tested data and ML pipelines to extract, transform, and structure large datasets for ML applications. Expertise in using Apache Airflow (or similar orchestration tools like Prefect/Dagster) to define, schedule, and monitor complex data and ML workflows (DAGs). Implement comprehensive software … engineering teams. Bonus Skills to Stand Out (Optional): Experience with CI/CD tooling (e.g., GitHub Actions, Jenkins) specifically for ML pipelines and Airflow DAG deployment. Experience with data quality monitoring tools and frameworks. Master's or PhD in Computer Science, Data Science, or a related field. Relevant certifications ...

Technical Standards and Engineering Effectiveness within development squads. • Technical Experience: Demonstrate expertise in using SQL (Spark, Dremio), Python, GitHub and data orchestration tools (Airflow, Oozie) for data wrangling, building data pipelines and developing analytical interfaces. • AI-Assisted Analytics: Bring experience and curiosity towards AI-assisted analytics and machine learning … Strong knowledge and experience of using business intelligence, ETL frameworks and visualisation tools such as Tableau.• Experience with Python, GitHub, data orchestration tools (Oozie, Airflow) for data wrangling, building data pipelines and building analytical/web interfaces.• Good understanding of the full data lifecycle and understanding of typical enterprise ...

Technical Standards and Engineering Effectiveness within development squads. • Technical Experience: Demonstrate expertise in using SQL (Spark, Dremio), Python, GitHub and data orchestration tools (Airflow, Oozie) for data wrangling, building data pipelines and developing analytical interfaces. • AI-Assisted Analytics: Bring experience and curiosity towards AI-assisted analytics and machine learning … Strong knowledge and experience of using business intelligence, ETL frameworks and visualisation tools such as Tableau.• Experience with Python, GitHub, data orchestration tools (Oozie, Airflow) for data wrangling, building data pipelines and building analytical/web interfaces.• Good understanding of the full data lifecycle and understanding of typical enterprise ...