2 of 2 Permanent Apache Airflow Jobs in Staffordshire

automation to ensure successful project delivery, adhering to client timelines and quality standards. Implement and manage real-time and batch data processing frameworks (e.g., Apache Kafka, Apache Spark, Google Cloud Dataproc) in line with project needs. Build and maintain robust monitoring, logging, and alerting systems for client projects … languages like Python, Bash, or Go to automate tasks and build necessary tools. Expertise in designing and optimising data pipelines using frameworks like Apache Airflow or equivalent. Demonstrated experience with real-time and batch data processing frameworks, including Apache Kafka, Apache Spark, or Google Cloud Dataflow. ...

strong ability to learn it quickly. Strong SQL skills; working familiarity with Python for scripting and DBT automation. Experience integrating DBT with orchestration tools (Airflow, Dagster, Prefect, etc.). Solid understanding of modern data engineering, ELT patterns, and version-controlled analytics development. Preferred Prior experience operationalizing ML workflows inside ...