10 of 10 Apache Airflow Jobs in the West Midlands

data architectures, including cloud-based and distributed systems. Strong proficiency in SQL and Python . Experience with data engineering and pipeline technologies such as Apache Airflow and Spark . Experience working with cloud platforms, particularly AWS and Azure . Knowledge of big data technologies and distributed data processing. ...

senior or lead-level technical role. Deep expertise in Google Cloud Platform: BigQuery, Dataflow, Pub/Sub, Cloud Storage, and Cloud Composer (Airflow) as the primary data platform stack. Advanced Python and SQL skills, including writing performant, production grade code and conducting rigorous code reviews. Proven experience designing ...

senior or lead-level technical role. Deep expertise in Google Cloud Platform: BigQuery, Dataflow, Pub/Sub, Cloud Storage, and Cloud Composer (Airflow) as the primary data platform stack. Advanced Python and SQL skills, including writing performant, production grade code and conducting rigorous code reviews. Proven experience designing ...

team mentorship. Key Skills: Strong experience in a Lead/Senior Data Engineering role Expertise with GCP (BigQuery, Dataflow, Pub/Sub, Cloud Storage, Airflow) Advanced Python and SQL Experience building scalable batch and real-time data pipelines Strong data modelling, CI/CD, Git, and Terraform knowledge Experience ...

ideal candidate will have strong experience in a lead data engineering position, extensive GCP know-how (BigQuery, Dataflow, Pub/Sub, Cloud Storage, Airflow), and proficiency in Python and SQL. A focus on scalable data pipelines and CI/CD is essential. #J-18808-Ljbffr ...

management * Software testing lifecycle/defect management * CI/CD & DevOps practices Desirable: HMRC/public sector experience, AWS/Azure/SAS PaaS, Airflow or SAS Migration Factory experience. If you are interested in this role or wish to apply, please submit your CV. ...

data platform, blending hands-on delivery with leadership and mentorship responsibilities. The role requires strong GCP experience (BigQuery, Dataflow, Pub/Sub, Cloud Storage, Airflow), advanced Python and SQL, and a track record of building scalable batch and real-time pipelines. #J-18808-Ljbffr ...

Lead Data Engineer Location: West Midlands | Hybrid 3 days per week onsite The Role Were looking for an experienced Lead Data Engineer to provide hands-on technical leadership within a data engineering team for a ...

The Role We’re looking for an experienced Lead Data Engineer to provide hands‐on technical leadership within a data engineering team for a large retail brand. You’ll lead the design and delivery of ...

responsible for availability, latency, performance, efficiency, change management, monitoring, automation, emergency response, and capacity planning for the centralized platforms of Control-M, Automic, Airflow as well as Google services Cloud Composer, Workflows and Scheduler which are utilized across the Bank for workload automation/job scheduling/batch … days’ volunteering leave per year Your Key Responsibilities Develop solutions using Python, Kubernetes, Cloud services and API integrations Build and orchestrate REST APIs across Airflow, Google Cloud Platform, Control-M and Automic Drive the adoption of Infrastructure as Code (IaC) to automate provisioning, configuration, and management of infrastructure Deliver ...