15 of 15 Apache Airflow Jobs in the West Midlands

need to have: AWS Data tooling such as S3/Glue,Redshift. Familiarity with containerization (e.g. Docker/ec2), Orchestraion in enterprise environment (Airflow), Infrastructure automation (Terraform), and CI/CD platform (Github Actions and Admin), Password/Secret Management (hashicorp vault). Strong Data related programming skills ...

Solid experience with modern data engineering tools and patterns, with real depth in several of SQL, Spark, Databricks/Delta Lake, orchestration tools (Dagster, Airflow, Temporal), and dbt. Comfort with modern deployment practices: CI/CD, containerisation (Docker), and cloud-based infrastructure. It's a bonus ...

large scale data. Highly proficient working with Infrastructure as Code (Terraform, Ansible) Highly proficient in Python. Experience in orchestration tools like Dagster, Prefect and Airflow are advantageous. Experience with Spark, Databricks, data lakes/lakehouses. Knowledge of good data modelling and design patterns; in-depth knowledge of relational databases ...

Feature engineering. Exposure to common data analysis and ML technologies such as on scikit-learn, pandas, NumPy, XGBoost, LightGBM. Exposure to tools like Apache Oozie, Apache Airflow. £70,000 - £105,000 a year Why you’ll love it here: We want to make Prima a happy and empowering ...

team mentorship. Key Skills: Strong experience in a Lead/Senior Data Engineering role Expertise with GCP (BigQuery, Dataflow, Pub/Sub, Cloud Storage, Airflow) Advanced Python and SQL Experience building scalable batch and real-time data pipelines Strong data modelling, CI/CD, Git, and Terraform knowledge Experience ...

usage exports, AI vendor billing data, marketplace billing, or the FOCUS specification Experience with Google BigQuery, or with data pipelines and orchestration tooling (Dagster, Airflow) Experience building AI-powered product features (LLM integration, intelligent automation) Exposure to FinOps practices or cloud financial management products BA/BS degree ...

culture of engineering excellence, continuous learning, and cross-pollination of knowledge. Own the technical roadmap for Airalo’s data infrastructure (GCP, BigQuery), orchestration (Dagster, Airflow), and ingestion (Fivetran, custom APIs). Drive data-platform architecture decisions, turning ambiguous business problems into scalable, production-grade technical designs. Bridge the data … background with major cloud platforms (GCP preferred) and cloud-native data warehouses (BigQuery preferred, or Snowflake/Redshift). Strong experience with orchestration tools (Airflow, Dagster), ELT pipelines (Fivetran, dbt), and distributed data processing frameworks (Apache Spark, Flink). Hands-on experience using AI tools to accelerate engineering ...

culture of engineering excellence, continuous learning, and cross-pollination of knowledge. Own the technical roadmap for Airalo’s data infrastructure (GCP, BigQuery), orchestration (Dagster, Airflow), and ingestion (Fivetran, custom APIs). Drive data-platform architecture decisions, turning ambiguous business problems into scalable, production-grade technical designs. Bridge the data … background with major cloud platforms (GCP preferred) and cloud-native data warehouses (BigQuery preferred, or Snowflake/Redshift). Strong experience with orchestration tools (Airflow, Dagster), ELT pipelines (Fivetran, dbt), and distributed data processing frameworks (Apache Spark, Flink). Hands-on experience using AI tools to accelerate engineering ...

have skills: RabbitMQ Java/Microservices MongoDB/MySQL Kubernetes Grafana/Prometheus Gitlab Job Scheduling tooling (eg Berlin/JS7 Job Scheduler, TWS, Apache Airflow). Reporting and visualisation tooling (from Pentaho BA, Power BI, SAP Business Objects). Nice to have: Experience with databases/data ...

have skills: RabbitMQ Java/Microservices MongoDB/MySQL Kubernetes Grafana/Prometheus Gitlab Job Scheduling tooling (e.g. Berlin/JS7 Job Scheduler, TWS, Apache Airflow). Reporting and visualisation tooling (from Pentaho BA, Power BI, SAP Business Objects). Nice to have: Experience with databases/data ...

have skills: * RabbitMQ * Java/Microservices * MongoDB/MySQL * Kubernetes * Grafana/Prometheus * Gitlab * Job Scheduling tooling (e.g. Berlin/JS7 Job Scheduler, TWS, Apache Airflow). * Reporting and visualisation tooling (from Pentaho BA, Power BI, SAP Business Objects). Nice to have: * Experience with databases/data ...

data platform, blending hands-on delivery with leadership and mentorship responsibilities. The role requires strong GCP experience (BigQuery, Dataflow, Pub/Sub, Cloud Storage, Airflow), advanced Python and SQL, and a track record of building scalable batch and real-time pipelines. #J-18808-Ljbffr ...

reason about the performance of non-trivial analytical queries Hands-on experience building and operating data pipelines with an orchestration framework. Dagster or Airflow is highly desired ; equivalent experience with Prefect, dbt or a comparable tool is relevant if you're ready to work in Dagster/Airflow ...

Lead Data Engineer Location: West Midlands | Hybrid 3 days per week onsite The Role Were looking for an experienced Lead Data Engineer to provide hands-on technical leadership within a data engineering team for a ...

Highly proficient in Python. Highly proficient in version control and Git/GitHub. Experience of workflow management tools, e.g. Nextflow, WDL/Cromwell, Airflow, Prefect, Dagster Understanding of containerisation (e.g. Docker) and deployment (e.g. Kubernetes). Good understanding of cloud environments (ideally Azure), distributed computing and scaling workflows … pipelines Understanding of common data transformation and storage formats, e.g. Apache Parquet. Awareness of data standards such as GA4GH ( ) and FAIR (). Experience with Spark, Databricks, data lakes. Follow best practices like code reviews, clean code and unit tests. Experience working in an agile development team. Why join ...