13 of 13 Apache Airflow Jobs in Wales

of Science Degree in software engineering or a related field Proficiency in English spoken and written Nice-to-Haves: Experience with ETL/ELT pipeline design and tools (e.g., Apache Airflow). Familiarity with Change Data Capture (CDC) solutions. Knowledge of database services on other cloud platforms (e.g., Azure SQL Database, Google Cloud Spanner). Understanding of ORM More ❯

bring: Experience building ETL pipelines in Python. Familiarity with analytical data warehouses (e.g. Redshift preferred, or Snowflake/BigQuery). Understanding of orchestration tools such as AWS Step Functions, Airflow, or AWS Batch. Experience working with Agile methodologies. Awareness of automated testing and delivery pipelines. Understanding of metadata-driven data modelling or scalable data frameworks. Accessibility & Adjustments We are More ❯

grade ETL and ELT pipelines in python Comfortable implementing data architectures in analytical data warehouses such as Snowflake, Redshift or BigQuery Hands on experience with data orchestrators such as Airflow Knowledge of Agile development methodologies Awareness of cloud technology particularly AWS. Knowledge of automated delivery processes Hands on experience of best engineering practices (handling and logging errors, system monitoring More ❯

systems (e.g. Git) Desirables: Experience with cloud-based ML infrastructure, particularly GCP (Vertex AI, BigQuery), or equivalent (e.g. AWS, Azure) Exposure to orchestration tools such as Kubeflow pipelines or Airflow Familiarity with DBT or similar tools for modelling data in data warehouses Desire to build interpretable and explainable ML models (using techniques such as SHAP) Desire to quantify the More ❯

systems (e.g. Git) Desirables: Experience with cloud-based ML infrastructure, particularly GCP (Vertex AI, BigQuery), or equivalent (e.g. AWS, Azure) Exposure to orchestration tools such as Kubeflow pipelines or Airflow Familiarity with DBT or similar tools for modelling data in data warehouses Desire to build interpretable and explainable ML models (using techniques such as SHAP) Desire to quantify the More ❯

analytics platforms. Experience managing data products or platforms, ideally customer data platforms (CDPs), data warehouses (e.g. Snowflake, BigQuery), or data lakes. Familiarity with data engineering workflows, data tools (dbt, Airflow), and cloud data platforms (AWS, GCP, Azure). Familiarity with data modelling, data pipelines, ETL/ELT processes, and APIs. Knowledge of GDPR, data ethics, and governance practices. Strong More ❯

data warehouses (Snowflake, BigQuery), lakes, and CDPs. Understanding of data pipelines, contracts, lineage, APIs, and data governance frameworks. Comfortable navigating GDPR, CCPA and other compliance requirements. Familiar with dbt, Airflow, and cloud platforms (AWS, GCP, Azure). Proven ability to manage backlogs, engage stakeholders and deliver in Agile environments. Analytical mindset with a strong commercial awareness. Why Apply? Excellent More ❯

Utilise Docker for containerisation and Kubernetes for orchestration, ensuring scalable and efficient deployment of applications across both cloud-based and on-premises environments. Workflow Automation: Employ tools such as Apache Airflow to automate data flows and manage complex workflows within hybrid environments. Event Streaming Experience: Utilise event-driven technologies such as Kafka to handle real-time data streams … cloud services. Containerisation and Orchestration Expertise: Solid experience with Docker and Kubernetes in managing applications across both on-premises and cloud platforms. Proficiency in Workflow Automation Tools: Practical experience Apache Airflow in hybrid data environments. Experience in Event Streaming: Proven ability in managing and deploying event streaming platforms like Kafka. Data Security Knowledge: Experience with implementing security practices More ❯

Utilise Docker for containerisation and Kubernetes for orchestration, ensuring scalable and efficient deployment of applications across both cloud-based and on-premises environments. Workflow Automation: Employ tools such as Apache Airflow to automate data flows and manage complex workflows within hybrid environments. Event Streaming Experience: Utilise event-driven technologies such as Kafka to handle real-time data streams … cloud services. Containerisation and Orchestration Expertise: Solid experience with Docker and Kubernetes in managing applications across both on-premises and cloud platforms. Proficiency in Workflow Automation Tools: Practical experience Apache Airflow in hybrid data environments. Experience in Event Streaming: Proven ability in managing and deploying event streaming platforms like Kafka. Data Security Knowledge: Experience with implementing security practices More ❯

common life sciences data acquisition software, such as Scientific Data Management Systems (SDMS) or Laboratory Information Management Systems (LIMS). Hands-on experience with data pipeline orchestration tools (e.g., Apache Airflow) and data parsing. Familiarity with cloud service models, SaaS infrastructure, and related SDLC. Familiarity with containerization and container orchestration tools (e.g., Docker, Kubernetes). ZONTAL is an More ❯

common life sciences data acquisition software, such as Scientific Data Management Systems (SDMS) or Laboratory Information Management Systems (LIMS). Hands-on experience with data pipeline orchestration tools (e.g., Apache Airflow) and data parsing. Familiarity with cloud service models, SaaS infrastructure, and related SDLC. Familiarity with containerization and container orchestration tools (e.g., Docker, Kubernetes). ZONTAL is an More ❯

Code • Create Terraform scripts for the infrastructure provisioning • Set up infrastructure security • Implementation of IAM policy and permissions for applications and GitHub • Changes of environment variables for applications and Airflow DAGS If you are interested please hit apply with your updated CV and we will arrange a call to further your application. More ❯

Leading complex projects involving multiple stakeholders. Design mechanical components in CREO Parametric 3D - Pro/E CAD software. Conduct or direct CFD and FEA analyses to optimize Semiconductor Equipment airflow requirements and mechanical design. Reduce 3D mechanical designs to 2D drawings and apply mechanical tolerancing/GD&T to achieve desired fit and functionality of manufactured parts. Collaborate with … engineering fundamentals, including design principles, materials selection, and fabrication/machining methods. Experience in several of these areas is desirable: CREO Parametric 3D MCAD - Pro/E software, CFD airflow analysis; FEA analysis; Design for manufacture (DFM); Design of welded sheet metal structures and frames; Measurement instrumentation, testing and data acquisition; Programming in Python, C/C C# and More ❯