51 to 75 of 928 Permanent Apache Airflow Jobs

ideally with a background in software engineering, product management or data analytics. Strong proficiency in Python or Java, SQL, and data pipeline frameworks (e.g., Airflow, dbt, Spark), with solid experience with the AWS ecosystem. Excellent problem-solving skills and ability to work in a fast-paced environment. Bachelor ...

data pipelines, orchestration, and automation; Solid software engineering fundamentals, including version control, testing, and CI/CD; Experience with workflow orchestration frameworks such as Apache Airflow; Experience with cloud-native data platforms, preferably AWS or Azure; Experience with enterprise data warehouses, preferably Snowflake; Experience with performance tuning, cost ...

batch and real-time pipelines Work with streaming and event-driven technologies such as Kafka, Flink, Kinesis, and Pub/Sub Orchestrate workflows using Airflow, Dataflow, and Glue Process and transform large datasets using Spark and Flink Design production-ready systems Work across relational, NoSQL, and analytical data stores ...

data engineering, with demonstrated expertise in designing and implementing scalable, flexible modern data architectures Experience building modern data lake/lakehouse architectures (e.g., Apache Iceberg) in cloud environments Strong knowledge of AWS (S3, Redshift) or Azure data services Experience with ETL/ELT processes and data ingestion Proven expertise … using transformation tools such as dbt Experience with data pipeline orchestration tools (such as Apache Airflow) Experience with best practices applied to data (e.g., testing, CI/CD) Advantageous Experience developing dashboards and reporting solutions using data visualization tools such as Power BI or Amazon QuickSight Experience with ...

. Strong technical knowledge of SQL and Python . Experience with modern data technologies and tooling such as Microsoft Fabric, Power BI, Snowflake, dbt, Airflow, Databricks or Looker . Experience designing data pipelines, ETL/ELT processes and modern data models. Practical understanding of modern data architecture approaches, including ...

have Programming: Proficiency in Python, Java, Scala, or similar languages for data processing. Big Data Technologies: Hands-on experience with tools such as Databricks, Apache Spark, and Hadoop. Cloud Platforms: Familiarity with AWS, Azure, GCP, or other cloud ecosystems for data engineering tasks. Database Management: Expertise in relational databases … e.g. Postgres, SQL Server). Data Integration Tools: Knowledge of platforms like Airflow, Apache NiFi, or Talend. Data Storage and Modelling: Experience with data warehousing tools (e.g. Snowflake, Redshift, BigQuery) and schema design. Version Control and CI/CD: Familiarity with Git, Docker, and CI/CD pipelines ...

Experience building scalable data pipelines and distributed data platforms Knowledge of Kafka, Spark and modern data processing technologies Experience with orchestration tools such as Airflow, Dagster or Prefect Hands‐on experience with Docker, Kubernetes and containerised deployments CI/CD experience with a focus on production ownership and reliability ...

Hadoop, Flink) and cloud platforms (AWS, GCP, or Azure). Familiarity with data warehouse technologies (e.g., Snowflake, Redshift, BigQuery) and workflow orchestration tools (e.g., Airflow, Luigi). Strong knowledge of data security, compliance, and governance frameworks. Effective communication in English. Preferred Qualifications Experience in e‐commerce or consumer‐facing ...

CloudFormation). Cloud experience with AWS, Azure or GCP (networking, IAM, storage, compute), including secure architecture principles. Experience with data platforms and pipelines (Spark, Airflow, Kafka, dbt or similar) and working with large-scale datasets. Knowledge of model serving patterns (REST/gRPC, batch scoring, streaming inference ...

years in a team leadership or mentorship role. Strong technical background in building and maintaining data pipelines and platforms using tools like Spark, dbt, Airflow, Kafka, or Databricks. Proficiency in one or more programming languages (e.g., Python, Scala, or Java) and SQL.Experience with cloud data platforms (e.g. ...

working knowledge Nice-to-have Databricks → AWS (or cross-platform) migration experience — the single strongest signal Parity/statistical testing methodology Data orchestration (Airflow, dbt, Step Functions) Data governance & compliance (PII/GDPR); regulated industry background (iGaming strongly preferred, but FS, banking considered) Soft skills Comfortable working ...

working knowledge Nice-to-have Databricks → AWS (or cross-platform) migration experience — the single strongest signal Parity/statistical testing methodology Data orchestration (Airflow, dbt, Step Functions) Data governance & compliance (PII/GDPR); regulated industry background (iGaming strongly preferred, but FS, banking considered) Soft skills Comfortable working ...

working knowledge Nice-to-have Databricks → AWS (or cross-platform) migration experience — the single strongest signal Parity/statistical testing methodology Data orchestration (Airflow, dbt, Step Functions) Data governance & compliance (PII/GDPR); regulated industry background (iGaming strongly preferred, but FS, banking considered) Soft skills Comfortable working ...

working knowledge Nice-to-have Databricks → AWS (or cross-platform) migration experience — the single strongest signal Parity/statistical testing methodology Data orchestration (Airflow, dbt, Step Functions) Data governance & compliance (PII/GDPR); regulated industry background (iGaming strongly preferred, but FS, banking considered) Soft skills Comfortable working ...

Experience with cloud data services and technologies, ideally within the GCP ecosystem, such as Dataflow, Pub/Sub, BigQuery or Vertex AI. Experience with Airflow environment management and Docker. An interest in contributing to the AI roadmap and experimenting with AI tooling, including coding agents, within the development lifecycle. ...

large- scale batch processing. Proven ability to deploy and maintain data infrastructure using Infrastructure as Code principles and tools such as Terraform. Experience with Airflow environment management and Docker. Experience contributing to an AI roadmap and evaluating AI tooling, including coding agents, for use within the development lifecycle. ...

/CD Ability to work onsite 2x/per week at our Brisbane HQ PREFERRED QUALIFICATIONS Experience with workflow orchestration systems (Prefect, Nextflow, CWL, Airflow) Experience with LIMS/ELN data modeling, preferably Benchling Experience building and operating data pipelines or ETL systems, and comfort owning them ...

senior or lead-level technical role. Deep expertise in Google Cloud Platform: BigQuery, Dataflow, Pub/Sub, Cloud Storage, and Cloud Composer (Airflow) as the primary data platform stack. Advanced Python and SQL skills, including writing performant, production grade code and conducting rigorous code reviews. Proven experience designing ...

Kanban. Strong analytical and problem‐solving skills, with a focus on delivering high-quality solutions. Experience with modern data engineering tools such as Airflow, dbt, Dataform, or similar technologies. Excellent communication and stakeholder management skills, with the ability to explain technical concepts to non‐technical audiences. What we offer ...

Kanban. Strong analytical and problem-solving skills, with a focus on delivering high-quality solutions. Experience with modern data engineering tools such as Airflow, dbt, Dataform, or similar technologies. Excellent communication and stakeholder management skills, with the ability to explain technical concepts to non-technical audiences. Unfortunately ...

data engineering, with demonstrated expertise in designing and implementing scalable, flexible modern data architectures Experience building modern data lake/lakehouse architectures (e.g., Apache Iceberg) in cloud environments Strong knowledge of AWS (S3, Redshift) or Azure data services Experience with ETL/ELT processes and data ingestion Proven expertise … using transformation tools such as dbt Experience with data pipeline orchestration tools (such as Apache Airflow) Experience with best practices applied to data (e.g., testing, CI/CD) Advantageous Experience developing dashboards and reporting solutions using data visualization tools such as Power BI or Amazon QuickSight Experience with ...

Ansible for repeatable, automated provisioning of GPU clusters and AI platform environments; GitOps (ArgoCD) for continuous, declarative platform delivery. Pipeline orchestration: Kubeflow Pipelines, Apache Airflow, or Argo Workflows to orchestrate multi-stage training, fine-tuning, and inference pipelines. Cluster & workload scheduling: Slurm, Run:ai, and NVIDIA Base Command ...

with using and integrating BI tools such as QuickSight, Looker, Power BI, Tableau Business Intelligence (BI) knowledge/experience Knowledge on tools like Terraform, Airflow, DBT and Harness Modern data engineering practises The environment is that of Facebook or Google, relaxed open with time to think and make ...

areas such as: KYC AML Transaction Monitoring Screening Risk Ratings Compliance Case Management Strong data governance, lineage and data quality experience Experience with dbt, Airflow, Azure Data Factory, Dagster or similar tooling CI/CD, Git and modern engineering practices Strong stakeholder engagement and communication skills Why Apply? Opportunity ...

/ELT, and various database technologies. Technical Versatility: Fluency in data processing languages (Python, SQL, PySpark) and openness to tech stacks such as SSIS, Airflow, Spark, Databricks, Fabric. Cloud Capability: Experience with at least one major cloud provider (AWS, Azure, or Google Cloud) and curiosity to learn others. Bridging ...