51 to 75 of 308 Remote/Hybrid Apache Airflow Jobs

delivery (CI/CD) pipelines, containerisation, and workflow orchestration. Familiar with ETL/ELT frameworks, and experienced with Big Data Processing Tools (e.g. Spark, Airflow, Hive, etc.) Knowledge of programming languages (e.g. Java, Python, SQL) Hands-on experience with SQL/NoSQL database design. Degree in STEM, or similar ...

delivery (CI/CD) pipelines, containerisation, and workflow orchestration. Familiar with ETL/ELT frameworks, and experienced with Big Data Processing Tools (e.g. Spark, Airflow, Hive, etc.) Knowledge of programming languages (e.g. Java, Python, SQL) Hands-on experience with SQL/NoSQL database design. Degree in STEM, or similar ...

delivery (CI/CD) pipelines, containerisation, and workflow orchestration. Familiar with ETL/ELT frameworks, and experienced with Big Data Processing Tools (e.g. Spark, Airflow, Hive, etc.) Knowledge of programming languages (e.g. Java, Python, SQL) Hands-on experience with SQL/NoSQL database design. Degree in STEM, or similar ...

substitute. Strong platform engineering foundations: cloud (Azure and/or AWS), containers, infrastructure as code, CI/CD, and workflow orchestration (Airflow, Databricks Workflows or similar). Hands-on with ML lifecycle tooling - experiment tracking, model registry (MLflow or equivalent), and CI/CD for models rather than only ...

Experience with Infrastructure as Code (Terraform or CloudFormation). Automation/Al: Proficiency in Python scripting for automation. Experience with workflow orchestration tools (e.g., Airflow, Step Functions). Basic experience integrating Al/ML models into applications. DevOps: Basic understanding of Cl/CD pipelines, containerization (Docker), and cloud ...

Working knowledge of Kubernetes/EKS, comfortable deploying to and reasoning about containerised workloads in a managed K8s environment. Experience orchestrating pipelines with Dagster, Airflow, Prefect, or similar. Solid grasp of ETL concepts and production‐grade pipeline design. Beneficial Skills Interest in chemistry, life sciences, robotics, or manufacturing. Hands ...

data platform. You'll play a key role in building and optimising scalable data pipelines and analytics solutions, working across AWS, Snowflake, dbt and Airflow to deliver high-quality data products. The Company They are a well-established media organisation with a large and diverse audience, using data … models. Your Skills & Experience Strong experience with SQL and modern data engineering practices. Hands-on experience with Snowflake and dbt. Strong experience working with Apache Airflow for data orchestration. Experience working with AWS data services and cloud-based data platforms. Strong Python skills for data engineering and pipeline ...

experience Nice To Have: Experience with Alteryx Server administration, including scheduling, publishing workflows, and managing concurrency Familiarity with workflow orchestration tools such as n8n, Apache Airflow, or Prefect Familiarity with cloud storage environments (AWS S3, SFTP, or similar) Experience with Python or equivalent scripting for lightweight automation tasks ...

issuesData Engineers must have:2:1 or above Hons. degree or equivalent in mathematics, computer science or comparable scientific discipline. PythonBuild ETL Pipelines (e.g., Airflow)JavascriptBuild and CI/CD toolsWrite SQL codeCreate and implementing Rest APIsGIT and GIT branchingBI Tools such as Looker, Qlik, Power BI, TableauContainerisation technologiesGoogle ...

infrastructure, compute, and storage optimization on AWS or GCP. Strong candidates may also have experience with Data pipelining for AI/ML workflows using Airflow, Prefect, or Dagster. Build system expertise with Bazel, CMake, or distributed build systems. Secrets management tools such as Vault, SOPS, AWS Secrets Manager ...

systems Excellent communication skills, able to explain complex technical systems to commercial, operations and senior leadership teams. Experience with Google Cloud, Docker, Kafka, Spark, Airflow, ElasticSearch, ClickHouse or similar production infrastructure Experience owning product roadmaps, release governance or cross-functional delivery across distributed teams and time zones. What ...

such as customer lifetime value, attribution modelling, real-time bidding, and audience targeting is a plus Familiarity with data pipeline orchestration tools such as Apache Airflow and Kubernetes is a plus You do your best work as part of a team and enjoy sharing knowledge just as much ...

team mentorship. Key Skills: Strong experience in a Lead/Senior Data Engineering role Expertise with GCP (BigQuery, Dataflow, Pub/Sub, Cloud Storage, Airflow) Advanced Python and SQL Experience building scalable batch and real-time data pipelines Strong data modelling, CI/CD, Git, and Terraform knowledge Experience ...

Data Scientists use (we don't expect applicants to have experience with all of these):Python and Databricks for Data Science, Spark, MLFlow and Airflow for ML Workflows, Google Cloud Platform for our analytics infrastructure, dbt and BigQuery for data modelling and warehousing. Discover more about our Analytics Community ...

advanced analytics - ideally in a hybrid PLG/sales-led SaaS environment Strong Python and SQL; experience with data modelling and pipeline tools (dbt, Airflow, Dagster) Deep expertise in predictive modelling, causal inference, survival analysis, and experimentation (A/B, diff-in-diff, instrumental variables) Experience working directly with ...

advanced analytics - ideally in a hybrid PLG/sales-led SaaS environment Strong Python and SQL; experience with data modelling and pipeline tools (dbt, Airflow, Dagster) Deep expertise in predictive modelling, causal inference, survival analysis, and experimentation (A/B, diff-in-diff, instrumental variables) Experience working directly with ...

similar). Experience with unit, integration testing for ML models, including data validation, correctness checks, and reproducibility. Experience with CI/CD, Orchestration tools (Airflow, MLflow, Kubernetes, Terraform) and ML/data platforms(SageMaker, Databricks, Unity Catalog, Snowflake/Snowpark) to build scalable ML data pipelines and model workflows. ...

similar). Experience with unit, integration testing for ML models, including data validation, correctness checks, and reproducibility. Experience with CI/CD, Orchestration tools (Airflow, MLflow, Kubernetes, Terraform) and ML/data platforms(SageMaker, Databricks, Unity Catalog, Snowflake/Snowpark) to build scalable ML data pipelines and model workflows. ...

similar). Experience with unit, integration testing for ML models, including data validation, correctness checks, and reproducibility. Experience with CI/CD, Orchestration tools (Airflow, MLflow, Kubernetes, Terraform) and ML/data platforms(SageMaker, Databricks, Unity Catalog, Snowflake/Snowpark) to build scalable ML data pipelines and model workflows. ...

similar). Experience with unit, integration testing for ML models, including data validation, correctness checks, and reproducibility. Experience with CI/CD, Orchestration tools (Airflow, MLflow, Kubernetes, Terraform) and ML/data platforms(SageMaker, Databricks, Unity Catalog, Snowflake/Snowpark) to build scalable ML data pipelines and model workflows. ...

similar). Experience with unit, integration testing for ML models, including data validation, correctness checks, and reproducibility. Experience with CI/CD, Orchestration tools (Airflow, MLflow, Kubernetes, Terraform) and ML/data platforms(SageMaker, Databricks, Unity Catalog, Snowflake/Snowpark) to build scalable ML data pipelines and model workflows. ...

similar). Experience with unit, integration testing for ML models, including data validation, correctness checks, and reproducibility. Experience with CI/CD, Orchestration tools (Airflow, MLflow, Kubernetes, Terraform) and ML/data platforms(SageMaker, Databricks, Unity Catalog, Snowflake/Snowpark) to build scalable ML data pipelines and model workflows. ...

similar). Experience with unit, integration testing for ML models, including data validation, correctness checks, and reproducibility. Experience with CI/CD, Orchestration tools (Airflow, MLflow, Kubernetes, Terraform) and ML/data platforms(SageMaker, Databricks, Unity Catalog, Snowflake/Snowpark) to build scalable ML data pipelines and model workflows. ...

similar). Experience with unit, integration testing for ML models, including data validation, correctness checks, and reproducibility. Experience with CI/CD, Orchestration tools (Airflow, MLflow, Kubernetes, Terraform) and ML/data platforms(SageMaker, Databricks, Unity Catalog, Snowflake/Snowpark) to build scalable ML data pipelines and model workflows. ...

similar). Experience with unit, integration testing for ML models, including data validation, correctness checks, and reproducibility. Experience with CI/CD, Orchestration tools (Airflow, MLflow, Kubernetes, Terraform) and ML/data platforms(SageMaker, Databricks, Unity Catalog, Snowflake/Snowpark) to build scalable ML data pipelines and model workflows. ...