326 to 350 of 885 Apache Airflow Jobs

similar). Experience with unit, integration testing for ML models, including data validation, correctness checks, and reproducibility. Experience with CI/CD, Orchestration tools (Airflow, MLflow, Kubernetes, Terraform) and ML/data platforms(SageMaker, Databricks, Unity Catalog, Snowflake/Snowpark) to build scalable ML data pipelines and model workflows. ...

similar). Experience with unit, integration testing for ML models, including data validation, correctness checks, and reproducibility. Experience with CI/CD, Orchestration tools (Airflow, MLflow, Kubernetes, Terraform) and ML/data platforms(SageMaker, Databricks, Unity Catalog, Snowflake/Snowpark) to build scalable ML data pipelines and model workflows. ...

similar). Experience with unit, integration testing for ML models, including data validation, correctness checks, and reproducibility. Experience with CI/CD, Orchestration tools (Airflow, MLflow, Kubernetes, Terraform) and ML/data platforms(SageMaker, Databricks, Unity Catalog, Snowflake/Snowpark) to build scalable ML data pipelines and model workflows. ...

similar). Experience with unit, integration testing for ML models, including data validation, correctness checks, and reproducibility. Experience with CI/CD, Orchestration tools (Airflow, MLflow, Kubernetes, Terraform) and ML/data platforms(SageMaker, Databricks, Unity Catalog, Snowflake/Snowpark) to build scalable ML data pipelines and model workflows. ...

similar). Experience with unit, integration testing for ML models, including data validation, correctness checks, and reproducibility. Experience with CI/CD, Orchestration tools (Airflow, MLflow, Kubernetes, Terraform) and ML/data platforms(SageMaker, Databricks, Unity Catalog, Snowflake/Snowpark) to build scalable ML data pipelines and model workflows. ...

similar). Experience with unit, integration testing for ML models, including data validation, correctness checks, and reproducibility. Experience with CI/CD, Orchestration tools (Airflow, MLflow, Kubernetes, Terraform) and ML/data platforms(SageMaker, Databricks, Unity Catalog, Snowflake/Snowpark) to build scalable ML data pipelines and model workflows. ...

similar). Experience with unit, integration testing for ML models, including data validation, correctness checks, and reproducibility. Experience with CI/CD, Orchestration tools (Airflow, MLflow, Kubernetes, Terraform) and ML/data platforms(SageMaker, Databricks, Unity Catalog, Snowflake/Snowpark) to build scalable ML data pipelines and model workflows. ...

similar). Experience with unit, integration testing for ML models, including data validation, correctness checks, and reproducibility. Experience with CI/CD, Orchestration tools (Airflow, MLflow, Kubernetes, Terraform) and ML/data platforms(SageMaker, Databricks, Unity Catalog, Snowflake/Snowpark) to build scalable ML data pipelines and model workflows. ...

similar). Experience with unit, integration testing for ML models, including data validation, correctness checks, and reproducibility. Experience with CI/CD, Orchestration tools (Airflow, MLflow, Kubernetes, Terraform) and ML/data platforms(SageMaker, Databricks, Unity Catalog, Snowflake/Snowpark) to build scalable ML data pipelines and model workflows. ...

similar). Experience with unit, integration testing for ML models, including data validation, correctness checks, and reproducibility. Experience with CI/CD, Orchestration tools (Airflow, MLflow, Kubernetes, Terraform) and ML/data platforms(SageMaker, Databricks, Unity Catalog, Snowflake/Snowpark) to build scalable ML data pipelines and model workflows. ...

similar). Experience with unit, integration testing for ML models, including data validation, correctness checks, and reproducibility. Experience with CI/CD, Orchestration tools (Airflow, MLflow, Kubernetes, Terraform) and ML/data platforms(SageMaker, Databricks, Unity Catalog, Snowflake/Snowpark) to build scalable ML data pipelines and model workflows. ...

similar). Experience with unit, integration testing for ML models, including data validation, correctness checks, and reproducibility. Experience with CI/CD, Orchestration tools (Airflow, MLflow, Kubernetes, Terraform) and ML/data platforms(SageMaker, Databricks, Unity Catalog, Snowflake/Snowpark) to build scalable ML data pipelines and model workflows. ...

similar). Experience with unit, integration testing for ML models, including data validation, correctness checks, and reproducibility. Experience with CI/CD, Orchestration tools (Airflow, MLflow, Kubernetes, Terraform) and ML/data platforms(SageMaker, Databricks, Unity Catalog, Snowflake/Snowpark) to build scalable ML data pipelines and model workflows. ...

similar). Experience with unit, integration testing for ML models, including data validation, correctness checks, and reproducibility. Experience with CI/CD, Orchestration tools (Airflow, MLflow, Kubernetes, Terraform) and ML/data platforms(SageMaker, Databricks, Unity Catalog, Snowflake/Snowpark) to build scalable ML data pipelines and model workflows. ...

secureCost-conscious: optimised warehouse spend, storage strategies, or job efficiency, and treat compute as a resource to manage, not ignorePlatform fluency: worked across orchestration (Airflow, Dagster), warehouses (Snowflake, BigQuery, Databricks), ingestion (Fivetran, Airbyte, custom), and transformation (dbt, Spark)AI Native: experienced in agentic coding workflows (context, harness, loop ...

functionally with Product/Design/Engineering and bring teams along on decisions. To share extra context, our current tech stack includes GCP, BigQuery, Airflow, Python, SQL on the Data side and AWS, Kotlin, Javascript, Typescript on the Product side while our infrastructure is containerised with Kubernetes. Experience across ...

open-source libraries we use extensively. We implement the systems that require the highest data throughput in Java and C++. We use Airflow for workflow management, Kafka for data pipelines, Bitbucket for source control, Jenkins for continuous integration, Grafana + Prometheus for metrics collection, ELK for log shipping ...

level proficiency in Python (3.x) for data engineering, with strong experience in Scripting, pandas, requests, SQLAlchemy, custom libraries, and building reusable, production-grade code. Apache Airflow Deep understanding of core concepts, including DAGs, tasks, operators, sensors, executors, hooks, and connections. Hands-on experience with Airflow architecture, scheduling … GitHub Actions for CI/CD, and collaborative development. Google Cloud Platform (GCP) Solid hands-on experience with GCP services, particularly Cloud Composer (managed Airflow), BigQuery (advanced SQL and Scripting), Cloud Storage, Dataflow, Pub/Sub, IAM, VPC, and Cloud Monitoring/Logging for pipeline observability. #J-18808-Ljbffr ...

enhancement programme. Investment Data Engineer, key skills: Strong commercial experience in Data Engineering, particularly using Snowflake Proven experience developing and maintaining workflows using Apache Airflow and DBT (Data Build Tool) Experience integrating and supporting Bloomberg data feeds, services or associated investment data solutions Strong SQL development and data … with minimal ramp-up time Strong analytical and problem-solving skills Excellent stakeholder communication and collaboration abilities Investment Data Engineer, Bloomberg, SQL, Python, DBT, Airflow Reasonable Adjustments: Respect and equality are core values to us. We are proud of the diverse and inclusive community we have built ...

enhancement programme. Investment Data Engineer, key skills: Strong commercial experience in Data Engineering, particularly using Snowflake Proven experience developing and maintaining workflows using Apache Airflow and DBT (Data Build Tool) Experience integrating and supporting Bloomberg data feeds, services or associated investment data solutions Strong SQL development and data … with minimal ramp-up time Strong analytical and problem-solving skills Excellent stakeholder communication and collaboration abilities Investment Data Engineer, Bloomberg, SQL, Python, DBT, Airflow Reasonable Adjustments: Respect and equality are core values to us. We are proud of the diverse and inclusive community we have built ...

Description Job DescriptionThe Software Engineer shall be responsible for creating and maintaining data workflows and automation pipelines using Apache Airflow. This role focuses on building reliable, scalable, and observable workflow orchestration solutions that support data engineering, analytics, and operational use cases. The engineer will collaborate closely with data engineers … Linux CLI and Linux tools Experience developing Bash scripts to automate manual processes Recent software development experience using Python and Java Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows Experience using Distributed Big Data processing engines including Apache Spark ...

Description Job DescriptionThe Software Engineer shall be responsible for creating and maintaining data workflows and automation pipelines using Apache Airflow. This role focuses on building reliable, scalable, and observable workflow orchestration solutions that support data engineering, analytics, and operational use cases. The engineer will collaborate closely with data engineers … Linux CLI and Linux tools Experience developing Bash scripts to automate manual processes Recent software development experience using Python and Java Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows Experience using Distributed Big Data processing engines including Apache Spark ...

professional software engineering experience. o Platform Maintenance Requirements o Strong Python development experience (APIs, automation, scripting, packaging, unit testing). o Experience administering Apache httpd, including mod_proxy, mod_rewrite, and OIDC authentication modules. o Experience configuring Azure EntraID application registrations, client credentials, OAuth2/OIDC endpoint integration … permissions - including integrating EntraID as an identity provider into web applications via OIDC. o Preferred - Familiarity with JupyterHub, Apache Airflow, and MLflow in a containerized environment. o Preferred - Working knowledge of Apache Spark standalone cluster deployment and configuration o Preferred Basic React/JavaScript familiarity for maintaining ...

/silver/gold layers, and partner with analytics, ML, and trading teams to deliver trusted data assets. You will work with dbt, Spark, Airflow, Kafka, and streaming technologies to ensure data quality, governance, and efficient storage. #J-18808-Ljbffr ...

while mentoring engineers and setting engineering standards. You'll work closely with stakeholders to translate requirements into robust data solutions, using Databricks, Snowflake, dbt, Airflow, Python and SQL in production environments. #J-18808-Ljbffr ...