826 to 850 of 946 Apache Airflow Jobs

/ML, or data engineeringExperience in large-scale data processing, microservices, API design, Kafka, Redis, MemCached, observability tools (Dynatrace, Splunk, Grafana), and orchestration frameworks (Airflow, Temporal)Advanced working knowledge of relational and NoSQL databases, vector stores, data lake architectures, and data governancePractical cloud-native experience (AWS, Azure … SnowflakeDeep hands-on experience with Spark/PySpark and other big data processing technologiesExpertise in open-source table formats and catalog services such as Apache IcebergExperience with LLM orchestration frameworks and model serving infrastructure or managed endpoints (AWS Bedrock, Azure OpenAI)Familiarity with emerging technologies in data engineeringAbility ...

everything: AI pipelines, automation, backend services, and data engineering Data Platform Snowflake as our cloud data warehouse DBT for modular, version-controlled data transformations Airflow for orchestration and workflow automation SQL for data modeling and analysis' Infrastructure & Delivery AWS for cloud infrastructure and services React for front-end interfaces … systems, AI agents, and automated workflows that reduce manual work across asset management You'll also contribute to: Data pipelines and warehouse architecture (Snowflake, Airflow, dbt) Data quality frameworks and automated QC processes Dashboards and reporting that drive portfolio decisions Qualifications Core: Experience building and deploying AI/ ...

everything: AI pipelines, automation, backend services, and data engineering Data Platform Snowflake as our cloud data warehouse DBT for modular, version-controlled data transformations Airflow for orchestration and workflow automation SQL for data modeling and analysis' Infrastructure & Delivery AWS for cloud infrastructure and services React for front-end interfaces … systems, AI agents, and automated workflows that reduce manual work across asset management You'll also contribute to: Data pipelines and warehouse architecture (Snowflake, Airflow, dbt) Data quality frameworks and automated QC processes Dashboards and reporting that drive portfolio decisions Qualifications Core: Experience building and deploying AI/ ...

FastAPI) a huge plus; Experience in Kubernetes, Docker, Spark and related monitoring tools (e.g. DataDog, Grafana, Prometheus) for DataOps a huge plus; Experience with Airflow a huge plus; Experience with dbt for pipeline modelling also beneficial; Skilled at shaping needs into a solid set of requirements and designing scalable … main programming language Databricks Spark for data processing Databricks/dbt/SQL for data modelling and analytics Streamlit for data applications and visualisations Airflow for job scheduling and tracking CircleCI for continuous deployment Parquet and Delta file formats on S3 for data lake storage Terraform for our infrastructure ...

CDO. What you’ll need for this role Hands-on experience designing and operating large-scale data pipelines on GCP (BigQuery, Cloud Composer/Airflow, GCS), with proven knowledge of Apache Kafka and real-time streaming architectures Demonstrated experience leading or technically mentoring a team of data engineers ...

architectural tradeoffs Hands-on experience designing tokenisation schemes for heterogeneous feature types such as numerical, categorical, and temporal Proficiency in Python, PyTorch, SageMaker, and Airflow Experience owning the full model lifecycle, from training through to serving in production Comfortable working in a small, high ownership team on open ended ...

React) Knowledge of relational database design (Postgres) and RESTful API development Proven ability to lead technical initiatives and mentor others Experience automating complex workflows (Airflow) Bonus Qualifications Experience with FastAPI, Kubernetes, and ArgoCI Knowledge of geospatial data and coordinate systems Base Salary Range There are three major components ...

React) Knowledge of relational database design (Postgres) and RESTful API development Proven ability to lead technical initiatives and mentor others Experience automating complex workflows (Airflow) Bonus Qualifications Experience with FastAPI, Kubernetes, and ArgoCI Knowledge of geospatial data and coordinate systems Base Salary Range There are three major components ...

game production cycle or long-term project. A strong understanding of Photogrammetry workflows and software. Proficiency in Python. Experience with build systems like Jenkins, Airflow, or Celery. An understanding of a 3D asset pipeline and color management. Ability to think creatively and develop innovative solutions to complex problems. PLUSESPlease ...

staking, or other on-chain systems. Full-stack development with Python (FastAPI). Strong relational data modeling fundamentals. GitOps and Kubernetes. Job orchestration systems (Airflow, Prefect, etc.). For more information about DRW's processing activities and our use of job applicants' data, please view our Privacy Notice ...

nature of the government contracts we support. Preferred Qualifications Experience with Kubernetes cluster management and AI/ML workflow orchestration (Argo, Airflow, and Kubeflow). Familiarity with GPU virtualization and cloud computing. Experience with Prometheus/Grafana for monitoring. Knowledge of distributed resource scheduling systems (Slurm (preferred), LSF, etc. ...

nature of the government contracts we support. Preferred Qualifications Experience with Kubernetes cluster management and AI/ML workflow orchestration (Argo, Airflow, and Kubeflow). Familiarity with GPU virtualization and cloud computing. Experience with Prometheus/Grafana for monitoring. Knowledge of distributed resource scheduling systems (Slurm (preferred), LSF, etc. ...

such as generating metrics, establishing traceability, etc, when necessary. Deep experience in enterprise-scale deployment practices and issues Bonus Qualifications: Experience working with PipeDream, Airflow and Looker Proficiency in ReactJS, TypeScript and C++ (C+, C+, C+) including memory management, threading, and common debugging pattern There are three major components ...

such as generating metrics, establishing traceability, etc, when necessary. Deep experience in enterprise-scale deployment practices and issues Bonus Qualifications: Experience working with PipeDream, Airflow and Looker Proficiency in ReactJS, TypeScript and C++ (C+, C+, C+) including memory management, threading, and common debugging pattern There are three major components ...

/ML, data engineering)Experience in large-scale data processing, microservices, API design, Kafka, Redis, MemCached, observability tools (Dynatrace, Splunk, Grafana), and orchestration frameworks (Airflow, Temporal)Advanced working knowledge of relational and NoSQL databases, vector stores, data lake architectures, and data governancePractical cloud-native experience (AWS, Azure … SnowflakeDeep hands-on experience with Spark/PySpark and other big data processing technologiesExpertise in open-source table formats and catalog services such as Apache IcebergExperience with LLM orchestration frameworks and model serving infrastructure or managed endpoints (AWS Bedrock, Azure OpenAI)Familiarity with AI evaluation and observability practices: evals ...

wherever your expertise can have the greatest impact. Our application data lives primarily in CockroachDB, with a modern data platform built around BigQuery, dbt, Airflow and pub/sub. Data flows both ways: into analytics and modelling, and back into the products our customers use. That culture translates into … comfortable working beyond a narrowly defined specialism when that is what the problem requires. Experience that will set you apart Experience with BigQuery, Airflow and dbt, or equivalent modern data technologies. Experience with CockroachDB, Postgres or other distributed/relational databases, including CDC or event-driven data pipelines. Knowledge ...

MongoDB. And work with PostgreSQL too. The Senior Data Engineer will be well versed in Kafka. The Senior Data Engineer will know all about Apache Spark, Airflow and Iceberg. The Senior Data Engineer will have solid cloud infrastructure knowledge e.g. Google Cloud (GCP). The Senior Data Engineer ...

help strengthen pre and post-change validation, enhance observability, and support the continuous improvement of automation capabilities. Technology Stack Linux/UNIX Python Ansible Apache Airflow Prometheus Grafana Loki VMware F5 What We're Looking For We're looking for engineers with: Strong Linux/UNIX administration fundamentals ...

building internal developer tools, DSLs, or compilers, multi-language proficiency such as Go, C, or Rust, cybersecurity, workflow orchestration with Prefect or Airflow, high-growth SaaS Условия: Competitive salary Meaningful equity One of the first engineering hires Direct access to the founders Huge ownership from day one Build products ...

provide recommendations for improving documentation and software development process standards. Required : Active and current TS.SCI w FSP through MD 14 years of SWE experience AirFlow Python Spark Trino Kubernetes Education : Bachelor's degree in Computer Science or related discipline from an accredited college or university is required. Four ...

provide recommendations for improving documentation and software development process standards. Required : Active and current TS.SCI w FSP through MD 14 years of SWE experience AirFlow Python Spark Trino Kubernetes Education : Bachelor's degree in Computer Science or related discipline from an accredited college or university is required. Four ...

house robotics hardware. Within that scope, you will specialize in gripper technology, where robotics stops being simulation and starts being physics: vacuum and airflow, seal quality, load balance, and hardware that wears. You will model that physics in production C++ and Python and close the loop back into motion ...

/Java and/or Python. Experience managing batching and/or streaming data pipelines and infrastructure using technologies such as GCP, Dataflow/Apache Beam, Dataproc, Spark/Flink, dbt; Working knowledge of SQL and shell scripting; Experience with Docker/k8s and “infrastructure as a code” tools … partners across the organization via Technical Design Documents. This is a great opportunity to further your experience across technologies such as Cloud Composer, Airflow, Dataflow, Spark, Terraform & Google Cloud Platform. Benefits Hybrid working Long contract Award winning work environment ...

Docker An interest or experience in data/network security would be a nice-to-have Datadog/Grafana/Prometheus Data related products (Airflow, Jupyter, Spark, dbt etc) The projects will be varied and we’re looking for someone who can work autonomously and proactively to scope problems … Stack... Python as our main programming language Terraform for our infrastructure definition Kubernetes for data services and task orchestration Argo CD for application deployments Airflow purely for job scheduling and tracking CircleCI for continuous deployment Parquet and Delta file formats on S3 for data lake storage Postgres/Aurora ...

deployments Troubleshoot integration failures, data inconsistencies, and production issues Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time … robust, production-grade data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). ...