576 to 600 of 886 Apache Airflow Jobs

workbenches, document intelligence platforms, prompt playgrounds, feedback loops, approval workflows, and human-in-the-loop systems. Implement data engineering pipelines using Spark, PySpark, Databricks, Airflow, Kafka, Snowflake, BigQuery, Redshift, SQL, NoSQL, and cloud-native data services. Build ingestion pipelines for structured, semi-structured, and unstructured data including PDFs, Word … with Docker, Kubernetes, Helm, Terraform, CI/CD pipelines , and cloud-native deployments. Strong data engineering skills using SQL, Python, Spark/PySpark, Databricks, Airflow, Kafka , and cloud data platforms. Experience implementing observability, monitoring, logging, tracing, and evaluation for AI/ML/LLM applications. Strong understanding of LLMOps ...

workbenches, document intelligence platforms, prompt playgrounds, feedback loops, approval workflows, and human-in-the-loop systems. Implement data engineering pipelines using Spark, PySpark, Databricks, Airflow, Kafka, Snowflake, BigQuery, Redshift, SQL, NoSQL, and cloud-native data services. Build ingestion pipelines for structured, semi-structured, and unstructured data including PDFs, Word … with Docker, Kubernetes, Helm, Terraform, CI/CD pipelines , and cloud-native deployments. Strong data engineering skills using SQL, Python, Spark/PySpark, Databricks, Airflow, Kafka , and cloud data platforms. Experience implementing observability, monitoring, logging, tracing, and evaluation for AI/ML/LLM applications. Strong understanding of LLMOps ...

workbenches, document intelligence platforms, prompt playgrounds, feedback loops, approval workflows, and human-in-the-loop systems. Implement data engineering pipelines using Spark, PySpark, Databricks, Airflow, Kafka, Snowflake, BigQuery, Redshift, SQL, NoSQL, and cloud-native data services. Build ingestion pipelines for structured, semi-structured, and unstructured data including PDFs, Word … with Docker, Kubernetes, Helm, Terraform, CI/CD pipelines , and cloud-native deployments. Strong data engineering skills using SQL, Python, Spark/PySpark, Databricks, Airflow, Kafka , and cloud data platforms. Experience implementing observability, monitoring, logging, tracing, and evaluation for AI/ML/LLM applications. Strong understanding of LLMOps ...

workbenches, document intelligence platforms, prompt playgrounds, feedback loops, approval workflows, and human-in-the-loop systems. Implement data engineering pipelines using Spark, PySpark, Databricks, Airflow, Kafka, Snowflake, BigQuery, Redshift, SQL, NoSQL, and cloud-native data services. Build ingestion pipelines for structured, semi-structured, and unstructured data including PDFs, Word … with Docker, Kubernetes, Helm, Terraform, CI/CD pipelines , and cloud-native deployments. Strong data engineering skills using SQL, Python, Spark/PySpark, Databricks, Airflow, Kafka , and cloud data platforms. Experience implementing observability, monitoring, logging, tracing, and evaluation for AI/ML/LLM applications. Strong understanding of LLMOps ...

pragmatic engineering mindset focused on automation, reliability, and maintainable solutions. Preferred Qualifications Experience with Argo CD, Helm, or other GitOps tooling. Familiarity with Airflow, Snowflake, or Apache Iceberg. Experience with Apache Kafka or Amazon MSK. Experience with hybrid cloud, enterprise networking, or multi-account AWS environments. Experience ...

About this role: At Astronomer, we’re redefining how companies run Apache Airflow at scale. Our R&D organization is home to some of the most innovative minds in cloud infrastructure and open-source software. You can’t spell “Data Orchestration” without “Data”, and we’re looking … data platforms from cloud-native component parts - we have a healthy mix of build vs. buy; sometimes building is the right choice. Experience with Apache Airflow. #LI-Hybrid At Astronomer, we value diversity. We are an equal opportunity employer: we do not discriminate on the basis of race, religion ...

automation, and data architects. The role focuses on building scalable data pipelines, migrating hundreds of Teradata scripts to dbt models, and orchestrating workflows with Apache Airflow (Astronomer). #J-18808-Ljbffr ...

3+ years experience working in version control environments using platforms such as Gitlab or Github 2+ years experience working with job orchestration tools like Apache Airflow, both as a pipeline developer and reviewer 2+ years experience with data ingestion and transformation frameworks (e.g., dbt, Fivetran, or custom/ ...

role involves using technology to automate data processes, working with SQL, DBT, Snowflake, AWS, Airflow, and Python. About Hard Rock Digital Hard Rock Digital is a company providing digital solutions for the iGaming industry. Estimated Benefits Health Insurance Paid Time Off Benefits estimated based on industry standards #J ...

design, build, and maintain data pipelines and infrastructure to support secure, reliable, and scalable public sector services. You will work with AWS, Terraform, Spark, Airflow, Docker, and GitLab CI/CD within a hybrid model, contributing to secure coding practices and collaborating across cross-functional teams. #J-18808-Ljbffr ...

across analytics, product and engineering teams. The role combines hands‐on pipeline work with strategic design, governance, and observability, primarily on AWS with dbt, Airflow and IaC tooling, to support scale, reliability and secure data #J-18808-Ljbffr ...

analytics and governance while promoting self-service insights for business users. Key skills include data lakehouse design (Iceberg), AWS/Azure data services, dbt, Airflow, and BI/dashboard experience. The role emphasizes automation, quality, and collaboration with architects. #J-18808-Ljbffr ...

smart meter readings daily, enabling customised, market-leading tariffs and a scalable energy ecosystem. Our stack includes Python, Terraform, Kubernetes, Argo CD and Airflow on S3-based data lakes. Join us as a Platform Engineer to design, implement, and maintain scalable data pipelines and services, collaborating with product ...

background as a Machine Learning Engineer. Technical Skills: Strong in SQL and Python (Pandas, Scikit-learn, Jupyter, Matplotlib). Data transformation & manipulation : experience with Airflow, DBT and Kubeflow Cloud: Experience with GCP and Vertex AI (developing ML services). Expertise: Solid understanding of computer science fundamentals and time-series ...

join our dynamic, expanding team. Over the last few years we've built a solid data foundation using best in class technologies (dbt, BigQuery, Airflow) and are just at the start of our journey to leverage this data in a more sophisticated way. About Zapp: Zapp is London ...

results post-migration (before/after comparison) -Release management — experience managing releases in an enterprise environment Nice to have - Experience with other orchestration tools (Airflow, AWS Glue Workflows) - AWS certification (Solutions Architect/DevOps Engineer) - Knowledge of AWS Lambda, EventBridge (commonly used- alongside Step Functions) - Experience in financial domain ...

platforms - execution roles, service roles, cross-account access, Lake Formation, SSO/SAML MLflow or equivalent experiment tracking SageMaker Pipelines or similar workflow orchestration (Airflow, Step Functions) Model serving - real-time endpoints, batch transform, auto-scaling, endpoint monitoring Snowflake as a data source for ML pipelines Kubernetes ...

ideally within a large‐scale or regulated environment. AWS Experience: Strong working knowledge of AWS and cloud‐first data pipeline orchestration tools such as Airflow, Glue, or EMR. A Security Mindset: Understanding of compliance and security when managing sensitive data pipelines. Strong Automation Skills: Comfortable using Python and Shell ...

platforms - execution roles, service roles, cross-account access, Lake Formation, SSO/SAML MLflow or equivalent experiment tracking SageMaker Pipelines or similar workflow orchestration (Airflow, Step Functions) Model serving - real-time endpoints, batch transform, auto-scaling, endpoint monitoring Snowflake as a data source for ML pipelines Kubernetes ...

narratives Entrepreneurial mentality: You can take work beyond the analysis and drive outcomes. Useful additional experience: Experience in Fintech domain Knowledge of utilities like Airflow/Github/DBT Experience with user-facing products and data Please note: we are not able to offer visa sponsorship for this role ...

labeling workflows, ontologies, consensus systems, QA, or label-store integrations Experience with Go, Rust, or TypeScript for services Experience with orchestration tools such as Airflow or Prefect Experience with metadata and lineage tools such as MLflow or Weights & Biases Exposure to edge or sensor data, including audio, sonar, video ...

labeling workflows, ontologies, consensus systems, QA, or label-store integrations Experience with Go, Rust, or TypeScript for services Experience with orchestration tools such as Airflow or Prefect Experience with metadata and lineage tools such as MLflow or Weights & Biases Exposure to edge or sensor data, including audio, sonar, video ...

large‐scale or regulated environment. AWS Experience: You have a strong working knowledge of AWS and cloud‐first data pipeline orchestration tools (like Airflow, Glue, or EMR). A Security Mindset: You understand the importance of compliance and security when managing sensitive data pipelines. Strong Automation Skills ...

will include Design, build and maintain robust, scalable data pipelines that support data science workflows and advanced analytics use cases Develop and manage complex Airflow orchestration, ensuring pipelines are reliable, observable and maintainable Work hands-on with Databricks suite to deliver high-quality data engineering solutions for data science ...

what's at stake for real people, and that's what gives our intensity its purpose. Technologies we use Claude Code, Kubernetes, AWS, Airflow, dlt, dbt, Python, TypeScript, React, Go Please note: we are unable to sponsor or take over sponsorship of an employment visa at this time. Compensation ...