26 to 50 of 160 Remote Apache Airflow Jobs

modern data architectures, including cloud-based and distributed systems. Strong proficiency in SQL and Python. Experience with data engineering and pipeline technologies such as Apache Airflow and Spark. Experience working with cloud platforms, particularly AWS and Azure. Knowledge of big data technologies and distributed data processing. Understanding ...

EventBridge, SQS, Step Functions, CloudWatch Proficient in Python and SQL (Go would be advantageous) Experience with data orchestration and workflow management (e.g. Airflow or AWS- native solutions). Good understanding of data modelling and data warehousing concepts. Confident owning core relational databases (e.g. MySQL) and their processes. Experience handling ...

test, and deploy ETL pipelines to source, cleanse, and optimise data at scale. Automate and orchestrate data workflows: Develop and maintain orchestration solutions (e.g. Apache Airflow), implementing testing, alerting, monitoring, and data quality checks as first‐class concerns. Ensure data quality and observability: Embed data testing and validation … event streaming platforms including Kafka and its core concepts on topics, messages, and consumers. Experience building and operating automated data workflows using tools like Apache Airflow. Experience implementing data quality and validation checks throughout pipelines to ensure accuracy, completeness, consistency, and reliability. Practical experience implementing monitoring, observability and alerting ...

. Strong technical knowledge of SQL and Python . Experience with modern data technologies and tooling such as Microsoft Fabric, Power BI, Snowflake, dbt, Airflow, Databricks or Looker . Experience designing data pipelines, ETL/ELT processes and modern data models. Practical understanding of modern data architecture approaches, including ...

large- scale batch processing. Proven ability to deploy and maintain data infrastructure using Infrastructure as Code principles and tools such as Terraform. Experience with Airflow environment management and Docker. Experience contributing to an AI roadmap and evaluating AI tooling, including coding agents, for use within the development lifecycle. ...

similar. Experience with MLOps practices such as model deployment, monitoring, versioning or model registries. Exposure to workflow orchestration or deployment tools such as Airflow, MLflow, Azure DevOps, GitHub Actions or similar. Experience in pricing, insurance, financial services or another regulated environment. Understanding of model governance, responsible AI or explainability. ...

Versatility: Fluency in data processing languages (Python, SQL, PySpark) and an open-minded approach to tech stacks—ranging from SSIS and stored procedures to Airflow, Spark, Databricks, or Fabric. Cloud Capability: Experience with at least one major cloud provider (AWS, Azure, or Google Cloud) alongside a curiosity to learn ...

Kanban. Strong analytical and problem‐solving skills, with a focus on delivering high-quality solutions. Experience with modern data engineering tools such as Airflow, dbt, Dataform, or similar technologies. Excellent communication and stakeholder management skills, with the ability to explain technical concepts to non‐technical audiences. What we offer ...

Kanban. Strong analytical and problem-solving skills, with a focus on delivering high-quality solutions. Experience with modern data engineering tools such as Airflow, dbt, Dataform, or similar technologies. Excellent communication and stakeholder management skills, with the ability to explain technical concepts to non-technical audiences. Unfortunately ...

data platforms (AWS, GCP, or Azure) Technical credibility with data engineering practices: strong grasp of SQL, data modeling, pipeline design, and tools like dbt, Airflow, Fivetran, and similar Hands-on experience with cloud data warehouses (BigQuery, Redshift, or Snowflake); understanding of performance optimization, partitioning, and data quality patterns Ability ...

/ELT, and various database technologies. Technical Versatility: Fluency in data processing languages (Python, SQL, PySpark) and openness to tech stacks such as SSIS, Airflow, Spark, Databricks, Fabric. Cloud Capability: Experience with at least one major cloud provider (AWS, Azure, or Google Cloud) and curiosity to learn others. Bridging ...

just how fast. We expect you to enjoy leveraging AI and agentic systems to operate more effectively. Tech environmentScala | Spark | Databricks | AWS | Claude | Airflow | Kubernetes | Terraform | Functional ProgrammingYou will thrive here if youEnjoy end-to-end ownership, from writing the code to architecture design to coaching others through delivery. ...

experienced with modern cloud data platforms such as BigQuery, Snowflake, or Databricks. You've worked with data orchestration tools such as Dagster, Airflow, or Prefect. We use Dagster. You're comfortable owning cloud infrastructure. You can work with infrastructure-as-code such as Terraform and own the infrastructure your ...

similar language. Proficiency in database technologies (SQL, NoSQL, time-series databases) and data modelling. Strong understanding of data pipeline orchestration tools (e.g., Apache Airflow, Kubernetes). You thrive when working as part of a team Comfortable in a fast-paced environment Have excellent written and verbal English skills ...

Building Extract Transform and Load (ETL) pipeline (streaming/batch) using MPP frameworks (Spark, Beam, or other) Experience in orchestrating complex pipelines using Airflow, Dagster or other Proficiency in one or more programming languages: Python, Java, GO or other Experience with AWS or GCP and their products ...

technical roadmap for data engineering across Elliptic. Leverage and deploy AI and agentic systems to operate more effectively. Tech environment Scala | Spark | Databricks | AWS | Airflow | Kubernetes | Terraform | Functional Programming You will thrive here if you Enjoy end‐to‐end ownership, from writing the code to architecture design to coaching ...

required . Proficiency in at least one object-oriented language. Experience with big data technologies such as HDFS, YARN, MapReduce, Hive, Kafka, Spark, Airflow, or Presto. Experience with AWS, GCP, or Looker (advantageous but not essential). Solid background in data modelling, including the design, implementation and optimisation ...

required . Proficiency in at least one object-oriented language. Experience with big data technologies such as HDFS, YARN, MapReduce, Hive, Kafka, Spark, Airflow, or Presto. Experience with AWS, GCP, or Looker (advantageous but not essential). Solid background in data modelling, including the design, implementation and optimisation ...

wider stakeholders. Technical Environment Experience with some of the following technologies would be beneficial: Python SQL Cloud platforms – AWS, Azure or GCP Databricks Apache Spark/PySpark Kafka/event-driven architectures Airflow dbt Git/GitHub CI/CD Infrastructure as Code Modern data platforms and distributed ...

Computer Science or equivalent practical experience Experience developing finance applications is a plus Working experience with Terraform is a plus Experience creating workflows for Apache Airflow is a plus #LI-JB6 What's Roku's approach to hybrid working? Roku fosters an inclusive and collaborative environment where teams ...

significant commitments to other projects during this period. Qualifications Must‐Have Data Engineering : Experience with SQL , Python , ETL , ELT , and tools like Spark , Kafka , Airflow , dbt , Snowflake , BigQuery , or Databricks on AWS , GCP , or Azure . Sales : Experience as Account Executives, Account Managers, Customer Success Managers, SDRs, BDRs ...

using: Kafka as our message transport Flink for (near) real time processing Datahub as our catalog BigQuery as our warehouse Airflow (GCP Composer) for scheduling DBT for data transformation Montecarlo for monitoring The platform here encompasses the end-to-end, first for real time/streaming use cases ...

Data Engineer within GCP environments Hands-on experience with BigQuery, Dataflow and Spanner Strong programming capability in Python, Java or Scala Experience with Apache Beam/Dataflow and distributed processing frameworks Experience designing and managing ETL/ELT pipelines Solid understanding of data modelling and database design Experience with … workflow orchestration tools such as Apache Airflow Strong understanding of data governance, security and scalability Desirable Skills for the GCP Data Engineer: Experience with Pub/Sub, Cloud Composer or Cloud Data Fusion Exposure to CI/CD, DevOps and Infrastructure as Code Experience with real-time streaming ...

operating ETL/ELT pipelines and large‐scale data architectures. Hands‐on experience with modern data stacks — our tech includes Python, SQL, Snowflake, Apache Iceberg, AWS S3, PostgresDB, Airflow, dbt, and Apache Spark, deployed via AWS, Docker, and Terraform (experience with similar technologies is essential). Ability ...

skills with exceptional attention to detail. Excellent communication and collaboration skills. Preferred Qualifications Experience with ETL/ELT tools and data orchestration frameworks (e.g., Airflow, dbt). Familiarity with cloud environments such as AWS, Azure, or Google Cloud Platform. Exposure to CI/CD tools (e.g., Jenkins, GitHub Actions ...