1 to 25 of 39 Remote Apache Airflow Jobs

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

Vertex AI or Azure ML Data engineering and MLOps Experience with data warehouses such as Snowflake, BigQuery or Redshift Workflow orchestration using tools like Airflow or Dagster Experience with MLOps tools such as MLflow, Weights and Biases or similar Awareness of data and model drift, and how to monitor ...

modular, reusable transformations using SQL and Python. Implement CI/CD pipelines and manage deployments via Git. Automate workflows using orchestration tools such as Airflow or dbt Cloud. Configure and optimise Snowflake warehouses for performance and cost efficiency. Required Skills & Experience 7+ years in data engineering roles. 3+ years ...

modular, reusable transformations using SQL and Python. Implement CI/CD pipelines and manage deployments via Git. Automate workflows using orchestration tools such as Airflow or dbt Cloud. Configure and optimise Snowflake warehouses for performance and cost efficiency. Required Skills & Experience 7+ years in data engineering roles. 3+ years ...

cloud platform (Azure, AWS or GCP). Exposure to big data technologies such as Spark or Hadoop. Experience with ETL/orchestration tools like Airflow, Talend or Azure Data Factory. Understanding of data warehousing solutions (Snowflake, BigQuery, Redshift or similar). Good understanding of data governance, GDPR and modern ...

using best practices in schema design and data governance. Contribute to ETL/ELT development, testing, and automation using tools such as Python, SQL, Airflow, or Azure Data Factory. Collaborate closely with analysts, scientists, and architects to ensure data solutions meet business needs. Participate in Agile delivery teams, including ...

analytics, AI, and business intelligence use cases. Proven experience in designing architectures for structured, semi-structured, and unstructured data , leveraging technologies like Databricks, Snowflake, Apache Kafka , and Delta Lake to enable seamless data processing and analytics. Hands-on experience in data integration , including designing and optimising data pipelines (batch … e.g., Azure Synapse, AWS Redshift, Google BigQuery ) with legacy systems, ensuring performance and scalability. Deep knowledge of ETL/ELT processes , leveraging tools like Apache Airflow, dbt, or Informatica , with a focus on ensuring data quality, lineage, and integrity across the data lifecycle. Practical expertise in data ...

performance, cost efficiency, and scalability.* Troubleshoot and resolve data pipeline issues swiftly and effectively across the data platform.* Work with orchestration tools such as Airflow, ADF, or Prefect to schedule and automate workflows.* Keep abreast of industry trends and emerging technologies in data engineering, and continuously improve your skills ...

modelling techniques. Experience designing data marts and semantic layers for BI tools (Power BI, Tableau, Looker). Familiarity with analytics engineering tools including dbt, Airflow, and Git for version control. Excellent collaboration and communication skills, with strong attention to detail and data quality. Desirable: Exposure to AI/ ...

complex or secure environments Strong understanding of data modelling, data integration and data management principles Proficiency in SQL, Python and pipeline tools (e.g., Airflow, Spark) Experience with cloud platforms such as AWS, Azure or GCP Awareness of modern data architectures, analytics and visualisation tooling Strong analytical skills and ability ...

have indepth technical knowledge of Python for data workflows, SQL and Data Modelling, DBT, Cloud platforms (AWS, GCP or Azure), Workflow Orchestration tools (e.g. Airflow, Dagster, Prefect, DBT Cloud), CI/CD (GitHub Actions, GitLab CI, CircleCI) You have experience of leading technical deployments, running customer projects, diagnosing issues ...

cloud services and Databricks . Advanced proficiency in Python and SQL for data engineering. Experience with ETL/ELT tools and orchestration frameworks (e.g., Airflow, dbt). Strong knowledge of data warehousing and cloud-based data architectures. Understanding of BI tools such as Power BI or Tableau. Strong problem ...

including Azure DevOps or GitHub Considerable experience designing and building operationally efficient pipelines, utilising core Cloud components, such as Azure Data Factory, Big Query, AirFlow, Google Cloud Composer and Pyspark etc Proven experience in modelling data through a medallion-based architecture, with curated dimensional models in the gold layer ...

data pipelines using Python and SQL to ensure clean, reliable, and well-structured data. You'll design and optimise workflows using tools such as Airflow and dbt to support scalable, high-quality analytics layers. You'll help architect and evolve cloud-based data platforms across technologies like BigQuery, Redshift ...

models that support analytics, machine learning, and operational use cases. The role involves working with modern data stack technologies such as Databricks, AWS, dbt, Airflow, and Looker. They lead complex technical initiatives, improve engineering efficiency through better CI/CD, observability, and tooling, and ensure data reliability at scale. ...

Factory (ADF) and Python . Ensure high-quality raw datasets to enable accurate analytics and data modeling. Deploy and maintain data tools on Kubernetes (Airflow, Superset, RStudio Connect). Support Data Analytics initiatives through DBT , DevOps , and deployment governance. You will work closely with a small, focused team, contributing ...

solutions into real applications Conduct model performance analysis and iterate based on business feedback Automate model training, validation, and deployment using tools like MLflow, Airflow, or Kubernetes Contribute to code reviews, architecture discussions, and system design Requirements: 4+ years of Python development experience (not just scripting - solid OOP, architecture ...

environments Strong Python for automation workflows and data pipelines Proficiency in SQL, data warehousing, and cloud platforms (GCP/Azure preferred) Experience with dbt, Airflow, or similar data modeling tools Understanding of digital marketing data (GA4, ad servers, programmatic platforms) Team management/mentoring experience with collaborative leadership style ...

search, and Generative AI architectures. Practical experience using Hugging Face, OpenAI, LangChain, Retrieval Augmented Generation, and diffusion models. Strong MLOps experience including MLflow, Kubeflow, Airflow, Docker, Kubernetes, and CI and CD tooling. Strong programming skills in Python. Bash, SQL, and JavaScript are desirable. Proven experience working with large, complex ...

Principal Data Engineer: Experience as a lead or principal data engineer. Prior experience designing data platform(s) within GCP, working hands on with; Airflow, Big Query, Data Flow, Data Fusion, and Data Stream. Deep understanding of Data Mesh/decentralised design and Data Lake/Warehouse solutions. Previously ...

Principal Data Engineer: Experience as a lead or principal data engineer. Prior experience designing data platform(s) within GCP, working hands on with; Airflow, Big Query, Data Flow, Data Fusion, and Data Stream. Deep understanding of Data Mesh/decentralised design and Data Lake/Warehouse solutions. Previously ...

Strong skills in Python, Spark, SQL and experience with SQL databases. Terraform experience for cloud infrastructure as code. Experience with Azure and workflow tools (Airflow, ADF). Excellent problem-solving ability, communication skills, and attention to detail. Experience across Waterfall and Agile methodologies. Curious, inclusive, and committed to continuous ...

solutions end-to-end Experience working with large datasets and complex data ecosystems Familiarity with modern data platforms and tools (e.g., Snowflake, dbt, GCP, Airflow) is a plus, but not a requirement Strong analytical and problem-solving skills, with a keen eye for detail and data quality Excellent communication ...