126 to 150 of 250 Apache Airflow Jobs

modelling, transformation, and visualization (eg Python Dash)Experience with software development (modularisation, versioning eg with GIT, tests, understandable code), with containerization (Docker) and orchestration (Airflow)Habit of starting simple first to get buy-in early and iterate on feedback to add valueCuriosity & desire to understand the worldA plus: existing ...

calling out to external CLI tools/subprocesses safely.You might also have experience of the following:Direct experience with a workflow orchestration framework (Prefect, Airflow, Dagster, or similar).Experience with containerization (Docker, or HPC-oriented tools like Apptainer/Singularity).Exposure to systems that coordinate with external schedulers/ ...

external CLI tools/subprocesses safely. You might also have experience of the following: Direct experience with a workflow orchestration framework (Prefect, Airflow, Dagster, or similar).Experience with containerization (Docker, or HPC-oriented tools like Apptainer/Singularity).Exposure to systems that coordinate with external schedulers/queues ...

models, schemas to support business requirementsDevelop and maintain data ingestion and processing systems using various tools and technologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. Implement data storage solutions using different types of databases, such as relational, non-relational, or cloud-based. Working collaboratively with the client …/Azure SQL, PostgreSQL)You have framework experience within either Flask, Tornado or Django, DockerExperience working with ETL pipelines is desirable e.g. Luigi, Airflow or ArgoExperience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data qualityPreparing ...

models, schemas to support business requirementsDevelop and maintain data ingestion and processing systems using various tools and technologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. Implement data storage solutions using different types of databases, such as relational, non-relational, or cloud-based. Working collaboratively with the client …/Azure SQL, PostgreSQL) You have framework experience within either Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving ...

with DataStrong SQL expertise, particularly in complex analytical and warehouse queriesProficiency in Python and/or JavaExperience with Data Warehouses, such as Snowflake or Apache IcebergPractical knowledge deploying and operating containerised workloads using Docker and KubernetesKnowledge of streaming tooling (Kafka, Kafka Connect, Flink,...)Experience with ETL/… tooling (dbt, Airflow, Airbyte, dlt,..)Hands-on experience provisioning and managing cloud infrastructure with TerraformExperience with CI/CD pipelines, automated testing and Git-based development workflowsFamiliarity with observability practices, including logging, metrics, alerting and production troubleshooting. Strong grasp of software engineering principles and best practicesExperience contributing ...

Data Engineer Location: Remote – with requirement to visit London based office twice a month Hours: 37.5 Hours a week (Monday – Friday 9:00am – 17:00pm) Salary Range: £40,000 - £80,000 per annum (Depending on ...

data engineering, data science and decisioning disciplines, with experience using tools such as GitLab or GitHub Knowledge of Python and orchestration tools such as Apache Airflow would be advantageousHours35Job Posting Closing Date:27/10/2026Ways of Working: Remote FirstSummaryLocation: Edinburgh; Belfast; LondonType: Full time ...

data engineering, data science and decisioning disciplines, with experience using tools such as GitLab or GitHub Knowledge of Python and orchestration tools such as Apache Airflow would be advantageousHours35Job Posting Closing Date:27/10/2026Ways of Working:Remote FirstSummaryLocation: Edinburgh; Belfast; LondonType: Full time ...

data engineering, data science and decisioning disciplines, with experience using tools such as GitLab or GitHub Knowledge of Python and orchestration tools such as Apache Airflow would be advantageousHours35Job Posting Closing Date:27/10/2026Ways of Working:Remote FirstSummaryLocation: Edinburgh; Belfast; LondonType: Full time ...

bandwidth. The goal: no software rewrites, predictable time to production, early integration, and fast iteration. You'll work with tools such as DBT, Python, Apache Airflow, Spark, Iceberg; AWS services like Lambda, Bedrock, and SageMaker, containers, and whatever adds the most value. You'll design tools that ...

implementing large-scale data pipelines, ETL processes, and distributed systems Should be able to work independenty with minimal help/guidance Good Understanding of Airflow,Data Fusion and Data Flow Strong Background and experience in Data Ingestions,Transformation,Modeling and Performance tuning. One migration Experience from Cornerstone ...

implementing large-scale data pipelines, ETL processes, and distributed systems Should be able to work independenty with minimal help/guidance Good Understanding of Airflow,Data Fusion and Data Flow Strong Background and experience in Data Ingestions,Transformation,Modeling and Performance tuning. One migration Experience from Cornerstone ...

modern BI development Advanced SQL skills with the ability to write efficient, scalable queries Hands-on experience with dbt Experience with GCP Experience with Airflow Strong experience building and maintaining ELT/ETL pipelines Experience working with Looker and LookML Knowledge of dimensional modelling and analytics best practices Experience ...

Nice to have Consulting or client-facing delivery experience Experience evaluating and monitoring LLM systems (testing, guardrails, cost control) MLOps tools such as MLflow, Airflow or CI/CD pipelines We Are Dcoded is acting as an employment agency in relation to this permanent vacancy. ...

skills at senior level. Strong technical understanding of SQL, cloud data warehousing and modern data tooling . Experience with tools such as BigQuery, dbt, Airflow, Git and Looker/Tableau or similar. Python experience is advantageous. Comfortable working with ambiguity while maintaining strong analytical rigour. What Will Make ...

GitHub Actions and Azure DevOpsExperience with data platforms and tools such as Azure Data Factory, Databricks, SQL Database, Synapse Analytics, Stream Analytics, AWS Glue, Airflow, Kinesis, Redshift, SonarQube and PyTestExperience in commodity trading and supply operations, ideally within the energy sectorStrong communication skills with both technical and business audiences ...

willingness to take initiative. Desirable Experience with dashboarding/BI tools (Power BI, Tableau, Streamlit). Familiarity with Linux scripting or workflow orchestration tools (Airflow, Prefect). Exposure to financial markets , asset management, or consulting environments. This role would suit someone who is technically strong, logical, and ambitious, with ...

operate across engineering, product, and business functions Desirable Experience LLM applications and document-processing platforms Retrieval-Augmented Generation (RAG) React and Next.js Snowflake Airflow Data engineering and ETL pipelines Kubernetes and cloud-native infrastructure Supply chain, procurement, or operational systems Ideal Background Suitable candidates may come from: Product ...

team's responsibilities.Required Skills, Knowledge and ExpertiseExperience building and operating data pipelines, including ingestion, preparation, data quality checks, backfills and orchestration.Working knowledge of Kubernetes, Airflow, SQL and Spark.A practical approach to delivering work, with reliability and consistency in how you maintain systems and work with others.The ability to collaborate ...

responsibilities. Required Skills, Knowledge and ExpertiseExperience building and operating data pipelines, including ingestion, preparation, data quality checks, backfills and orchestration. Working knowledge of Kubernetes, Airflow, SQL and Spark. A practical approach to delivering work, with reliability and consistency in how you maintain systems and work with others. The ability ...

good understanding of functional paradigms and type theory. Confident JVM knowledge. Modern programming languages knowledge in our primary languages (Java, Python, Clojure).Experience with Airflow or other Python-based workflow orchestration tools. Proficiency in domain-driven design and domain modeling. Exposure to Kubernetes, Docker, Linux, Kafka, RabbitMQ, or git. ...

driving informed decision-making. Experience with data visualization platforms (e.g., Looker, Tableau). Familiarity with Big Data tools and platforms such as Spark and Airflow, and proficiency in version control using Git. Ability to design and develop efficient and scalable ETL and data pipelines for datasets, including ...

with expertise in Python and experience building reusable tooling and platform services. Experience with modern platform and engineering tooling such as GitHub Actions, Apigee, Airflow, and related cloud-native technologies. Expertise with observability platforms such as Data Dog, Prometheus, Grafana, ELK, Splunk or equivalent, including monitoring, logging, tracing, reliability ...

modelling, transformation, and visualization (eg Python Dash)Experience with software development (modularisation, versioning eg with GIT, tests, understandable code), with containerization (Docker) and orchestration (Airflow)Habit of starting simple first to get buy-in early and iterate on feedback to add valueCuriosity & desire to understand the worldA plus: existing ...