1 to 25 of 45 Apache Airflow Jobs in the South East

concepts and best practices Familiarity with CI/CD processes and DevOps practices Preferred Qualifications Snowflake certifications (SnowPro Core, Advanced) Experience with orchestration tools (Airflow, Prefect, etc.) Knowledge of data governance and compliance frameworks Experience with real-time streaming tools (Kafka, Kinesis) Experience supporting BI tools such as Tableau ...

pipelines Proficiency with at least one cloud platform: Amazon Web Services (AWS) Microsoft Azure (Azure) Google Cloud Platform (GCP) Experience with orchestration tools (e.g., Apache Airflow) Experience with version control (e.g., Git) Solid understanding of data warehousing concepts and dimensional modeling To apply for this role please submit ...

/GCP beneficial) Strong data modelling knowledge Understanding of data governance and security best practices Ability to translate business needs into scalable solutions Desirable Airflow, dbt, Kafka, CI/CD, BI tools, governance platforms, financial services experience. Interested in building modern, enterprise-scale data platforms in a highly regulated ...

driving innovation in data engineering. Desirable Criteria Experience delivering data pipelines on Hortonworks/Cloudera on-prem and leading cloud migration initiatives. Familiarity with: Apache Airflow Data modelling and metadata management Experience influencing enterprise data strategy and contributing to architectural governance. To apply for this position please submit ...

Cassandra) Expertise in building and maintaining ETL pipelines and data workflows Familiarity with cloud data platforms (AWS, Azure, GCP) and data pipeline orchestration tools (Airflow, Prefect, etc.) Understanding of data modelling, schema design, and performance optimisation Experience with agile development methodologies, including Scrum and Kanban Familiarity with version control ...

based data engineering, including Redshift, S3, IAM and related services Building and maintaining data pipelines using Python and SQL Orchestration tools such as Airflow Data modelling and warehouse architecture in modern cloud environments Git-based development and Infrastructure as Code (e.g. Terraform) Desirable experience includes exposure to regulated industries ...

detailed technical design. Hands-on experience configuring multi-node Hadoop clusters, including resource management, security, and performance tuning. Strong Big Data engineering background using Apache Airflow, Spark, dbt, Kafka, and Hadoop ecosystem tools. Knowledge of RDBMS systems (PostgreSQL, SQL Server) and familiarity with NoSQL/distributed databases such … MongoDB. Proven delivery of streaming pipelines and real-time data processing solutions. Improved job efficiency and reduced runtimes through Apache Spark optimisation and development. Some experience with containerisation (Docker, Kubernetes) and CI/CD pipelines. Delivered streaming pipelines and real-time data processing solutions. Experience replacing legacy ETL tools ...

Skills and Experience * Strong commercial experience working with AWS in production environments. * Proficiency in Python and SQL for data processing and orchestration. * Experience with Airflow for workflow management. * Knowledge of cloud data warehousing, ideally Redshift. * Experience with infrastructure as code and CI/CD tooling such as Terraform ...

with SQL and modern data warehousing technologies (e.g., Snowflake, BigQuery, Redshift, Databricks). Proven experience building production-ready pipelines using tools such as dbt, Airflow, Dagster, Prefect, or similar. Experience integrating data from HRIS and talent systems (e.g., Workday, BambooHR, Greenhouse, Lever, HiBob, Personio). Ability to work with ...

tasks, working with the Snowflake Data Marketplace, Performance Tuning and Knowledge of ETL/ELT pipelines and data integration tools (e.g., Informatica, Matillion, DBT, Airflow). Experience with APIs, stored procedures, and automation scripts is a plus. Strong analytical and problem-solving mindset. Clear communicator, able to work across ...

grade data pipelines for multiple internal teams. Develops and optimises central data models supporting analytics, ML, and operational workloads. Works with Databricks, AWS, dbt, Airflow, and Looker as part of a modern data stack. Leads complex technical initiatives and improves efficiency through CI/CD, observability, and tooling. Ensures ...

modern data warehouse such as Snowflake, Redshift, or BigQuery. Experience building and maintaining ETL pipelines and data models. Knowledge of orchestration tools such as Airflow or Dagster. Infrastructure-as-code experience such as Terraform or similar. A background working in smaller, high-growth companies or strong engineering-led environments. ...

databases Ideally you will have experience with some of the following technology that is also in the tech stack: data pipeline orchestration tools (e.g. Airflow, Prefect, Dagster), cloud data platforms (e.g. AWS, S3, Glue, Athena, Redshift, Kinesis), data warehouse concepts and dimensional modelling, data streaming tools (e.g. Kafka, Kinesis ...

Required Data Integration & Ingestion Data Manipulation & Processing GitHub, GitHub Actions, Azure DevOps Azure Data Factory Databricks SQL Database Azure Synapse Stream Analytics AWS Glue Apache Airflow AWS Kinesis Amazon Redshift SonarQube PyTest Optional/Nice to Have Experience managing projects or running Scrum teams Experience with BPC/ ...

understanding ML pipelines and models in a production setting. Direct experience with Google Cloud Platform, BigQuery, and associated tooling. Experience with workflow tools like Airflow or Kubeflow. Familiarity with dbt (Data Build Tool). Please send your CV for more information on these roles. Reasonable Adjustments: Respect and equality ...

platforms in a cloud-native environment (AWS, GCP, or Azure). Deep understanding of modern data stacks (e.g. Snowflake/BigQuery/Redshift, dbt, Airflow, BI tools. Comfort operating at both strategic and hands-on levels. Track record of partnering with non-technical stakeholders and influencing at exec level. ...

locally-hosted solutions. Technical Requirements Languages Expert-level Python and advanced SQL . Data Engineering Experience with ETL/ELT and orchestration tools like Apache Airflow or NiFi . On-Prem Tech Proficiency with Hadoop/HDFS , Spark , and containerization via Docker/Kubernetes (K3s/OpenShift) . ...

data platforms and backend systems. Familiarity with data governance frameworks, privacy compliance, and automated data quality checks. Hands-on experience with big data tools (Airflow, Databricks) and data observability platforms. Collaborative mindset and experience working with cross-functional teams including ML and analytics specialists. Curiosity and enthusiasm for continuous ...

Familiarity with cloud platforms such as AWS, Azure or Google Cloud and associated MLOps practices. Experience with automation and orchestration tooling such as UiPath, Airflow or Kubeflow. Experience and Capability Strong experience delivering AI or automation solutions within enterprise environments. Ability to work with cross functional teams and translate ...

technologies including the Python scientific stack (NumPy, Pandas, SciPy, etc.), frameworks such as OpenCV, PyTorch, TensorFlow and JAX, data pipeline tools such as Airflow or Prefect and data processing tools such as Spark or Databricks. The Company The Python Developer will be joining a company whose platform has been ...

technologies including the Python scientific stack (NumPy, Pandas, SciPy, etc.), frameworks such as OpenCV, PyTorch, TensorFlow and JAX, data pipeline tools such as Airflow or Prefect and data processing tools such as Spark or Databricks. The Company The Python Developer will be joining a company whose platform has been ...

technologies including the Python scientific stack (NumPy, Pandas, SciPy, etc.), frameworks such as OpenCV, PyTorch, TensorFlow and JAX, data pipeline tools such as Airflow or Prefect and data processing tools such as Spark or Databricks. The Company The Python Developer will be joining a company whose platform has been ...

directly with clients in a consultative, solution-shaping capacity. * Experience leading or growing technical teams. * Exposure to AWS, automation tools and orchestrators such as Airflow or Dagster. * Understanding of machine learning or predictive analytics, even at a conceptual level. * Experience across multiple industries; familiarity with the music industry ...

experience with Google Cloud Platform (Big Query, Data form, Cloud Composer). Metadata management and data cataloguing (e.g., DataHub, Alation). Modern orchestration platforms (Airflow, Prefect, Dagster). Cloud-native architectures, including Kubernetes, serverless, and Infrastructure as Code. Data mesh or decentralised data architecture implementations. Model Context Protocol ...

experience with Google Cloud Platform (Big Query, Data form, Cloud Composer). Metadata management and data cataloguing (e.g., DataHub, Alation). Modern orchestration platforms (Airflow, Prefect, Dagster). Cloud-native architectures, including Kubernetes, serverless, and Infrastructure as Code. Data mesh or decentralised data architecture implementations. Model Context Protocol ...