1 to 25 of 41 Apache Airflow Jobs in the South West

Synapse Analytics with Spark and SQL, Azure functions with Python, Azure Purview, and Cosmos DB. They are also proficient in Azure Event Hub and Streaming Analytics, Managed Streaming for Apache Kafka, Azure DataBricks with Spark, and other open source technologies like Apache Airflow and dbt, Spark/Python, or Spark/Scala. Preferred Education Bachelor's Degree More ❯

marketing strategists, data analysts, data engineers, and product owners to define use cases and deliver scalable solutions. Model Deployment & Monitoring: Deploy models using MLOps practices and tools (e.g., MLflow, Airflow, Docker, cloud platforms) ensuring performance, reliability, and governance compliance. Innovation & Research: Stay current on advancements in AI/ML and proactively bring forward new ideas, frameworks, and techniques that … or notebooks-based workflows for experimentation. Data Access & Engineering Collaboration : Comfort working with cloud data warehouses (e.g., Snowflake, Databricks, Redshift, BigQuery) Familiarity with data pipelines and orchestration tools like Airflow Work closely with Data Engineers to ensure model-ready data and scalable pipelines. Nice to have Prior experience working in financial services or within a marketing analytics function. Knowledge More ❯

marketing strategists, data analysts, data engineers, and product owners to define use cases and deliver scalable solutions. Model Deployment & Monitoring: Deploy models using MLOps practices and tools (e.g., MLflow, Airflow, Docker, cloud platforms) ensuring performance, reliability, and governance compliance. Innovation & Research: Stay current on advancements in AI/ML and proactively bring forward new ideas, frameworks, and techniques that … or notebooks-based workflows for experimentation. Data Access & Engineering Collaboration : Comfort working with cloud data warehouses (e.g., Snowflake, Databricks, Redshift, BigQuery) Familiarity with data pipelines and orchestration tools like Airflow Work closely with Data Engineers to ensure model-ready data and scalable pipelines. Nice to have Prior experience working in financial services or within a marketing analytics function. Knowledge More ❯

libraries (e.g., GDAL, GeoPandas, Rasterio). •Familiarity with data cataloguing tools and practices. •Prior experience in a startup or high-growth tech company. •Familiarity with containerisation (Docker), orchestration tools (Airflow, Prefect), and CI/CD workflows. •Understanding of foundational MLOps and data-centric AI practices. •Experience of working in an Agile environment. What We Offer: •The opportunity to shape More ❯

We are seeking a skilled, motivated Data Engineer to join our dynamic and innovative team. As a Data Engineer in the Data & Insight Team you will work as part of a team of data engineers to design, develop, test and More ❯

such as AWS, Azure, or GCP · Docker · Documenting code, architectures, and experiments · Linux systems and bash terminals Preferred Qualifications o Databases and/or data warehousing technologies, such as Apache Hive, Iceberg etc. o Data transformation via SQL and DBT. o Orchestration platforms such as Apache Airflow, Argo Workflows, etc. o Data catalogs and metadata management tools More ❯

Synapse Analytics with Spark and SQL, Azure functions with Python, Azure Purview, and Cosmos DB. They are also proficient in Azure Event Hub and Streaming Analytics, Managed Streaming for Apache Kafka, Azure DataBricks with Spark, and other open source technologies like Apache Airflow and dbt, Spark/Python, or Spark/Scala. Preferred Education Bachelor's Degree More ❯

of Science Degree in software engineering or a related field Proficiency in English spoken and written Nice-to-Haves: Experience with ETL/ELT pipeline design and tools (e.g., Apache Airflow). Familiarity with Change Data Capture (CDC) solutions. Knowledge of database services on other cloud platforms (e.g., Azure SQL Database, Google Cloud Spanner). Understanding of ORM More ❯

patterns in pipeline architecture and design. Confident using Git-based version control systems, including Azure DevOps or similar. Skilled in managing and scheduling data workflows using orchestration platforms like Apache AirFlow. Involved in building and optimizing data warehouses on modern analytics platforms like Snowflake, Redshift, or Databricks. Familiar with visual or low-code data integrations tools, including platforms such More ❯

and Lakehouse Design: Strong data modelling, design, and integration expertise. Data Mesh Architectures: In-depth understanding of data mesh architectures. Technical Proficiency: Proficient in dbt, SQL, Python/Java, Apache Spark, Trino, Apache Airflow, and Astro. Cloud Technologies: Awareness and experience with cloud technologies, particularly AWS. Analytical Skills: Excellent problem-solving and analytical skills with attention to More ❯

analytics platforms. Experience managing data products or platforms, ideally customer data platforms (CDPs), data warehouses (e.g. Snowflake, BigQuery), or data lakes. Familiarity with data engineering workflows, data tools (dbt, Airflow), and cloud data platforms (AWS, GCP, Azure). Familiarity with data modelling, data pipelines, ETL/ELT processes, and APIs. Knowledge of GDPR, data ethics, and governance practices. Strong More ❯

analytics platforms. Experience managing data products or platforms, ideally customer data platforms (CDPs), data warehouses (e.g. Snowflake, BigQuery), or data lakes. Familiarity with data engineering workflows, data tools (dbt, Airflow), and cloud data platforms (AWS, GCP, Azure). Familiarity with data modelling, data pipelines, ETL/ELT processes, and APIs. Knowledge of GDPR, data ethics, and governance practices. Strong More ❯

Product Owner or Product Owner for data/analytics platforms. Understanding of the software development lifecycle with a data-centric lens. Familiarity with data engineering workflows, data tools (dbt, Airflow), and cloud data platforms (AWS, GCP, Azure). Proven experience translating data and analytics requirements into actionable backlog items. Knowledge of regulatory and compliance frameworks (e.g., GDPR, CCPA) as More ❯

Product Owner or Product Owner for data/analytics platforms. Understanding of the software development lifecycle with a data-centric lens. Familiarity with data engineering workflows, data tools (dbt, Airflow), and cloud data platforms (AWS, GCP, Azure). Proven experience translating data and analytics requirements into actionable backlog items. Knowledge of regulatory and compliance frameworks (e.g., GDPR, CCPA) as More ❯

Product Owner or Product Owner for data/analytics platforms. Understanding of the software development lifecycle with a data-centric lens. Familiarity with data engineering workflows, data tools (dbt, Airflow), and cloud data platforms (AWS, GCP, Azure). Proven experience translating data and analytics requirements into actionable backlog items. Knowledge of regulatory and compliance frameworks (e.g., GDPR, CCPA) as More ❯

Product Owner or Product Owner for data/analytics platforms. Understanding of the software development lifecycle with a data-centric lens. Familiarity with data engineering workflows, data tools (dbt, Airflow), and cloud data platforms (AWS, GCP, Azure). Proven experience translating data and analytics requirements into actionable backlog items. Knowledge of regulatory and compliance frameworks (e.g., GDPR, CCPA) as More ❯

oversight across the data platform, including data pipelines, orchestration and modelling. Lead the team in building and maintaining robust data pipelines, data models, and infrastructure using tools such as Airflow, AWS Redshift, DBT and Looker.Ensuring the team follows agile methodologies to improve delivery cadence and responsiveness. Contribute to hands-on coding, particularly in areas requiring architectural input, prototyping, or … mentoring skills and ability to foster team growth and development Strong understanding of the data engineering lifecycle, from ingestion to consumption Hands-on experience with our data stack (Redshift, Airflow, Python, DVT, MongoDB, AWS, Looker, Docker) Understanding of data modelling, transformation, and orchestration best practices Experience delivering both internal analytics platforms and external data-facing products Knowledge of modern More ❯

Pandas, SQL, NoSQL. Has strong experience working with modern database platforms such as Cosmos, Athena, and MySQL. Is comfortable with both NoSQL and relational database design. Able to use Airflow to a high skill level. Enjoys working independently in a small team. Has a good understanding of AWS and Azure architecture. There is also an opportunity to get involved More ❯

in Python and ML/engineering frameworks such as PyTorch, TensorFlow (including Keras), Hugging Face (Transformers, Datasets) and scikit-learn, etc Experience with MLOps tools, including MLFlow, workflow orchestrators (Airflow, Metaflow, Perfect or similar), and containerisation (Docker) Strong knowledge of cloud platforms like Azure, AWS or GCP for deploying and managing ML models Familiarity with data engineering tools and More ❯

by managing data integrations between Salesforce Health Cloud and Informatica, ensuring seamless data flow between systems. You’ll troubleshoot virtual machine access via SSH, facilitate migration of outputs into Airflow, and support AWS infrastructure while interfacing with Google Cloud-hosted systems. The position plays a key role in enabling actionable insights and operational stability across complex, cross-platform data … or Informatica Cloud Solid understanding of data extraction, transformation, and loading (ETL) processes Proficiency in SSH and managing/troubleshooting virtual machine environments Familiarity with orchestration tools such as Apache Airflow Experience with AWS services (e.g., S3, EC2, RDS) Understanding of cloud-based environments (Google Cloud Platform experience a plus) Ability to collaborate across infrastructure, data engineering, and … Manage and optimize data flows between Salesforce Health Cloud and Informatica Perform infrastructure-level troubleshooting using SSH and virtual machine access Ensure high-quality data migration and integration into Airflow-managed pipelines Support AWS-based data operations and contribute to multi-cloud data management Collaborate with infrastructure and application teams to maintain seamless operations Analyze and validate data transformations More ❯

by managing data integrations between Salesforce Health Cloud and Informatica, ensuring seamless data flow between systems. You’ll troubleshoot virtual machine access via SSH, facilitate migration of outputs into Airflow, and support AWS infrastructure while interfacing with Google Cloud-hosted systems. The position plays a key role in enabling actionable insights and operational stability across complex, cross-platform data … or Informatica Cloud Solid understanding of data extraction, transformation, and loading (ETL) processes Proficiency in SSH and managing/troubleshooting virtual machine environments Familiarity with orchestration tools such as Apache Airflow Experience with AWS services (e.g., S3, EC2, RDS) Understanding of cloud-based environments (Google Cloud Platform experience a plus) Ability to collaborate across infrastructure, data engineering, and … Manage and optimize data flows between Salesforce Health Cloud and Informatica Perform infrastructure-level troubleshooting using SSH and virtual machine access Ensure high-quality data migration and integration into Airflow-managed pipelines Support AWS-based data operations and contribute to multi-cloud data management Collaborate with infrastructure and application teams to maintain seamless operations Analyze and validate data transformations More ❯

by managing data integrations between Salesforce Health Cloud and Informatica, ensuring seamless data flow between systems. You’ll troubleshoot virtual machine access via SSH, facilitate migration of outputs into Airflow, and support AWS infrastructure while interfacing with Google Cloud-hosted systems. The position plays a key role in enabling actionable insights and operational stability across complex, cross-platform data … or Informatica Cloud Solid understanding of data extraction, transformation, and loading (ETL) processes Proficiency in SSH and managing/troubleshooting virtual machine environments Familiarity with orchestration tools such as Apache Airflow Experience with AWS services (e.g., S3, EC2, RDS) Understanding of cloud-based environments (Google Cloud Platform experience a plus) Ability to collaborate across infrastructure, data engineering, and … Manage and optimize data flows between Salesforce Health Cloud and Informatica Perform infrastructure-level troubleshooting using SSH and virtual machine access Ensure high-quality data migration and integration into Airflow-managed pipelines Support AWS-based data operations and contribute to multi-cloud data management Collaborate with infrastructure and application teams to maintain seamless operations Analyze and validate data transformations More ❯

by managing data integrations between Salesforce Health Cloud and Informatica, ensuring seamless data flow between systems. You’ll troubleshoot virtual machine access via SSH, facilitate migration of outputs into Airflow, and support AWS infrastructure while interfacing with Google Cloud-hosted systems. The position plays a key role in enabling actionable insights and operational stability across complex, cross-platform data … or Informatica Cloud Solid understanding of data extraction, transformation, and loading (ETL) processes Proficiency in SSH and managing/troubleshooting virtual machine environments Familiarity with orchestration tools such as Apache Airflow Experience with AWS services (e.g., S3, EC2, RDS) Understanding of cloud-based environments (Google Cloud Platform experience a plus) Ability to collaborate across infrastructure, data engineering, and … Manage and optimize data flows between Salesforce Health Cloud and Informatica Perform infrastructure-level troubleshooting using SSH and virtual machine access Ensure high-quality data migration and integration into Airflow-managed pipelines Support AWS-based data operations and contribute to multi-cloud data management Collaborate with infrastructure and application teams to maintain seamless operations Analyze and validate data transformations More ❯

by managing data integrations between Salesforce Health Cloud and Informatica, ensuring seamless data flow between systems. You’ll troubleshoot virtual machine access via SSH, facilitate migration of outputs into Airflow, and support AWS infrastructure while interfacing with Google Cloud-hosted systems. The position plays a key role in enabling actionable insights and operational stability across complex, cross-platform data … or Informatica Cloud Solid understanding of data extraction, transformation, and loading (ETL) processes Proficiency in SSH and managing/troubleshooting virtual machine environments Familiarity with orchestration tools such as Apache Airflow Experience with AWS services (e.g., S3, EC2, RDS) Understanding of cloud-based environments (Google Cloud Platform experience a plus) Ability to collaborate across infrastructure, data engineering, and … Manage and optimize data flows between Salesforce Health Cloud and Informatica Perform infrastructure-level troubleshooting using SSH and virtual machine access Ensure high-quality data migration and integration into Airflow-managed pipelines Support AWS-based data operations and contribute to multi-cloud data management Collaborate with infrastructure and application teams to maintain seamless operations Analyze and validate data transformations More ❯

by managing data integrations between Salesforce Health Cloud and Informatica, ensuring seamless data flow between systems. You’ll troubleshoot virtual machine access via SSH, facilitate migration of outputs into Airflow, and support AWS infrastructure while interfacing with Google Cloud-hosted systems. The position plays a key role in enabling actionable insights and operational stability across complex, cross-platform data … or Informatica Cloud Solid understanding of data extraction, transformation, and loading (ETL) processes Proficiency in SSH and managing/troubleshooting virtual machine environments Familiarity with orchestration tools such as Apache Airflow Experience with AWS services (e.g., S3, EC2, RDS) Understanding of cloud-based environments (Google Cloud Platform experience a plus) Ability to collaborate across infrastructure, data engineering, and … Manage and optimize data flows between Salesforce Health Cloud and Informatica Perform infrastructure-level troubleshooting using SSH and virtual machine access Ensure high-quality data migration and integration into Airflow-managed pipelines Support AWS-based data operations and contribute to multi-cloud data management Collaborate with infrastructure and application teams to maintain seamless operations Analyze and validate data transformations More ❯