21 of 21 Permanent Apache Airflow Jobs in the South East

Data Engineer/Architect - Apache Airflow - Astronomer Location: London - 3 days a week onsite (non-negotiable) Duration: 6 Months Rate: £700-£800 per day Inside IR35 The Role We're supporting a highly reputable client in the Financial Services industry who are seeking an experienced Data Engineer … support them through a period of significant change across their Technology Delivery function. The team are in the early stages of adopting Apache Airflow and Astronomer as their core orchestration platform/tooling for their DBT projects. To move forward with the process and maximise the tooling ...

data warehousing (Snowflake, Redshift, BigQuery or Synapse) Understanding of data modelling and CI/CD Desirable Spark, Databricks or Kafka Orchestration tools such as Airflow or dbt Infrastructure as Code (Terraform) Experience supporting ML workloads What's On Offer Competitive salary and bonus Hybrid working Pension, private healthcare, holiday ...

Data Engineer: Passion for building scalable, resilient cloud data platforms Strong experience with Databricks or Snowflake on AWS Proven Python skills, including Spark and Airflow expertise Advanced SQL skills and end-to-end data modelling experience Experience building batch and real-time data integrations Hands-on CICD skills with ...

Data Engineer: Passion for building scalable, resilient cloud data platforms Strong experience with Databricks or Snowflake on AWS Proven Python skills, including Spark and Airflow expertise Advanced SQL skills and end-to-end data modelling experience Experience building batch and real-time data integrations Hands-on CICD skills with ...

cloud data AWS Aurora PostgreSQL AWS Database Migration Service (DMS) Snowflake Azure Google Cloud Platform (GCP) Data integration and engineering Informatica Talend Apache Airflow Python for data processing and automation Data warehouse design and optimisation APIs and event-driven architecture REST APIs GraphQL Apache Kafka Event-driven ...

initial 6-month contract. Core Technical Requirements Strong experience with Snowflake for data warehousing, including writing efficient SQL and managing schemas. Proficiency in Airflow for orchestration and workflow management. Hands-on experience with AWS services , particularly S3 for storage and Lambda for serverless processing. Solid understanding of data modelling ...

Snowpark Iceberg Tables Secure Data Sharing Snowflake Cortex Data Integration Fivetran SnapLogic Enterprise SaaS integration patterns Data Transformation & Orchestration dbt Cloud/dbt Core Apache Airflow (MWAA) CI/CD pipelines Event-driven orchestration Data Governance & Observability Collibra Data Catalogue Data Lineage Data Governance Frameworks Acceldata Data Observability ...

hands-on experience in at least one data area and one platform area below. Data experience Orchestration: operating pipelines with tools such as Airflow, Dagster or Prefect, including dependencies, retries, backfills, reruns or schema changes. Storage and modelling: designing schemas and storage for relational databases, warehouses or lakehouses ...

lake, lakehouse, warehouse or large-scale analytical platform delivery. • Python, Bash or other scripting and automation approaches. • Workflow orchestration and scheduling tools, such as Airflow, TWS, JS7 or similar. • CI/CD, version control and modern engineering delivery practices. • Data quality, testing, observability and operational resilience. • Working with enterprise ...

cloud-native architectures, with experience shaping technical direction across teams and stakeholders Solid expertise in relevant technologies such as AWS, Terraform, Kafka/MSK, Airflow, Glue or Spark, and building scalable data solutions Experience with modern data ecosystems including data lakes/lakehouse architectures, Iceberg or similar table formats ...

building data pipelines Proficient in SQL, Python, AWS and other data management technologies Familiarity with version control systems like Git and orchestration tools like Airflow Ability to test and troubleshoot data platforms reliably. A track record of improving data reliability and quality Excellent communication skills and the ability ...

Data Engineer Location: Remote – with requirement to visit London based office twice a month Hours: 37.5 Hours a week (Monday – Friday 9:00am – 17:00pm) Salary Range: £40,000 - £80,000 per annum (Depending on ...

Data Engineer within GCP. Experience building production-grade data pipelines and platforms. Expertise with technologies such as BigQuery, Dataflow, Cloud Composer/Airflow, Pub/Sub and Cloud Storage. Strong SQL and data engineering fundamentals. An engineering mindset and a passion for solving problems. Confidence working independently while remaining ...

operate across engineering, product, and business functions Desirable Experience LLM applications and document-processing platforms Retrieval-Augmented Generation (RAG) React and Next.js Snowflake Airflow Data engineering and ETL pipelines Kubernetes and cloud-native infrastructure Supply chain, procurement, or operational systems Ideal Background Suitable candidates may come from: Product ...

Python, APIs, and distributed systems. Good understanding of MLOps tooling, including CI/CD, monitoring, and pipeline management. Experience with tools such as MLflow, Airflow, Evidently, DVC, Docker, or Kubernetes. Experience working within AWS, GCP, or Azure environments. Previous mentoring or leadership experience with an interest in developing management ...

LLMs, or automation technologies to improve business processes. Strong understanding of modern analytics and data platforms. Experience with the following would be beneficial: dbt, Airflow and Git. Looker or similar BI tools. Python for analysis or automation. Experience within fintech, financial services, or another regulated industry. What They Offer ...

improve processes or analytical workflows. Experience within financial services, fintech or another regulated environment is highly desirable. Python experience is preferred. Experience with dbt, Airflow and Git would be advantageous. Experience with Looker, Tableau or another enterprise BI platform. Background in operational analytics, workforce management, customer service ...

deploying, monitoring and maintaining ML systems at scale Ability to balance hands-on engineering with people management responsibilities Experience with AWS, Snowflake, MLflow, Airflow or similar tooling would be advantageous SALARY AND BENEFITS £110,000 - £125,000 base salary Annual bonus Hybrid working model Private medical insurance Enhanced family ...

Engineering, or MLOps environments Experience building, deploying, and supporting machine learning solutions at scale Experience working with AWS and ML tooling such as MLflow, Airflow, Metaflow, or Snowflake Ability to balance technical leadership, strategic thinking, and hands-on engineering contribution SALARY AND BENEFITS Up to £125,000 base salary ...

role). Cloud Infrastructure & Data Pipelines: Build with AWS and Azure services to construct ETL workflows and dynamic systems using orchestration platforms like Apache Airflow. Production Operations: Support production applications, maintain SLAs, and create continuous evaluation metrics for ML solution performance. Qualifications & Skills 2-5 years' hands-on software … Hands-on experience building GenAI applications, LLM workflows, and data pipelines. Cloud experience across AWS or Azure ecosystems along with data orchestration tools (e.g., Airflow). Practical understanding of AI safety, prompt injection handling, and PII/MNPI compliance guardrails. If you have 2-5 years' experience ...

migrate data sets into their AWS Snowflake platform. Designing and implementing dbt models that power clean, consistent metrics. Buidl out orchestartion pipelines using Airflow Creating clear documentation for dashboards, metrics, and models. Ensuring optimal performance and cost efficiency across Snowflake Supporting a stakeholder-first approach to data usability … access. KEY SKILLS AND REQUIREMENTS Extensive experience operating within Snowflake environments Airflow for data orchestration. Proficiency in SQL and dbt, with a strong understanding of data modeling best practices. Strong communication skills with the ability to translate complex needs into elegant data solutions. Focus on usability, documentation, and data ...