22 of 22 Permanent Apache Airflow Jobs in the South East

fields of data analytics and software Proficiency in Python programming language and common data science packages. Experience with data engineering tools (e.g. Apache Spark, AWS Glue, Kinesis, Snowflake, Apache Airflow) Experience in building data pipelines and data streaming applications. Experience with tools to support the software ...

stack evolves. Nice to Have Experience with stream processing frameworks such as Flink or Spark Streaming. Experience with task orchestration tools such as Apache Airflow or similar systems. Familiarity with additional technologies: GraphQL, React, HTML5, JavaScript, CSS, Postgres, Gradle, BERT. Experience working with and designing infrastructures for large ...

data architectures, including cloud-based and distributed systems. Strong proficiency in SQL and Python . Experience with data engineering and pipeline technologies such as Apache Airflow and Spark . Experience working with cloud platforms, particularly AWS and Azure . Knowledge of big data technologies and distributed data processing. ...

Experience building scalable data pipelines and distributed data platforms Knowledge of Kafka, Spark and modern data processing technologies Experience with orchestration tools such as Airflow, Dagster or Prefect Hands-on experience with Docker, Kubernetes and containerised deployments CI/CD experience with a focus on production ownership and reliability ...

. Strong technical knowledge of SQL and Python . Experience with modern data technologies and tooling such as Microsoft Fabric, Power BI, Snowflake, dbt, Airflow, Databricks or Looker . Experience designing data pipelines, ETL/ELT processes and modern data models. Practical understanding of modern data architecture approaches, including ...

Kanban. Strong analytical and problem‐solving skills, with a focus on delivering high-quality solutions. Experience with modern data engineering tools such as Airflow, dbt, Dataform, or similar technologies. Excellent communication and stakeholder management skills, with the ability to explain technical concepts to non‐technical audiences. What we offer ...

Kanban. Strong analytical and problem-solving skills, with a focus on delivering high-quality solutions. Experience with modern data engineering tools such as Airflow, dbt, Dataform, or similar technologies. Excellent communication and stakeholder management skills, with the ability to explain technical concepts to non-technical audiences. Unfortunately ...

initial 6-month contract. Core Technical Requirements Strong experience with Snowflake for data warehousing, including writing efficient SQL and managing schemas. Proficiency in Airflow for orchestration and workflow management. Hands-on experience with AWS services , particularly S3 for storage and Lambda for serverless processing. Solid understanding of data modelling ...

orchestration It would be nice if you could bring (desirables): Professional experience with PySpark, MySQL, Docker, Kubernetes Experience with best-practice pipeline orchestration software (Airflow, Dagster). Experience migrating code from prototype notebooks to .py, while maintaining logic and transparency of underlying code Owned a project across a whole ...

data platform. You'll play a key role in building and optimising scalable data pipelines and analytics solutions, working across AWS, Snowflake, dbt and Airflow to deliver high-quality data products. The Company They are a well-established media organisation with a large and diverse audience, using data … models. Your Skills & Experience Strong experience with SQL and modern data engineering practices. Hands-on experience with Snowflake and dbt. Strong experience working with Apache Airflow for data orchestration. Experience working with AWS data services and cloud-based data platforms. Strong Python skills for data engineering and pipeline ...

code Requirements: Must have strong, commercial AWS (contract) Data Engineering experience Must bring solid knowledge of data warehousing and modelling Experience with Airflow and infrastructure as a code (Terraform, CloudFormation) would be beneficial Must have experience with Redshift Nice to have: Experience with dbt/lake formation ...

within financial markets/securities . Experience working with GCP BigQuery . Experience with GCP Cloud SQL . Experience with Terraform . Experience with Apache Airflow . Understanding of security reference data, pricing data or corporate actions. The Project The wider project is focused on creating a multi ...

diligence work. Experience with MLOps or model lifecycle tooling such as MLflow, model registries, or feature stores. Experience with workflow orchestration tools such as Airflow, dbt, or Databricks Workflows. Experience with data product or data mesh operating models. Knowledge of European banking or EU regulatory frameworks. Experience with Teradata ...

platform and expanding their engineering capability. The Role Own and develop the MLOps infrastructure supporting AI services. Build and maintain orchestration pipelines using Dagster, Airflow, or Prefect. Deploy and manage ML workloads on Kubernetes and cloud platforms. Implement CI/CD, observability, and monitoring across production systems. Develop infrastructure ...

codebase and pipelines Hands-on experience maintaining production ML models: refresh, retrain, monitor, and troubleshoot, rather than building from scratch Working knowledge of Looker, Airflow and Google Cloud Advanced degree in a quantitative discipline (Computer Science, Mathematics, Statistics, Physics, or similar), or equivalent experience Benefits Hybrid working (3 days ...

/Java and/or Python. Experience managing batching and/or streaming data pipelines and infrastructure using technologies such as GCP, Dataflow/Apache Beam, Dataproc, Spark/Flink, dbt; Working knowledge of SQL and shell scripting; Experience with Docker/k8s and “infrastructure as a code” tools … partners across the organization via Technical Design Documents. This is a great opportunity to further your experience across technologies such as Cloud Composer, Airflow, Dataflow, Spark, Terraform & Google Cloud Platform. Benefits Hybrid working Long contract Award winning work environment ...

/Java and/or Python. Experience managing batching and/or streaming data pipelines and infrastructure using technologies such as GCP, Dataflow/Apache Beam, Dataproc, Spark/Flink, dbt; Working knowledge of SQL and shell scripting; Experience with Docker/k8s and “infrastructure as a code” tools … partners across the organization via Technical Design Documents. This is a great opportunity to further your experience across technologies such as Cloud Composer, Airflow, Dataflow, Spark, Terraform & Google Cloud Platform. Benefits Hybrid working Long contract Award winning work environment ...

/Java and/or Python. Experience managing batching and/or streaming data pipelines and infrastructure using technologies such as GCP, Dataflow/Apache Beam, Dataproc, Spark/Flink, dbt; Working knowledge of SQL and shell scripting; Experience with Docker/k8s and “infrastructure as a code” tools … partners across the organization via Technical Design Documents. This is a great opportunity to further your experience across technologies such as Cloud Composer, Airflow, Dataflow, Spark, Terraform & Google Cloud Platform. Benefits Hybrid working Long contract Award winning work environment ...

Designing and implementing data classification and governance-by-design Maintaining and improving a GCP/BigQuery lakehouse environment Building and supporting pipelines using Python, Airflow/Cloud Composer and dbt Identifying security vulnerabilities and supporting remediation Implementing robust CI/CD, testing and Terraform-based infrastructure Working across integrations … Deep knowledge of RBAC/IAM within cloud data environments Strong understanding of data security, governance and access controls Hands-on experience with Python, Airflow and dbt Experience with Terraform and CI/CD Knowledge of Kubernetes Exposure to AWS alongside GCP Strong stakeholder management and the ability ...

migrate data sets into their AWS Snowflake platform. Designing and implementing dbt models that power clean, consistent metrics. Buidl out orchestartion pipelines using Airflow Creating clear documentation for dashboards, metrics, and models. Ensuring optimal performance and cost efficiency across Snowflake Supporting a stakeholder-first approach to data usability … access. KEY SKILLS AND REQUIREMENTS Extensive experience operating within Snowflake environments Airflow for data orchestration. Proficiency in SQL and dbt, with a strong understanding of data modeling best practices. Strong communication skills with the ability to translate complex needs into elegant data solutions. Focus on usability, documentation, and data ...

within the new architecture. You'll work across: Migrating legacy pipelines and workloads into Snowflake Building and refactoring pipelines using Python Developing orchestration through Airflow/MWAA Infrastructure and deployment using Terraform and Docker Supporting transformation and modelling using dbt Working across both legacy and modern AWS data environments … looking for a broad, hands-on Data Engineer who is comfortable working across data engineering, software engineering and infrastructure. Core experience: Python Airflow/MWAA Snowflake Terraform AWS Desirable experience: dbt Docker Redshift R Data platform migrations or modernisation programmes The ideal candidate will have worked within complex ...

Inside IR35 Location: London - Hybrid, 3 days per week onsite Duration: 6 months The role will focus on GCP, BigQuery, Python, Airflow/Cloud Composer, dbt, Terraform and CI/CD, working closely with architects, engineers, product and governance teams to deliver secure, scalable data solutions. Key experience … BigQuery Python, Airflow & dbt Terraform & CI/CD Data platforms/lakehouse environments Kubernetes AWS alongside GCP Strong stakeholder management If this sounds relevant to you, please drop me a message or send your CV Thanks, Callum ...