18 of 18 Apache Airflow Jobs in the North of England

using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability to communicate technical concepts to both technical ...

using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability to communicate technical concepts to both technical ...

using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability to communicate technical concepts to both technical ...

Vertex AI or Azure ML Data engineering and MLOps Experience with data warehouses such as Snowflake, BigQuery or Redshift Workflow orchestration using tools like Airflow or Dagster Experience with MLOps tools such as MLflow, Weights and Biases or similar Awareness of data and model drift, and how to monitor ...

cloud platform (Azure, AWS or GCP). Exposure to big data technologies such as Spark or Hadoop. Experience with ETL/orchestration tools like Airflow, Talend or Azure Data Factory. Understanding of data warehousing solutions (Snowflake, BigQuery, Redshift or similar). Good understanding of data governance, GDPR and modern ...

will take ownership of the data platform, optimising it for scalability to ensure successful client onboarding. You'll use modern tools (such as Airflow, Prefect, Dagster or AWS Step Functions) for ETL design and orchestration, work on transformation logic to clean, validate and enrich data (including handling missing values ...

field, ideally from a Russell Group university) Hedge fund experience is essential Proficiency in SQL, Python, AWS, and modern data tools Experience with Git, Airflow, and data orchestration Strong troubleshooting skills and a track record of improving data reliability Excellent communication and teamwork skills A self-starter mindset with ...

Data Engineer – FinTech – Newcastle (Tech stack: Data Engineer, SQL, Python, AWS, Git, Airflow, Data Pipelines, Data Platforms, Programmer, Developer, Architect, Data Engineer) Our client is a trailblazer in the FinTech space, known for delivering innovative technology solutions to global financial markets. They are expanding their engineering capability in Newcastle ...

/B testing. Split principles, test planning, logging. Desirable hard skills Python. Data analysis, pandas, numpy, scipy, statsmodels, seaborn, matplotlib etc. ETL processes. Airflow, Pentaho etc. IT understanding. Client-server processes. API. Back-end and front-end. Parsing. Algorithms and data structures. Management. Sprints, AGILE. Waterfall. Jira etc. Other ...

Lead Data Engineer: Experience as a lead or principal data engineer. Prior experience designing data platform(s) within GCP, working hands on with; Airflow, Big Query, Data Flow, Data Fusion, and Data Stream. Deep understanding of Data Mesh/decentralised design and Data Lake/Warehouse solutions. Previously ...

Principal Data Engineer: Experience as a lead or principal data engineer. Prior experience designing data platform(s) within GCP, working hands on with; Airflow, Big Query, Data Flow, Data Fusion, and Data Stream. Deep understanding of Data Mesh/decentralised design and Data Lake/Warehouse solutions. Previously ...

data modelling, transformation, and data governance principles. Advanced SQL skills and experience with data processing frameworks. Experience with orchestration tools such as Cloud Composer (Airflow). Solid understanding of core GCP services: BigQuery, Cloud Storage, Pub/Sub, Cloud Functions, Kubernetes, IAM. Experience using Infrastructure as Code tools (Terraform ...

Data Engineer - GCP/Python/DBT - OutsideIR35 - £500 per day Role: Contract Data Engineer Tech: GCP/Python/DBT/Airbyte/Airflow Rate: £500 per day Determination: Outside IR35 Duration: 3-6 months A start-up client of ours are on the hunt for a Contract ...

experienced team members and fostering a culture of knowledge sharing Communicating clearly and effectively with diverse technical and non-technical audiences Tech stack Python , Airflow , Terraform Azure (but open to other cloud experience) DBT (nice to have) Exposure to ML pipelines beneficial ...

start-ups or high-growth scale-ups • Strong technical grounding across Node.js, Typescript, React, MySQL and cloud-native architectures (AWS, ECS/K8s, Kafka, Airflow) • Comfortable driving Agile and DevOps culture, and setting high standards for clean, testable, secure code in fast-moving environments If you want ...

workflows Nice to Have Knowledge of FinOps principles and cloud cost optimisation Experience with orchestration tools such as Azure Data Factory, Databricks Workflows, or Airflow Exposure to containerisation tools (Kubernetes, Docker) Experience with data cataloguing tools Familiarity with unit testing in data pipelines Awareness of MLOps practices ...

AI. Comfortable working in a fast-paced, agile environment. Excellent communication and collaboration skills. Nice to Have Experience with workflow orchestration tools (e.g., Temporal, Airflow). Familiarity with vector databases or semantic search tools. Experience building internal tooling or developer productivity enhancements using AI. Exposure to customer support ...

scheduling using workflow tools Build and deploy containerised and serverless data solutions Apply software engineering fundamentals to data engineering challenges Technology Stack Snowflake dbt Airflow SQL (strong focus) Cloud platforms (AWS, Azure, or GCP) Containers and Function Apps SQLMesh (or similar data transformation frameworks) Requirements 2-3 years' experience … containers and serverless/function-based architectures Good communication skills and a collaborative mindset Nice to Have Experience with Snowflake in production Exposure to Airflow orchestration ...