16 of 16 Apache Airflow Jobs in the North of England

direction within your team Required Skills and Experience Strong analytic skills related to working with unstructured datasets Python (PySpark, Pandas, PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka ...

cloud data technologies such as Redshift, Glue, S3, Lambda or IAM. Proficiency in SQL and Python for data processing and orchestration tools such as Airflow Experience with modern modelling approaches and tooling such as dbt. Practical experience with infrastructure as code and CI/CD practices BENEFITS The successful ...

cloud data technologies such as Redshift, Glue, S3, Lambda or IAM. Proficiency in SQL and Python for data processing and orchestration tools such as Airflow Experience with modern modelling approaches and tooling such as dbt. Practical experience with infrastructure as code and CI/CD practices BENEFITS The successful ...

experience working with GCP (BigQuery) and/or Microsoft Fabric (Synapse/OneLake) Experience building and managing data pipelines and workflow orchestration tools (e.g. Airflow, Data Factory) A solid understanding of data modelling (e.g. star schemas, SCD) and governance principles Experience implementing data quality testing and validation Familiarity with ...

days per week in the office. * A collaborative culture and clear opportunities for technical growth. * Exposure to modern tooling including AWS, Redshift, Airflow, Terraform, and dbt. * The chance to shape a data platform and have meaningful influence on engineering standards. How to Apply If you are interested in this ...

days per week in the office. * A collaborative culture and clear opportunities for technical growth. * Exposure to modern tooling including AWS, Redshift, Airflow, Terraform, and dbt. * The chance to shape a data platform and have meaningful influence on engineering standards. How to Apply If you are interested in this ...

Snowflake, Databricks certifications* SAFe, Scrum Master or similar agile qualifications* Modern data warehousing tools (Fabric, Lake Formation, Snowflake, Databricks)* dbt or equivalent transformation tooling* Airflow/ADF/Dagster* Data governance, cataloguing, lineage tools* Agile toolsets such as JIRA, Confluence, DevOps Working Environment* Permanent role with flexible working options. ...

data validation frameworks Experience of testing data platforms such as Snowflake, BigQuery, Redshift, Databricks, Azure Synapse Experience of testing pipelines in things like Airflow, Azure Data Factory, AWS Glue, Kafka Data Concepts ETL/ELT, data modelling, data warehousing, data governance The role is 100% remote, however you must ...

behavioural data (web, apps, ads, etc.) Awareness of privacy and governance considerations Familiarity with AWS-based data stacks (S3, Spark/EMR, Athena, Airflow, notebooks) How you'll work Hybrid role, Manchester-based 2 days per week in the office, the rest flexible Flexible start and finish times Data ...

processes with strong monitoring, logging and error handling Develop and maintain data models to support reporting and analytics Manage workflow orchestration and scheduling (e.g. Airflow or similar) Support CI/CD, version control and deployments across dev, test and production environments Implement data quality checks, governance and documentation Collaborate ...

Agile delivery (Scrum/SAFe) Strong communication and problem-solving skills Technical Stack Snowflake, Databricks, Fabric (or similar) dbt, CI/CD, version control Airflow, ADF, Dagster Power BI, Tableau, Looker JIRA, Confluence, DevOps Qualifications Relevant degree or equivalent experience Cloud or analytics certifications preferred Agile certifications desirable ...

with Cloudera Data Platform (CDP) on AWS or recent Hadoop administration on similar platforms. AWS administration and platform management experience. Strong experience in Spark, Airflow, Apache Ranger, Impala (AWS CDK is a plus). Agile experience with Scrum, and tools including Jira, Slack. Familiarity with PowerBI, CI/ ...

Data Engineer - FinTech - Newcastle (Tech stack: Data Engineer, SQL, Python, AWS, Git, Airflow, Data Pipelines, Data Platforms, Programmer, Developer, Architect, Data Engineer) Our client is a trailblazer in the FinTech space, known for delivering innovative technology solutions to global financial markets. They are expanding their engineering capability in Newcastle ...

technologies including the Python scientific stack (NumPy, Pandas, SciPy, etc.), frameworks such as OpenCV, PyTorch, TensorFlow and JAX, data pipeline tools such as Airflow or Prefect and data processing tools such as Spark or Databricks. The Company The Python Developer will be joining a company whose platform has been ...

Microsoft SQL Server Experience working with NoSQL technologies such as DynamoDB, MongoDB or similar Hands-on Kafka (or equivalent streaming) and workflow orchestration (Airflow) experience Strong understanding of data architecture patterns including data lakes, warehouses and event-driven architectures Experience of consulting across Agile delivery environments, implementing data quality … deploy ETL/ELT pipelines to ingest, transform and optimise large-scale datasets Build and operate event-driven architectures (Kafka) and orchestrate workflows (Airflow) Apply strong data architecture principles across data lakes, warehouses and event-driven solutions Develop and maintain streaming pipelines using technologies such as Kafka Implement monitoring ...

these Experience building data pipelines or data applications Strong skills in Python and/or SQL Familiarity with tools like Spark, Databricks, or Airflow Experience with AWS, Azure, or GCP Strong problem-solving and communication skills What We Offer Competitive salary + progression opportunities Exposure to complex, large-scale … complex data challenges in a high-performance environment, we’d love to hear from you. Data Engineering, Data Pipelines, ETL, Python, SQL, Spark, Databricks, Airflow, AWS, Azure, GCP, Cloud Technologies, Data Processing, Data Transformation, Data Quality, Scalable Systems, Data Applications, Data-Intensive Systems, Data Engineer, Engineering Consultant, High-Impact ...