15 of 15 Permanent Apache Airflow Jobs in the North of England

direction within your team Required Skills and Experience Strong analytic skills related to working with unstructured datasets Python (PySpark, Pandas, PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka ...

cloud data technologies such as Redshift, Glue, S3, Lambda or IAM. Proficiency in SQL and Python for data processing and orchestration tools such as Airflow Experience with modern modelling approaches and tooling such as dbt. Practical experience with infrastructure as code and CI/CD practices BENEFITS The successful ...

cloud data technologies such as Redshift, Glue, S3, Lambda or IAM. Proficiency in SQL and Python for data processing and orchestration tools such as Airflow Experience with modern modelling approaches and tooling such as dbt. Practical experience with infrastructure as code and CI/CD practices BENEFITS The successful ...

days per week in the office. • A collaborative culture and clear opportunities for technical growth. • Exposure to modern tooling including AWS, Redshift, Airflow, Terraform, and dbt. • The chance to shape a data platform and have meaningful influence on engineering standards. How to Apply If you are interested in this ...

with a strong focus on ETL/ELT. • Advanced SQL and Python development skills. • Hands-on experience with DBT, GIT, Terraform, Docker, IAM, and Airflow (Composer). • Proven experience working on cloud platforms – ideally GCP (BigQuery), but Azure or AWS also considered. • Strong understanding of Data Mesh, Test Driven ...

Snowflake, Databricks certifications * SAFe, Scrum Master or similar agile qualifications * Modern data warehousing tools (Fabric, Lake Formation, Snowflake, Databricks) * dbt or equivalent transformation tooling * Airflow/ADF/Dagster * Data governance, cataloguing, lineage tools * Agile toolsets such as JIRA, Confluence, DevOps Working Environment * Permanent role with flexible working options. ...

commercial experience working as a Data Engineer in AWS. Solid programming skills in Python and strong SQL capability. Exposure to orchestration tools such as Airflow or Dagster. Experience with modern data warehouses such as Snowflake, Redshift or BigQuery. Infrastructure-as-code experience, ideally Terraform or Pulumi. BENEFITS The successful ...

commercial experience working as a Data Engineer in AWS. Solid programming skills in Python and strong SQL capability. Exposure to orchestration tools such as Airflow or Dagster. Experience with modern data warehouses such as Snowflake, Redshift or BigQuery. Infrastructure-as-code experience, ideally Terraform or Pulumi. BENEFITS The successful ...

commercial experience working as a Data Engineer in AWS. Solid programming skills in Python and strong SQL capability. Exposure to orchestration tools such as Airflow or Dagster. Experience with modern data warehouses such as Snowflake, Redshift or BigQuery. Infrastructure-as-code experience, ideally Terraform or Pulumi. BENEFITS The successful ...

Azure, or Google Cloud) including data lakes, warehouses, and lakehouse solutions. Transform and process structured and unstructured data using modern ETL/ELT frameworks (Apache Spark, Airflow, dbt). Collaborate closely with product managers, analysts, and software developers to ensure seamless integration and high-quality data availability. Develop ...

technologies including the Python scientific stack (NumPy, Pandas, SciPy, etc.), frameworks such as OpenCV, PyTorch, TensorFlow and JAX, data pipeline tools such as Airflow or Prefect and data processing tools such as Spark or Databricks. The Company The Python Developer will be joining a company whose platform has been ...

Data Engineer - FinTech - Newcastle (Tech stack: Data Engineer, SQL, Python, AWS, Git, Airflow, Data Pipelines, Data Platforms, Programmer, Developer, Architect, Data Engineer) Our client is a trailblazer in the FinTech space, known for delivering innovative technology solutions to global financial markets. They are expanding their engineering capability in Newcastle ...

Data services (indexing, slots, pruning, partitioning, clustering) Expert-level Kubernetes & GKE resource tuning Hands-on experience with Dataflow job pipelines and worker optimisation Strong Airflow/Composer knowledge (DAG design, scheduling, PodOperator) Strong Dataflow processing pipelines development & schedulers knowledge Deep understanding of Cloud Logging routing, sinks, exclusion filters Experience ...

engineering and product teams to support evolving data requirements Requirements: SQL Server T-SQL DBA Skills Power BI ETL (SSIS or other, such as Airflow) MySQL would be useful but certainly not essential. Apply Now! If you have a range of experience in Data Engineering and you are looking ...

these Experience building data pipelines or data applications Strong skills in Python and/or SQL Familiarity with tools like Spark, Databricks, or Airflow Experience with AWS, Azure, or GCP Strong problem-solving and communication skills What We Offer Competitive salary + progression opportunities Exposure to complex, large-scale … complex data challenges in a high-performance environment, we’d love to hear from you. Data Engineering, Data Pipelines, ETL, Python, SQL, Spark, Databricks, Airflow, AWS, Azure, GCP, Cloud Technologies, Data Processing, Data Transformation, Data Quality, Scalable Systems, Data Applications, Data-Intensive Systems, Data Engineer, Engineering Consultant, High-Impact ...