16 of 16 Permanent Apache Airflow Jobs in Newcastle upon Tyne

Data Engineer

Location
Newcastle upon Tyne, England, United Kingdom
United Kingdom A hands-on data engineering role within a large-scale cloud data programme, responsible for building, maintaining, and troubleshooting data pipelines using Apache Spark, PySpark, Apache Airflow, and a broad suite of AWS services. You will apply strong analytical and engineering skills to deliver trusted … complex, cloud-based data programme - designing, building, and maintaining data pipelines that process large volumes of data across a modern AWS-native stack. Using Apache Spark and PySpark for distributed data processing, Apache Airflow for orchestration, and a range of AWS services for storage, compute, and analytics ...

Data Test Engineer (SC Cleared)

Location
Newcastle upon Tyne, England, United Kingdom
lead quality assurance and testing activities within a large-scale cloud data engineering programme operating across a modern AWS-native technology ecosystem, including Apache Airflow, Amazon Athena, AWS Glue, S3, EMR, DynamoDB, and related cloud services. This role combines hands-on technical leadership with test strategy ownership . … reconciliation, and performance under load Oversee PySpark-based data validation and interrogation activities on AWS EMR Support testing and monitoring of workflows orchestrated through Apache Airflow Drive root cause analysis for production data issues and platform defects Identify, assess, and communicate quality risks across releases and environments Analyse ...

Test Engineer (SC Cleared)

Location
Newcastle upon Tyne, England, United Kingdom
legal frameworks. About the role Test Engineer on a large-scale cloud data engineering programme, operating across a modern AWS-native technology stack including Apache Airflow, Amazon Athena, AWS Glue, S3, EMR, and DynamoDB. You will own testing across automated pipelines, data workflows, and cloud infrastructure — identifying risks … frameworks suited to the AWS data stack. Continuously improve existing frameworks to increase coverage and confidence in test outcomes. Validate data pipelines built on Apache Airflow, AWS Glue, Athena, and EMR — including data integrity, transformation accuracy, and performance under load. Mentoring & coaching – Mentor and advise team members ...

Software Developer

Hiring Organisation
MThree
Location
Newcastle Upon Tyne, North East, United Kingdom
Employment Type
Permanent Contract, Hybrid
Salary
£55,000
automated deployments, infrastructure management, monitoring, and scaling Coaching and mentoring junior engineers and promoting engineering best practices Skills & Experience: Understanding of data processing using Apache Spark and Apache Airflow for task orchestration Use of Python, SQL, and familiarity with PySpark Understanding of EMR and reviewing output logs ...

Data Engineer (SC Eligible/ SC Cleared)

Location
Newcastle upon Tyne, England, United Kingdom
solving and communication skills. Able to work independently and remotely, and to travel to Newcastle once a week. Desirable skills and experience Experience with Apache Spark, Databricks or Kafka. Familiarity with orchestration tools such as Airflow. Experience with CI/CD for data pipelines and Infrastructure as Code. Knowledge ...

Data Engineer - SC Cleared

Hiring Organisation
NSD
Location
Newcastle Upon Tyne, North East, United Kingdom
Employment Type
Permanent Contract, On-site
pipelines Strong programming skills in Python and SQL or similar Experience with technologies such as Spark, Databricks, AWS, Azure, GCP and/or Airflow Strong focus on data quality, testing and reliability Solid software engineering fundamentals and high engineering standards Strong communication and collaborative skills Comfortable working with ambiguity ...

Secure Data Engineer

Location
Newcastle upon Tyne, England, United Kingdom
will be an integral part of our team dedicated to building scalable and secure data platforms. You will leverage your expertise in Databricks, Apache Spark, and Azure to design, develop, and implement data warehouses, data lakehouses, and AI/ML models that fuel our data-driven operations.We are looking … relational or analytical storage technologies. Examples include Kafka, Spark, PostgreSQL.* **Orchestration** Experience defining and running data workflows using modern orchestration frameworks. Examples include Airflow, Dagster or Prefect.* **Data Quality and Lineage** Familiarity with tools and techniques for data testing, documentation and lineage. Examples include Great Expectations or dbt. ...

Data Developers

Location
Newcastle upon Tyne, England, United Kingdom
pipelines. Proficiency in SQL, Python, AWS, and other modern data engineering technologies. Experience with version control tools (e.g., Git) and workflow orchestration platforms (e.g., Airflow). Proven ability to test, troubleshoot, and improve data platforms, ensuring high levels of reliability and data quality. Strong interpersonal and communication skills with ...

Newcastle - Data Engineer (All Levels) Newcastle

Location
Newcastle upon Tyne, England, United Kingdom
building data pipelines Proficient in SQL, Python, AWS and other data management technologies Familiarity with version control systems like Git and orchestration tools like Airflow Ability to test and troubleshoot data platforms reliably. A track record of improving data reliability and quality Excellent communication skills and the ability ...

Lead AI Engineer

Location
Newcastle upon Tyne, England, United Kingdom
Cloud Run), AWS (Bedrock, SageMaker)* Experience building and automating AI/ML pipelines using tools such as MLflow, Kubeflow, Azure ML, Vertex Pipelines, Airflow or Google ADK* Hands-on experience with Generative and Agentic AI frameworks such as LangChain, LlamaIndex, CrewAI, Autogen, Google ADK, or similar.* Ability to design ...

Data Platform Engineer: Build Reliable Pipelines & Insights

Location
Newcastle upon Tyne, England, United Kingdom
pipelines from external vendors and market data into a central platform to support critical investment activities. You will work with SQL, Python, AWS and Airflow, testing and improving data platforms with a focus on reliability and data quality. This role offers a collaborative, fast-paced environment with opportunities ...

Data Engineer

Location
Newcastle upon Tyne, England, United Kingdom
Data Engineer – FinTech – Newcastle (Tech stack: Data Engineer, SQL, Python, AWS, Git, Airflow, Data Pipelines, Data Platforms, Programmer, Developer, Architect, Data Engineer) Our client is a trailblazer in the FinTech space, known for delivering innovative technology solutions to global financial markets. They are expanding their engineering capability in Newcastle ...

Senior Data QA & Test Manager — Cloud Data & Automation

Location
Newcastle upon Tyne, England, United Kingdom
ensure quality across data pipelines and deployments. You will collaborate with engineering, DevOps and stakeholders to embed quality across the software delivery lifecycle, leveraging Airflow, PySpark, and AWS services. #J-18808-Ljbffr ...

Data Engineering Consultant

Hiring Organisation
Electus Recruitment Solutions
Location
Newcastle upon Tyne, Tyne & Wear, United Kingdom
Employment Type
Permanent
Build data solutions for complex Defence challenges while broadening your technical experience across varied consultancy projects. Develop your skills across modern data engineering technologies and production environments. What you will need Hands-on data engineering ...

Data Engineering Consultant

Hiring Organisation
Electus Recruitment
Location
Newcastle Upon Tyne, North East, United Kingdom
Employment Type
Permanent Contract, On-site
Build data solutions for complex Defence challenges while broadening your technical experience across varied consultancy projects. Develop your skills across modern data engineering technologies and production environments. What you will need Hands-on data engineering ...

Cloud Data Engineer: Spark, Airflow & AWS | Hybrid UK

Location
Newcastle upon Tyne, England, United Kingdom
United Kingdom to design, build, and maintain data pipelines on a modern AWS-native stack. You will use Spark/PySpark for distributed processing, Airflow for orchestration, and Terraform for infrastructure as code in a hybrid work arrangement with weekly travel to Newcastle office. You will contribute to data ...