12 of 12 Apache Airflow Jobs in Tyne and Wear

Apache Spark Python AWS Cloud Data Pipelines A hands-on data engineering role within a large-scale cloud data programme, responsible for building, maintaining, and troubleshooting data pipelines using Apache Spark, PySpark, Apache Airflow, and a broad suite of AWS services. You will apply strong analytical … complex, cloud-based data programme - designing, building, and maintaining data pipelines that process large volumes of data across a modern AWS-native stack. Using Apache Spark and PySpark for distributed data processing, Apache Airflow for orchestration, and a range of AWS services for storage, compute, and analytics ...

lead quality assurance and testing activities within a large-scale cloud data engineering programme operating across a modern AWS-native technology ecosystem, including Apache Airflow, Amazon Athena, AWS Glue, S3, EMR, DynamoDB, and related cloud services. This role combines hands-on technical leadership with test strategy ownership . … reconciliation, and performance under load Oversee PySpark-based data validation and interrogation activities on AWS EMR Support testing and monitoring of workflows orchestrated through Apache Airflow Drive root cause analysis for production data issues and platform defects Risk Management & Reporting Identify, assess, and communicate quality risks across releases ...

Data Engineer - Newcastle upon Tyne (Hybrid- 3 days onsite) - SQL, Airflow, Python, Power BI - Future Microsoft Fabric Transformation Project - Up to £55,000 Are you a Data Engineer looking for an opportunity where you can influence the direction of a growing data platform rather than simply maintain existing processes … data capabilities and embarking on an exciting data transformation journey. This role offers the chance to work hands-on with Azure SQL, Airflow, Python and Power BI while playing a key role in the organisation's future migration to Microsoft Fabric. You'll join a small, highly visible team ...

Glue, ECR, EC2, EMR, DynamoDB, Lake Formation Experience with Infrastructure as Code (Terraform) Proficiency in Python, SQL, and familiarity with PySpark Experience with Apache Spark and data processing frameworks Hands-on experience with Apache Airflow for workflow orchestration Experience using Jupyter Notebooks and/or Amazon Athena ...

multiple data sources Distributed computing for data intensive work such as Spark and Databricks Cloud platforms including AWS, Azure and GCP Orchestration tools like Airflow Modern DevOps practices including version control, CI/CD, and infrastructure as code using Terraform or Kubernetes Experience building scalable backend applications Understanding ...

with large datasets. Hands-on experience with AWS services and cloud-based data platforms. Experience building and maintaining production-grade data pipelines. Experience using Airflow for workflow orchestration. Strong version control experience using Git. Understanding of data modelling principles and database design. Excellent problem-solving and analytical skills. Strong ...

Python Strong SQL skills and experience working with data platforms Experience with AWS or other cloud platforms Familiarity with data orchestration tools such as Airflow Experience using version control systems such as Git Understanding of data quality, testing, and reliability principles Strong communication skills and ability to work collaboratively ...

working as a Data Engineer Strong understanding of data engineering principles, ETL processes and data warehousing concepts Experience using workflow orchestration tools such as Airflow to schedule, monitor and manage data pipelines Experience working with at least one major cloud data platform, preferably Azure Strong data modelling skills, including ...

pipelines Developing solutions using Python and SQL Working with cloud platforms including AWS, Azure, or GCP Using technologies such as Spark, Databricks, and Airflow Improving data quality, reliability, and performance Applying modern engineering practices including automation, testing, and CI/CD What theyre looking for: Strong programming skills ...

Looking For Strong experience designing and building scalable data pipelines Proficiency in SQL, Python, Databricks or Azure Experience with tools such as Git and Airflow Proven ability to test, troubleshoot and improve data platforms Experience delivering high-quality, reliable data solutions Strong communication skills and ability to work ...

building data pipelines Proficient in SQL, Python, AWS and other data management technologies Familiarity with version control systems like Git and orchestration tools like Airflow Ability to test and troubleshoot data platforms reliably. A track record of improving data reliability and quality Excellent communication skills and the ability ...

involved in a modern data transformation programme, including a planned migration to Microsoft Fabric. Key Responsibilities Develop and maintain data pipelines using Apache Airflow. Design and optimise SQL-based data solutions. Build and enhance Power BI reports and dashboards. Work closely with stakeholders to gather requirements and deliver insights. … Support ongoing improvements to the data platform and reporting environment. Contribute to the organisation's future migration to Microsoft Fabric. Required Skills Experience with Apache Airflow. Strong Azure SQL skills. Power BI development and data modelling experience. Good understanding of ETL/ELT processes and data warehousing concepts. Strong ...