6 of 6 Apache Airflow Jobs in the North West

Troubleshooting: Oversee pipeline performance, address issues promptly, and maintain comprehensive data documentation. What Youll Bring Technical Expertise: Proficiency in Python and SQL; experience with data processing frameworks such as Airflow, Spark, or TensorFlow. Data Engineering Fundamentals: Strong understanding of data architecture, data modelling, and scalable data solutions. Backend Development: Willingness to develop proficiency in backend technologies (e.g., Python with … Django) to support data pipeline integrations. Cloud Platforms: Familiarity with AWS or Azure, including services like Apache Airflow, Terraform, or SageMaker. Data Quality Management: Experience with data versioning and quality assurance practices. Automation and CI/CD: Knowledge of build and deployment automation processes. Experience within MLOps A 1st class Data degree from one of the UKs top More ❯

in a commercial setting. Solid understanding of distributed systems (e.g. Hadoop, AWS, Kafka). Experience with SQL/NoSQL databases (e.g. PostgreSQL, Cassandra). Familiarity with orchestration tools (e.g. Airflow, Luigi) and cloud platforms (e.g. AWS, GCP). Passion for solving complex problems and mentoring others. Package: Salary from £(phone number removed) depending on experience Remote-first with flexible More ❯

As a Senior Data Engineer you will take ownership of the data platform, optimising it for scalability to ensure successful client onboarding. You'll use modern tools (such as Airflow, Prefect, Dagster or AWS Step Functions) for ETL design and orchestration, work on transformation logic to clean, validate and enrich data (including handling missing values, standardising formats and duplication More ❯

Bonus skills Experience in any of the following is a plus: Python, Scala, or data processing frameworks Event-driven or distributed system architectures Big data tools (e.g., Hadoop, HDFS, Airflow) Linux and containerisation Why join? This is an exciting opportunity to be at the forefront of large-scale, cloud-first transformation efforts. You'll help shape platforms that power More ❯

Bonus skills Experience in any of the following is a plus: Python, Scala, or data processing frameworks Event-driven or distributed system architectures Big data tools (e.g., Hadoop, HDFS, Airflow) Linux and containerisation Why join? This is an exciting opportunity to be at the forefront of large-scale, cloud-first transformation efforts. You'll help shape platforms that power More ❯

Responsibilities Architect and implement cloud-native data platforms using Databricks, Snowflake, and core cloud services (AWS/Azure/GCP) Build and maintain robust data ingestion and orchestration pipelines (Airflow, dbt, Fivetran, SnapLogic) Skills Devops databrick Job Title: Platform Engineer Location: London, UK Job Type: Contract Trading as TEKsystems. Allegis Group Limited, Maxis 2, Western Road, Bracknell, RG12 1RT More ❯