2 of 2 Temporary Apache Airflow Jobs in the South East

Data Engineer — AWS, Python & Airflow Rate: £550 per day, outside IR35 Location: Remote Duration: Initial 6-month contract, with a further 12-month extension planned Clearance: Active SC clearance, used within the last 12 months Nationality: Sole British nationals only; dual citizenship is not permitted The opportunity … urgently looking for an experienced Data Engineer with strong AWS, Python and Apache Airflow skills to join a programme on an initial six-month contract. You'll help build and maintain reliable data pipelines, develop cloud-based data solutions and make data available for downstream analytics and programme ...

streaming pipelines and deliver scalable Databricks solutions using Delta Live Tables, Workflows, Unity Catalog, Python, PySpark, Terraform and Databricks Asset Bundles. Key requirements: Advanced Apache Spark and Spark SQL optimisation Production Spark Structured Streaming experience Deep Databricks platform knowledge Strong Python and PySpark engineering capability Delta Live Tables, Workflows … Databricks Asset Bundles CI/CD and GitHub Actions Ability to work autonomously in a fast-moving environment Experience with Databricks Apps, Lakebase, Airflow, Azure Data Factory, monitoring platforms or financial services would be beneficial. Location: London Rate: £800–£900 per day IR35: Inside IR35 ...