8 of 8 Contract Apache Airflow Jobs in the UK

Data Engineer: Experience with Databricks , Kafka , or Kinesis for real-time data streaming Knowledge of containerisation (Docker, ECS) and modern orchestration tools such as Airflow Familiarity with machine learning model deployment pipelines or data lakehouse architectures Data Engineer, AWS Data Engineer ...

experience in cloud-based data services. Proficiency in SQL and Python for data manipulation and transformation. Experience with modern data engineering tools, including Apache Spark, Kafka, and Airflow. Strong understanding of data modelling, schema design, and data warehousing concepts. Familiarity with data governance, privacy, and compliance frameworks (e.g., GDPR ...

performance, cost efficiency, and scalability.* Troubleshoot and resolve data pipeline issues swiftly and effectively across the data platform.* Work with orchestration tools such as Airflow, ADF, or Prefect to schedule and automate workflows.* Keep abreast of industry trends and emerging technologies in data engineering, and continuously improve your skills ...

fact/dim, conformed dimensions) Experience with PostgreSQL optimisation. Advanced Python skills ETL/ELT Pipelines: Hands-on experience building pipelines using SSIS, dbt, Airflow, or similar Strong understanding of enterprise ETL frameworks, lineage, and data quality Cloud & Infrastructure: Experience designing and supporting AWS-based analytical infrastructure Skilled ...

Automation Strategy:Architect automation solutions leveraging GitHub Actions, Terraform, Ansible, and RPA tools (eg, Appian). Build custom automation frameworks and orchestrate workflows using Airflow or Prefect. AI/ML Integration:Design and implement AI/ML solutions using frameworks such as TensorFlow, PyTorch, and Scikit-learn. An experienced ...

images to registries, and ensures secure and efficient AKS cluster deployments. Implements infrastructure as code using Terraform, including network, security, and compute resources. Supports Airflow as part of platform orchestration. Skills & Qualifications : Azure Landing Zone principles, vNet design, RBAC, networking, and hybrid connectivity. CI/CD tooling, especially GitLab ...

scalable data pipelines and contribute to digital transformation initiatives across government departments. Key Responsibilities Design, develop and maintain robust data pipelines using PostgreSQL and Airflow or Apache Spark Collaborate with frontend/backend developers using Node.js or React Implement best practices in data modelling, ETL processes and performance … support DevOps practices What We're Looking For Proven experience as a Data Engineer in complex environments Strong proficiency in PostgreSQL and either Airflow or Spark Solid understanding of Node.js or React for integration and tooling Familiarity with containerisation technologies (Docker/Kubernetes) is a plus Excellent communication ...

Senior Data Analytics Manager l Analytics l omni l tableau l looker l dbt l airflow l leadership l Start up l Stakeholder management l £600 PD l Outside IR35 l 3 months l London - hybrid We're looking for a hands-on Analytics Lead to jump … Omni Experimentation and statistical analysis experience Hands-on Python or R Good understanding of analytics pipelines and ETL Bonus points if you have Airflow or DBT experience Contract: Outside IR35 Remote with office visits as and when required in London £600 per day 3 months initial with potential ...