76 to 80 of 80 Apache Airflow Jobs in the UK

role). Cloud Infrastructure & Data Pipelines: Build with AWS and Azure services to construct ETL workflows and dynamic systems using orchestration platforms like Apache Airflow. Production Operations: Support production applications, maintain SLAs, and create continuous evaluation metrics for ML solution performance. Qualifications & Skills 2-5 years' hands-on software … Hands-on experience building GenAI applications, LLM workflows, and data pipelines. Cloud experience across AWS or Azure ecosystems along with data orchestration tools (e.g., Airflow). Practical understanding of AI safety, prompt injection handling, and PII/MNPI compliance guardrails. If you have 2-5 years' experience ...

streaming pipelines and deliver scalable Databricks solutions using Delta Live Tables, Workflows, Unity Catalog, Python, PySpark, Terraform and Databricks Asset Bundles. Key requirements: Advanced Apache Spark and Spark SQL optimisation Production Spark Structured Streaming experience Deep Databricks platform knowledge Strong Python and PySpark engineering capability Delta Live Tables, Workflows … Databricks Asset Bundles CI/CD and GitHub Actions Ability to work autonomously in a fast-moving environment Experience with Databricks Apps, Lakebase, Airflow, Azure Data Factory, monitoring platforms or financial services would be beneficial. Location: London Rate: £800£900 per day IR35: Inside IR35 ...

globally recognised product and data technology company Data pipeline, data warehousing, API layer and big data infrastructure at enterprise scale Java, Python, AWS, PostgreSQL, Airflow, Redshift and more across a modern data stack Hybrid working Salary up to £85,000 Why This Organisation Our client connects thousands of brands … with a public cloud provider, ideally AWS Experience with ETL, data modelling and large-scale data warehousing solutions Experience with scheduling services such as Airflow or Oozie Experience with modern build tools such as Maven, Jenkins and GitHub Prior technical leadership and/or mentorship experience Strong analytical, technical ...

scalable APIs (FastAPI, etc.) for model deployment, implement MLOps pipelines, leverage cloud platforms (AWS/Azure) to optimize AI infrastructure, and use orchestration tools (Airflow) for complex ML workflows Champion ML governance and operational excellence – Ensure adherence to AI/ML governance guidelines, monitor model performance and SLAs, optimize … excellence – Strong understanding of MLOps, containerization (Docker, Kubernetes/AWS EKS), cloud platforms (AWS/Azure including Bedrock, SageMaker, Azure AI Search), workflow orchestration (Airflow), and API development for ML systems Software development fundamentals – Deep understanding of automated testing, source version control, code optimization, software architecture, and building scalable ...

migrate data sets into their AWS Snowflake platform. Designing and implementing dbt models that power clean, consistent metrics. Buidl out orchestartion pipelines using Airflow Creating clear documentation for dashboards, metrics, and models. Ensuring optimal performance and cost efficiency across Snowflake Supporting a stakeholder-first approach to data usability … access. KEY SKILLS AND REQUIREMENTS Extensive experience operating within Snowflake environments Airflow for data orchestration. Proficiency in SQL and dbt, with a strong understanding of data modeling best practices. Strong communication skills with the ability to translate complex needs into elegant data solutions. Focus on usability, documentation, and data ...