301 to 315 of 315 Apache Airflow Jobs in London

Designing and implementing data classification and governance-by-design Maintaining and improving a GCP/BigQuery lakehouse environment Building and supporting pipelines using Python, Airflow/Cloud Composer and dbt Identifying security vulnerabilities and supporting remediation Implementing robust CI/CD, testing and Terraform-based infrastructure Working across integrations … Deep knowledge of RBAC/IAM within cloud data environments Strong understanding of data security, governance and access controls Hands-on experience with Python, Airflow and dbt Experience with Terraform and CI/CD Knowledge of Kubernetes Exposure to AWS alongside GCP Strong stakeholder management and the ability ...

migrate data sets into their AWS Snowflake platform. Designing and implementing dbt models that power clean, consistent metrics. Buidl out orchestartion pipelines using Airflow Creating clear documentation for dashboards, metrics, and models. Ensuring optimal performance and cost efficiency across Snowflake Supporting a stakeholder-first approach to data usability … access. KEY SKILLS AND REQUIREMENTS Extensive experience operating within Snowflake environments Airflow for data orchestration. Proficiency in SQL and dbt, with a strong understanding of data modeling best practices. Strong communication skills with the ability to translate complex needs into elegant data solutions. Focus on usability, documentation, and data ...

within the new architecture. You'll work across: Migrating legacy pipelines and workloads into Snowflake Building and refactoring pipelines using Python Developing orchestration through Airflow/MWAA Infrastructure and deployment using Terraform and Docker Supporting transformation and modelling using dbt Working across both legacy and modern AWS data environments … looking for a broad, hands-on Data Engineer who is comfortable working across data engineering, software engineering and infrastructure. Core experience: Python Airflow/MWAA Snowflake Terraform AWS Desirable experience: dbt Docker Redshift R Data platform migrations or modernisation programmes The ideal candidate will have worked within complex ...

Company DescriptionWise is a global technology company, building the best way to move and manage the world's money. Min fees. Max ease. Full speed. Whether people and businesses are sending money to another country ...

Inside IR35 Location: London - Hybrid, 3 days per week onsite Duration: 6 months The role will focus on GCP, BigQuery, Python, Airflow/Cloud Composer, dbt, Terraform and CI/CD, working closely with architects, engineers, product and governance teams to deliver secure, scalable data solutions. Key experience … BigQuery Python, Airflow & dbt Terraform & CI/CD Data platforms/lakehouse environments Kubernetes AWS alongside GCP Strong stakeholder management If this sounds relevant to you, please drop me a message or send your CV Thanks, Callum ...

ship confidently. Key Responsibilities Own and evolve the core AI platform infrastructure supporting production ML services. Build and maintain orchestration pipelines using Dagster , Airflow or similar tooling. Deploy and manage workloads using Kubernetes and cloud-native infrastructure. Develop platform tooling and services in Python . Implement and maintain Terraform … + 10% bonus Working Model: Hybrid, 1-2 days per week onsite in Central London Tech Stack: Python, Azure, Kubernetes, Terraform, Dagster, Airflow, ML Infrastructure, LLMs, Vector Databases Visa Sponsorship: Exceptional candidates only Interested? Please apply below. ...

Foundry or AI Search, with Docker and Kubernetes Understanding of schema validation frameworks (e.g., JSON Schema, Pydantic) and MLOps tools such as MLflow or Airflow Strong communication ability to explain trade-offs around cost, latency and accuracy to technical and non-technical audiences Nice to have Experience using Azure … agent and tool interoperability Hands-on work with vector databases like Pinecone, Weaviate, Qdrant or pgvector Familiarity with distributed systems, workflow engines (Temporal, Airflow or Dagster) and event-driven architectures Experience with open-source LLMs or Small Language Models for custom deployments Knowledge of AI safety and governance: guardrails ...

seeking a Lead Data Engineer to own a business domain within a modern Snowflake, Airflow, and dbt data platform, combining hands-on technical leadership with team coordination in Greater London. You will shape how data products are designed, built, and improved, ensuring stable platform operations, high data quality ...

experienced Full Stack Data Engineer to join our Customer Data Science team. You will design, build and maintain robust data pipelines, orchestration with Airflow, and Databricks-based solutions to empower data scientists with reliable data foundations and scalable platforms. You will collaborate across product and delivery partners, contribute ...

apart) Experience using Google Cloud Platform and/or Google Cloud Engineer qualifications (could set you apart) Experience of PySpark, BigQuery, Git, DataFlow, DataProc, Airflow, or equivalents (could set you apart) Core Competencies Demonstrates strong expertise in data analytics, with proficiency in SQL and Python, while effectively managing stakeholder … Experience Stakeholder Relationship Management Google Cloud Platform Experience ATS Optimization Keywords Hard Skills Data Analytics SQL Python Analytics Techniques PySpark BigQuery Git DataFlow DataProc Airflow Soft Skills Excellent Communication Skills User Enablement Problem-Solving Certifications & Qualifications Google Cloud Engineer Qualifications Industry Keywords Credit Bureau Data D&A Governance Compliance ...

design, API development, and data modelling for production machine learning systems. Build and operate production solutions using technologies such as Python, TensorFlow, PyTorch, Redis, Airflow, Docker, Kubernetes, and cloud-native infrastructure. Design and deploy scalable batch and real-time ML pipelines supporting customer-facing applications. Develop and operationalise … designing, building, or scaling RAG systems. Experience in search, ranking, recommendations, personalisation, content intelligence, moderation, NLP, computer vision, or related AI domains. Experience with Airflow or comparable workflow orchestration platforms. Experience with cloud-native environments and container technologies, including Docker and Kubernetes. Experience developing model evaluation frameworks ...

design, API development, and data modelling for production machine learning systems. Build and operate production solutions using technologies such as Python, TensorFlow, PyTorch, Redis, Airflow, Docker, Kubernetes, and cloud-native infrastructure. Design and deploy scalable batch and real-time ML pipelines supporting customer-facing applications. Develop and operationalise … designing, building, or scaling RAG systems. Experience in search, ranking, recommendations, personalisation, content intelligence, moderation, NLP, computer vision, or related AI domains. Experience with Airflow or comparable workflow orchestration platforms. Experience with cloud-native environments and container technologies, including Docker and Kubernetes. Experience developing model evaluation frameworks ...

product, how ready are they for Fin. Making the data usable. Landing everything in well-modelled, well-tested dbt models in Snowflake orchestrated in Airflow, and syncing it out to Salesforce, Marketo, Clay and the rest of the GTM stack. Owning quality and trust. Instrumenting your pipelines with tests … rather than only technical ones. Experience with the modern data stack: dbt, a cloud warehouse (we use Snowflake), and a DAG orchestrator (we use Airflow).Experience building with LLMs in production: prompt design and evaluation, tool/function calling, web search and crawling, cost and latency control. Experience with ...

SENIOR SCALA ENGINEER £590 per day via Umbrella 6-12 month contract Stratford, London – hybrid remote working SC clearance required ABOUT THE CLIENT Our client is a major UK public sector organisation delivering digital services ...

design and develop data foundations that enable data science and analytics products at scale. You will build scalable pipelines and orchestration workflows using Airflow and Databricks, taking ownership of complex technical problems while collaborating closely with Data Scientists and product teams to deliver production-ready solutions. #J-18808-Ljbffr ...