26 to 50 of 51 Apache Airflow Jobs in London

necessary infrastructure, resources, and interfaces to enable data loading and LLM workflows. Use Python/Java and large-scale data workflow orchestration platforms e.g. Airflow to construct software artifacts for ETL, interfacing with diverse data formats and storage technologies, and incorporate them into robust data workflows and dynamic systems ...

Data Engineer Location: Remote – with requirement to visit London based office twice a month Hours: 37.5 Hours a week (Monday – Friday 9:00am – 17:00pm) Salary Range: £40,000 - £80,000 per annum (Depending on ...

Nice to have Consulting or client-facing delivery experience Experience evaluating and monitoring LLM systems (testing, guardrails, cost control) MLOps tools such as MLflow, Airflow or CI/CD pipelines We Are Dcoded is acting as an employment agency in relation to this permanent vacancy. ...

Data Engineer within GCP. Experience building production-grade data pipelines and platforms. Expertise with technologies such as BigQuery, Dataflow, Cloud Composer/Airflow, Pub/Sub and Cloud Storage. Strong SQL and data engineering fundamentals. An engineering mindset and a passion for solving problems. Confidence working independently while remaining ...

operate across engineering, product, and business functions Desirable Experience LLM applications and document-processing platforms Retrieval-Augmented Generation (RAG) React and Next.js Snowflake Airflow Data engineering and ETL pipelines Kubernetes and cloud-native infrastructure Supply chain, procurement, or operational systems Ideal Background Suitable candidates may come from: Product ...

Python, APIs, and distributed systems. Good understanding of MLOps tooling, including CI/CD, monitoring, and pipeline management. Experience with tools such as MLflow, Airflow, Evidently, DVC, Docker, or Kubernetes. Experience working within AWS, GCP, or Azure environments. Previous mentoring or leadership experience with an interest in developing management ...

LLMs, or automation technologies to improve business processes. Strong understanding of modern analytics and data platforms. Experience with the following would be beneficial: dbt, Airflow and Git. Looker or similar BI tools. Python for analysis or automation. Experience within fintech, financial services, or another regulated industry. What They Offer ...

field Production ML engineering excellence – Deep understanding of ML operations, including containerization (Docker, Kubernetes/AWS EKS), cloud platforms (AWS/Azure), workflow orchestration (Airflow), automated testing for ML systems, and API development for model deployment Technical leadership and influence – Track record of mentoring and coaching engineers, driving ...

Proven background as a Machine Learning Engineer Programming skills: Strong in SQL and Python (Pandas, Scikit-learn, Jupyter, Matplotlib) Data transformation & manipulation : experience with Airflow, DBT and Kubeflow Cloud: Experience with GCP and Vertex AI (developing ML services) Expertise: Solid understanding of computer science fundamentals and time-series forecasting ...

improve processes or analytical workflows. Experience within financial services, fintech or another regulated environment is highly desirable. Python experience is preferred. Experience with dbt, Airflow and Git would be advantageous. Experience with Looker, Tableau or another enterprise BI platform. Background in operational analytics, workforce management, customer service ...

narratives Entrepreneurial mentality: You can take work beyond the analysis and drive outcomes. Useful additional experience: Experience in Fintech domain Knowledge of utilities like Airflow/Github/DBT Experience with user-facing products and data Please note: we are not able to offer visa sponsorship for this role ...

working on the most impactful opportunities NICE TO HAVE BUT NOT ESSENTIAL Experience delivering high quality data and self-serve analytics using tools like Airflow, dbt and Looker. Practically used + applied AI/machine learning techniques and built predictive models to get deeper insights Knowledge of the FinTech ...

things done. Good to have: Experience in Financial Crime and/or Customer Onboarding domain Knowledge of the fintech ecosystem Knowledge of utilities like Airflow/Github/DBT Experience with user-facing products and data Additional Information What do we offer: Salary: £75,000 - £115,000 Company Restricted ...

Docker and Kubernetes experience, including deployment and management Previous experience working within air-gapped environments Strong understanding of APIs and microservices Experience with Prefect, Airflow or similar data pipeline/orchestration technologies Experience configuring and integrating workflow tooling such as Jira Experience with database and storage technologies such ...

deploying, monitoring and maintaining ML systems at scale Ability to balance hands-on engineering with people management responsibilities Experience with AWS, Snowflake, MLflow, Airflow or similar tooling would be advantageous SALARY AND BENEFITS £110,000 - £125,000 base salary Annual bonus Hybrid working model Private medical insurance Enhanced family ...

Engineering, or MLOps environments Experience building, deploying, and supporting machine learning solutions at scale Experience working with AWS and ML tooling such as MLflow, Airflow, Metaflow, or Snowflake Ability to balance technical leadership, strategic thinking, and hands-on engineering contribution SALARY AND BENEFITS Up to £125,000 base salary ...

clear, performant, and reliable queries to transform large complex datasets) You have experience building and owning automated data pipelines with tools like DBT/Airflow Experimentation & Statistics: Experience running A/B tests and analysing the results to drive product decisions Ownership: You enjoy working independently in a fast ...

experience with cloud platforms (AWS, Azure, GCP) Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise-scale applications. You have team lead ...

with cloud platforms (AWS, Azure, GCP) Well-versed in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Strong collaboration skills with the ability to work across engineering, research, and product teams across multiple time zones. You have external ...

with cloud platforms (AWS, Azure, GCP) Well-versed in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Strong collaboration skills with the ability to work across engineering, research, and product teams across multiple time zones. You have external ...

with cloud platforms (AWS, Azure, GCP) Well versed in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise-scale applications. You have team lead ...

with cloud platforms (AWS, Azure, GCP) Well versed in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise-scale applications. You have team lead ...

role). Cloud Infrastructure & Data Pipelines: Build with AWS and Azure services to construct ETL workflows and dynamic systems using orchestration platforms like Apache Airflow. Production Operations: Support production applications, maintain SLAs, and create continuous evaluation metrics for ML solution performance. Qualifications & Skills 2-5 years' hands-on software … Hands-on experience building GenAI applications, LLM workflows, and data pipelines. Cloud experience across AWS or Azure ecosystems along with data orchestration tools (e.g., Airflow). Practical understanding of AI safety, prompt injection handling, and PII/MNPI compliance guardrails. If you have 2-5 years' experience ...

streaming pipelines and deliver scalable Databricks solutions using Delta Live Tables, Workflows, Unity Catalog, Python, PySpark, Terraform and Databricks Asset Bundles. Key requirements: Advanced Apache Spark and Spark SQL optimisation Production Spark Structured Streaming experience Deep Databricks platform knowledge Strong Python and PySpark engineering capability Delta Live Tables, Workflows … Databricks Asset Bundles CI/CD and GitHub Actions Ability to work autonomously in a fast-moving environment Experience with Databricks Apps, Lakebase, Airflow, Azure Data Factory, monitoring platforms or financial services would be beneficial. Location: London Rate: £800£900 per day IR35: Inside IR35 ...

scalable APIs (FastAPI, etc.) for model deployment, implement MLOps pipelines, leverage cloud platforms (AWS/Azure) to optimize AI infrastructure, and use orchestration tools (Airflow) for complex ML workflows Champion ML governance and operational excellence – Ensure adherence to AI/ML governance guidelines, monitor model performance and SLAs, optimize … excellence – Strong understanding of MLOps, containerization (Docker, Kubernetes/AWS EKS), cloud platforms (AWS/Azure including Bedrock, SageMaker, Azure AI Search), workflow orchestration (Airflow), and API development for ML systems Software development fundamentals – Deep understanding of automated testing, source version control, code optimization, software architecture, and building scalable ...