51 to 75 of 114 Apache Airflow Jobs in the UK

/lending/risk/portfolio datasets Time series familiarity (trend/seasonality, cohorts over time, monitoring) Experience with data tools such as dbt, Airflow, Snowflake/BigQuery/Databricks (or similar) Experience creating automated data quality frameworks or reconciliation checks Benefits: £45,000 – £55,000 salary Hybrid working ...

notebooks for analysis dbt and Databricks data platform with Delta Lake Lightdash as our BI tool and semantic layer Streamlit for interactive data applications Airflow for orchestration Kubernetes for application deployment CI/CD with GitHub and CircleCI Infrastructure on AWS, deployed with Terraform/Spacelift Why else ...

expand their Devops team (multiple roles). Key requirements: Strong experience with AWS services and infrastructure as code using Terraform Data engineering expertise using Apache Spark and Python, including development in Jupyter Notebooks Workflow orchestration and containerisation experience with Apache Airflow and Docker Version control ...

prompt engineering skills and the ability to critically evaluate AI-generated code for correctness, security, and financial accuracy Desirable, but no essential: Experience with Apache Airflow or similar workflow schedulers REST or GraphQL API design experience Knowledge of fixed income, FX, or derivatives products and associated ...

prompt engineering skills and the ability to critically evaluate AI-generated code for correctness, security, and financial accuracy Desirable, but no essential: Experience with Apache Airflow or similar workflow schedulers REST or GraphQL API design experience Knowledge of fixed income, FX, or derivatives products and associated ...

reporting alongside project work Strong communication skills, particularly around handover and knowledge transfer Technology in use: Azure SQL Databases Azure Ubuntu Virtual Machines Apache Airflow Power BI Python REST & SOAP APIs To apply for this role please submit your CV or contact David Airey on or at . ...

responsibilities Own, assess, improve, or rebuild existing ETL/ELT pipelines Build reliable data workflows using Python Work with orchestration tools such as Airflow or similar Improve data quality, validation, lineage, and troubleshooting Collaborate with consultants and non-technical stakeholders Help translate messy business/client data into structured ...

data services (e.g. S3, Glue, Redshift, Lambda, Step Functions, Kinesis) and infrastructure-as-code (Terraform or CDK) Experience with workflow orchestration tools such as Airflow or similar Ability to design scalable architectures, make pragmatic trade-offs, and communicate effectively with both technical and non-technical stakeholders Processing Your Data ...

familiarity with common AI/ML libraries (scikit-learn, PyTorch, HuggingFace, OpenAI API). Bonus Points Experience with data engineering tools (SQL, pandas, dbt, Airflow). Exposure to LLMs or generative AI in a practical context. GitHub profile demonstrating collaborative projects and consistent contributions. Who we are: Here ...

data stack including a mix of structured and unstructured data sources, orchestration tooling, and distributed storage. RDS Postgres, MongoDB, AWS Athena, Parquet, AWS Glue, Airflow, Python, Docker, S3, GraphQL, REST. You won't know all of it, you'll be strong in your core area and curious about ...

technical field Experience with Infrastructure as Code (Terraform, OpenTofu) DataOps and CI/CD pipeline design - especially with dbt or SQLMesh Experience with Kubernetes, Airflow or Prefect Experience deploying on-premises infrastructure Exposure to geospatial, NLP, image processing, signals or financial data Experience working in or alongside blended analyst ...

Looking For Strong experience with SAS 9.x and SAS Viya Solid background in data engineering, ETL, and data modelling Experience with workflow orchestration (e.g., Airflow or similar) Understanding of performance optimisation and scalable systems Strong communication and stakeholder engagement skills Why Join? Work on meaningful, high-impact public sector ...

engineering, model evaluation, and experiment design (A/B testing, holdout strategies, stratification). Experience developing production-quality data pipelines and automated workflows using Airflow or similar orchestration tools. Practical familiarity with graph databases and/or graph frameworks (Neo4j, AWS Neptune, GraphFrames, DGL, PyTorch Geometric) and graph algorithms ...

Data Engineer in secure or government environments Strong skills in Python, SQL, and data pipeline development Experience with data integration tools (e.g. Airflow, NiFi, Azure Data Factory, AWS Glue, or similar) Hands-on experience with cloud platforms (AWS, Azure, or GCP - secure tenants preferred) Knowledge of data modelling, data … environments Strong understanding of data security, governance, and access controls Desirable Experience Experience working within UK defence, intelligence, or national security programmes Exposure to Apache Kafka, Spark, Hadoop, or similar technologies Experience supporting data science or advanced analytics use cases Background working with classified datasets Contract Details Apply ...

What they're looking for Strong Python + data engineering fundamentals Experience building scalable data pipelines/platforms Exposure to distributed systems (Kafka, Spark, Airflow etc.) Interest in AI/ML systems is a plus ...

+ 20% Bonus Location : Central London (Hybrid – 3 days per week) Tech: Python | Java | SQL | Azure | Spark | Flink | Kubernetes | Terraform | CI/CD | Airflow We’re working with one of the UK’s leading enterprise businesses as it continues to invest heavily in its Cyber Data & Platform capability. This ...

work independently and help drive things forward Nice to have: Time-series, high-volume or event-driven data experience Orchestration exposure such as Airflow, Dagster, Prefect, Temporal or similar Finance or market data experience Details: Permanent role London/hybrid Small, technically strong team Salary flexible depending ...

GitHub Copilot) with significant examples of delivery improvement AWS (S3, Lambda, EC2, Glue), Snowflake, Git, CI/CD, Datadog, MS SQL Server, REST, GraphQL, Airflow (as many as possible) Degree educated or higher in a relevant technical discipline from a leading university This is a £650-700/ ...

Python, and Ansible Familiarity with containers (Docker, Kubernetes, LXC) Experience with monitoring tools and SQL databases Exposure to big data systems (e.g., Spark, HDFS, Airflow) Summary A great opportunity for someone who enjoys solving complex infrastructure challenges, automating systems, and working closely with engineering teams. Spectrum IT Recruitment (South ...

Python, and Ansible Familiarity with containers (Docker, Kubernetes, LXC) Experience with monitoring tools and SQL databases Exposure to big data systems (e.g., Spark, HDFS, Airflow) Summary A great opportunity for someone who enjoys solving complex infrastructure challenges, automating systems, and working closely with engineering teams. Spectrum IT Recruitment (South ...

background as a Machine Learning Engineer. Technical Skills: Strong in SQL and Python (Pandas, Scikit-learn, Jupyter, Matplotlib). Data transformation & manipulation: experience with Airflow, DBT and Kubeflow Cloud: Experience with GCP and Vertex AI (developing ML services). Expertise: Solid understanding of computer science fundamentals and time-series ...

background as a Machine Learning Engineer. Technical Skills: Strong in SQL and Python (Pandas, Scikit-learn, Jupyter, Matplotlib). Data transformation & manipulation : experience with Airflow, DBT and Kubeflow Cloud: Experience with GCP and Vertex AI (developing ML services). Expertise: Solid understanding of computer science fundamentals and time-series ...

Data Engineer - FinTech - Newcastle (Tech stack: Data Engineer, SQL, Python, AWS, Git, Airflow, Data Pipelines, Data Platforms, Programmer, Developer, Architect, Data Engineer) Our client is a trailblazer in the FinTech space, known for delivering innovative technology solutions to global financial markets. They are expanding their engineering capability in Newcastle ...

APIs can be exposed to LLM-based agents. Experience with search relevance & recommendation systems — ranking algorithms, semantic search, personalisation. Hands-on with Snowflake, Databricks, Airflow, Kafka . Why Join Us Work on firm-wide platforms used by thousands of data scientists, ML engineers, and analysts across JPMC Shape ...

patient outcomes. Working across both on-premises and cloud environments, the postholder will utilise a range of tools and technologies including T-SQL, Python, Airflow and Google Cloud Platform. The postholder will also contribute to data engineering activities, support the development of junior staff, and ensure that all outputs ...