201 to 224 of 224 Apache Airflow Jobs in London

Senior Data Engineer Hybrid working (3 days per week onsite in London) 6 Month contract initially, with good scope for extension Market rates (Umbrella-PAYE) One of our blue chip clients is looking for a Senior Data Engineer to join More ❯

Lead Data Engineer - Snowflake, DBT, Airflow - London - Up to £100k I'm working with a key client of ours here at TRG who are looking to grow out their Data & Analytics function. My client are globally renowned for being a leader within their relative field. Whilst they are a … So they offer very flexible working arrangements through both WFH options and flexi working hours. Experience required... Expert in Snowflake Strong DBT experience Strong Airflow experience Expert knowledge and understanding of Data Warehousing Strong AWS experience This is a great opportunity to join outstanding organisation who pride themselves on … touch ASAP. Send across your CV to (url removed) or alternatively, give me a call on (phone number removed). Keywords: Snowflake, DBT, SQL, Airflow, AWS, Engineer, DWH, Data Warehouse, Data Warehousing, Architecture, London More ❯

robust version control Setting up monitoring and alerting frameworks to track model drift, data quality, and inference health Leveraging orchestration tools such as Dagster, Airflow, or Prefect to manage and scale ML workflows Supporting ongoing infrastructure migration or optimisation initiatives (e.g. improving cost efficiency, latency, or reliability) Partnering with … experience deploying ML models into production environments, including both batch and real-time/streaming contexts Proficiency working with distributed computing frameworks such as Apache Spark , Dask, or similar Experience with cloud-native ML deployment , particularly on AWS , using services like ECS, EKS, Fargate, Lambda, S3, and more Familiarity … with orchestration and workflow scheduling tools such as Dagster , Airflow , or Prefect Knowledge of CI/CD best practices and tools (e.g. GitHub Actions, Jenkins, CodePipeline) Exposure to monitoring and observability tools for ML systems (e.g. Prometheus, Grafana, DataDog, WhyLabs, Evidently, etc.) Experience in building parallelised or distributed model More ❯

technology infrastructure driving the ecosystem that enables the business to make smarter decisions with data. Our primary technology is Google Cloud Platform supported by Airflow and dbt. As technical lead on the team you'll be working closely with architects, product managers and stakeholders, helping to provide technical knowledge … ecosystem, including maintaining a lakehouse on Google Cloud Platform with BigQuery at its core Deliver operations and orchestration for all things data, specifically on Airflow, Cloud Composer Support integrations with key platforms such as Fivertan, Tableau, and Alation Enhance our architecture, align it with our infosec, multi-cloud, and … BigQuery preferred. Design and deliver solutions on the technologies that drive data at the Guardian. This looks like: Google Cloud Platform: BigQuery, Kubernetes Python, Airflow, & DBT CI/CD & Terraform Nice-to-have : Spark & Scala on DataProc Demonstrated knowledge and experience of key operational concerns, including: Security & Networks Site More ❯

Title: Data Scientist Salary: £65,000-£75,000 + Benefits Location: West London - Hybrid (3 days p/w in-office) Tech: AWS, Snowflake, Airflow, DBT The Company: Immersum are supporting the growth leading PropTech company on a mission to revolutionise how the property sector understands people, places, and … ML models Strong analytical background with applied stats, EDA, and model validation techniques Confidence working with structured data pipelines and modern tooling (AWS, Snowflake, Airflow, DBT) Curiosity for emerging techniques and an eagerness to learn and innovate Excellent communication skills, especially when simplifying complex findings for non-technical teams More ❯

Title: Data Scientist Salary: £65,000-£75,000 + Benefits Location: West London - Hybrid (3 days p/w in-office) Tech: AWS, Snowflake, Airflow, DBT The Company: Immersum are supporting the growth leading PropTech company on a mission to revolutionise how the property sector understands people, places, and … ML models Strong analytical background with applied stats, EDA, and model validation techniques Confidence working with structured data pipelines and modern tooling (AWS, Snowflake, Airflow, DBT) Curiosity for emerging techniques and an eagerness to learn and innovate Excellent communication skills, especially when simplifying complex findings for non-technical teams More ❯

a modern tech stack; you'll mainly be using Python, PySpark and AWS services but will also gain skills with AWS Glue, AWS Lambda, Airflow, CI/CD and Github. You'll be working with complex data centric systems that require high levels of security to protect the identity … Data Engineer Experience with any of the following would be great but you can pick it them up on the job too: AWS Lambda, Airflow, CI/CD, Github You must be a British citizen or already hold the right to work in Dubai What's in it for More ❯

a modern tech stack; you'll mainly be using Python, PySpark and AWS services but will also gain skills with AWS Glue, AWS Lambda, Airflow, CI/CD and Github. You'll be working with complex data centric systems that require high levels of security to protect the identity … Data Engineer Experience with any of the following would be great but you can pick it them up on the job too: AWS Lambda, Airflow, CI/CD, Github You must be a British citizen or already hold the right to work in Dubai What's in it for More ❯

the setup; Sharing, enhancing and upskilling team members on available tools and best practices. What you'll need Strong aptitude with SQL, Python and Airflow; Experience in Kubernetes, Docker, Django, Spark and related monitoring tools for DevOps a big plus (e.g. Grafana, Prometheus); Experience with dbt for pipeline modeling … based pipelines built with dbt on Databricks Analysis via Python Jupyter notebooks Pyspark in Databricks workflows for heavy lifting Streamlit and Python for dashboarding Airflow DAGs with Python for ETL running on Kubernetes and Docker Django for custom app/database development Kubernetes for container management, with Grafana/ More ❯

/Tools we use: Python, Azure (Virtual Machines, Azure Web Apps, Cloud Storage, Azure ML), Anaconda packages, Git, GitHub, GitHub Actions, Terraform, SQL, Artifactory, Airflow, Docker, Kubernetes, Linux/Windows VMs. About You: Hands-on industry experience in some combination of Software Engineering, ML Engineering, Data Science, DevOps, and … necessary. Hands-on industry experience in some combination of the following technologies: Python ecosystem, Azure (VMs, Web Apps, Managed Databases), GitHub Actions, Terraform, Packer, Airflow, Docker, Kubernetes, Linux/Windows VM administration, Shell scripting (primary Bash but PowerShell as well). A solid understanding of modern security and networking More ❯

that support core trading, forecasting, risk, and PPA processes across all Octopus international regions. The role leverages a modern tech stack including SQL, Python, Airflow, Kubernetes, and various other cutting-edge technologies. You'll work with tools like dbt on Databricks, PySpark, Streamlit, and Django, ensuring robust data infrastructure … code standardization Take ownership of data platform improvements Share knowledge and upskill team members Requirements For Data Engineer Strong aptitude with SQL, Python and Airflow Experience in Kubernetes, Docker, Django, Spark and related monitoring tools Experience with dbt for pipeline modelling Ability to shape needs into requirements and design More ❯

World Wide Technology (WWT), a global technology integrator and IT solutions provider. World Wide Technology, established in 1990 in St. Louis, Missouri, collaborates with OEMs like Cisco and Dell EMC to offer infrastructure security and custom app development services to More ❯

If you need support in completing the application or if you require a different format of this document, please get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100/+44 204 520 2575 with the More ❯

If you need support in completing the application or if you require a different format of this document, please get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100/+44 204 520 2575 with the More ❯

Senior Data Engineer 100% Remote B2B Contract Full-time position with flexible working hours (overlap with US required) We're looking for a Senior Data Engineer for a company that facilitates freelancing and remote work. Their platform provides a marketplace More ❯

engineers, providing mentorship and technical guidance. Taking ownership of the health and stability of a widely used data platform. Managing and improving a heavy Airflow estate within a GCP-based environment. Ensuring robust engineering practices and continuous platform improvement. Tech Stack: GCP and Airflow, (essential) dbt, Terraform, Kubernetes More ❯

engineers, providing mentorship and technical guidance. Taking ownership of the health and stability of a widely used data platform. Managing and improving a heavy Airflow estate within a GCP-based environment. Ensuring robust engineering practices and continuous platform improvement. Tech Stack: GCP and Airflow, (essential) dbt, Terraform, Kubernetes More ❯

engineers, providing mentorship and technical guidance. Taking ownership of the health and stability of a widely used data platform. Managing and improving a heavy Airflow estate within a GCP-based environment. Ensuring robust engineering practices and continuous platform improvement. Tech Stack: GCP and Airflow, (essential) dbt, Terraform, Kubernetes More ❯

CACI is looking for a Data Product Engineer within the Product Strategy & Implementation team who will help improve the existing data product refresh processes and mitigate data products. Who we are: At CACI we do amazing things with data. We More ❯

Machine Learning Engineer A long way has come since Sci-Fi films like Terminator and iRobot got us thinking about robots taking over the world. But in the 2020s, hearing AI and machines in the same sentence means a world More ❯

Zilch is a payment tech company on a mission to create the most empowering way to pay for anything, anywhere. Combining the best of debit, credit and savings, we give our customers the option to earn instant cashback or spread More ❯

CACI is looking for a Data Product Engineer within the Product Strategy & Implementation team who will help improve the existing data product refresh processes and mitigate data products. Who we are: At CACI we do amazing things with data. We More ❯

Headquartered in London, CACI Ltd is a wholly owned subsidiary of CACI International Inc., a publicly listed company on the NYSE with annual revenue in excess of US $6.2bn and employing approx. 22,000 people worldwide. CACI Ltd is an More ❯

Revolutionising Healthcare Through Machine Learning. The field of machine learning has advanced far beyond the futuristic ideas portrayed in Sci-Fi films like Robocop and Transformers. Today, machine learning represents a groundbreaking tool in healthcare and pharmaceuticals, offering solutions to More ❯