26 to 45 of 45 Apache Airflow Jobs in London with Remote Work Options

in: Data Warehousing Data Engineering, overall Data Analytics Data Visualisation Proficiency in: Google Cloud (GCP) GCP BigQuery Python DBT or similar FastAPI or similar Airflow or similar Desirable: Google Apigee (as an application developer) Exposure to Machine Learning projects Exposure to DataOps Exposure to dataproc or similar more »

in: Data Warehousing Data Engineering, overall Data Analytics Data Visualisation Proficiency in: Google Cloud (GCP) GCP BigQuery Python DBT or similar FastAPI or similar Airflow or similar Desirable: Google Apigee (as an application developer) Exposure to Machine Learning projects Exposure to DataOps Exposure to dataproc or similar more »

familiarity with modern software engineering practices, including 12factor, CI/CD, and Agile methodologies. Deep understanding of Spark (PySpark), Python (Pandas), orchestration software (e.g. Airflow, Prefect) and databases, data lakes and data warehouses. Experience with cloud technologies, particularly AWS Cloud services, with a particular focus on using AWS Glue more »

testing, and maintenance of data pipelines and data storage systems on Google Cloud Platform (GCP). You will be working with technologies such as Apache Airflow, BigQuery, Python, and SQL to transform and load large data sets, ensuring high data quality and accessibility for business intelligence and analytics more »

have Terraform experience SQL & NoSQL experience Have built out Data Warehouses & built Data Pipelines Strong Databricks & Snowflake experience Docker, ECS, Kubernetes & Orchestration tools like Airflow or Step Functions are nice to have Contracts are running for 6 months initially, paying up to £450p/day (Outside IR35) and will more »

load data to Snowflake. Converting SAS based module to python based Candidates who have data management experience in Snowflake with expertise in Python, DBT, Airflow or similar technologies Must have hands on experience in DBT & SQL Snowflake (added advantage more »

early-stage B2B SaaS experience involving client-facing projects • Experience in front-end development and competency in JavaScript • Knowledge of API development • Familiarity with Airflow, DBT, Databricks • Experience working with Enterprise Resource Planning (e.g. Oracle, SAP) and CRM systems. If this role sounds of interest, please apply using the more »

in a SaaS or B2B environment Ability to interact with clients and facing off to internal stakeholders Experience working with integration tools e.g. ActiveBatch, Airflow, Talend ESB and/or other ETL tools In return you'll get the opportunity to work in a fast paced, dynamic and highly more »

a leading commodities trading firm. Outside of IR35 Hybrid working - 2/3 days in London office Experience Required: - Commodities industry experience Weather forecasting Airflow (or equivalent data orchestration platforms) Data Modeling (Star Schema) Data Warehousing Data Pipeline Orchestration (Kafka) On-Prem SQL more »

knowledge on key technologies like Big Query/Redshift/Synapse/Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF etc Strong proven knowledge of Kimball/Dimensional data modelling and/or Data vault If you are interested in applying for more »

schemas to support business requirements Develop and maintain data ingestion and processing systems using various tools and technologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. Implement data storage solutions using different types of databases, such as relational, non-relational, or cloud-based. Working collaboratively with the client …/Azure SQL, PostgreSQL) You have framework experience within either Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving more »

financial services or energy trading industry Expertise in Python and its ecosystem of libraries and frameworks for data processing, data analysis and data visualisation Airflow, detailed understanding of architecture including schedulers, executers, operators Cloud Environments, understanding of principles, technologies and services for AWS/Azure Kubernetes EKS/AKS … including high availability Desired experience: Worked with Python 3.9+ Familiar with Python test automation Experience with SQL and Timeseries databases Familiar with Parquet, Arrow, Airflow, Databricks Experience with cloud AWS services, such as S3, EC2, RDS etc Quality engineering best practice and tooling including TDD, BDD This is an more »

processes, effective monitoring, and infrastructure-as-code using Terraform. Collaborate closely with our engineering teams to support the orchestration of our ETL pipelines using Airflow and manage our tech stack including Python, Next.js, Airflow, PostgreSQL MongoDB, Kafka and Apache Iceberg. Optimize infrastructure costs and develop strategies for more »

degree in Computer Science, or similar, and have 4-5 years minimum exposure to back end development in Python, and Kubernetes automation. Skills in Airflow are of extra interest. In this role, you will: Executes elite software solutions, help design, development, and technical troubleshooting Create secure and high-quality … conclusions to identify improvements and contribute to better decision-making in terms of creating secure and stable software application development Key skills Python Kubernetes Airflow Distributed systems Computer Science degree Market leading salary and bonus on offer, hybrid working, swish offices and excellent work culture. £120-150k++ more »

Engineer will have: Worked in a Software Engineering setting. Strong Python coding skills including testing principles (unit testing, TDD/BDD) Experience working with Airflow, DBT, and Terraform An understanding of cloud architecture RECRUITMENT PROCESS: A Technical Test 1 Hour online chat. HOW TO APPLY: Please register your interest … Engineer will have: Worked in a Software Engineering setting. Strong Python coding skills including testing principles (unit testing, TDD/BDD) Experience working with Airflow, DBT, and Terraform An understanding of cloud architecture RECRUITMENT PROCESS: A Technical Test 1 Hour online chat. HOW TO APPLY: Please register your interest more »

a MedTech company with a growing reputation in their field. The Data Architect will use their skills and experience of technologies including Kubernetes, Kafka, Airflow, Linux, AWS and Python to spearhead the evolution and enhancement of their existing data infrastructure, as they scale up the adoption of their software … the Software as a Medical Device industry Experience of designing and implementing scalable and secure data infrastructure Hands-on experience with the Kubernetes, Kafka, Airflow, Python, Ubuntu Linux, AWS (or similar cloud platforms) Strong database skills using SQL - Any experience with PostgreSQL or MongoDB would be advantageous An understanding more »

harnessing the power of Databricks and Synapse to build scalable and efficient data pipelines, data lakes, and analytical solutions. With expertise in tools like Airflow for orchestration and GitHub for version control, you will champion DevOps practices to ensure seamless collaboration and automation across the data engineering lifecycle. Your … cross-functional agile teams. of containerization technologies such as Docker and orchestration tools like Kubernetes for containerized deployments. with workflow management tools such as Airflow for orchestrating complex data pipelines and ETL processes. certifications in Azure cloud services and data engineering technologies, demonstrating expertise and proficiency in the Azure more »

Job Title: Data Engineer Job Type: Full Time, Permanent Working location: London, Hybrid Role Purpose At Travelex we are developing modern data services, which will be at the heart of our relationship with our customers. Our data architecture is becoming more »

Machine Learning Engineer up to £95 000 London NEW Machine Learning Engineer Opportunity Available with a Leading Organisation! The Company: Are you an expert in Machine Learning? We are on the lookout for a Machine Learning Engineer to join an more »

Lead Machine Learning Engineer up to £105 000 London NEW Machine Learning Engineer Opportunity Available with a Leading Organisation! The Company: Are you an expert in Machine Learning? We are on the lookout for a Machine Learning Engineer to join more »