276 to 300 of 391 Apache Airflow Jobs in the UK

Role : Build and operate data pipelines and analytics platforms in the cloud. Work with engineers and analysts to design, implement, and maintain reliable, observable ETL/ELT workflows using Airflow and managed cloud services. Focus on Python-first implementations, high-quality SQL, Airflow orchestration, and query engines such as Athena, Trino, or ClickHouse. Required Skills: Hands-on software More ❯

Role : Build and operate data pipelines and analytics platforms in the cloud. Work with engineers and analysts to design, implement, and maintain reliable, observable ETL/ELT workflows using Airflow and managed cloud services. Focus on Python-first implementations, high-quality SQL, Airflow orchestration, and query engines such as Athena, Trino, or ClickHouse. Required Skills: Hands-on software More ❯

across multiple sources. Integrate services via RESTful APIs and manage structured/unstructured data formats. Data Visualisation & Automation Build interactive dashboards in BI tools such as Power BI or Apache Superset. Automate KPI tracking and reporting to streamline workflows. Partner with teams to identify opportunities for process optimisation. Apply best visualisation principles for clarity and impact. Ensure dashboard performance … tools such as Power BI, Superset, or Tableau. Experience with AWS data tools and governance. Strong analytical mindset with a focus on business outcomes. Nice-to-Have Python or Airflow experience for automation. Knowledge of data warehouse best practices (Snowflake, BigQuery, Redshift). Experience with MS Business Central or similar ERP systems. eCommerce or omni-channel retail background. Exposure More ❯

with researchers, technologists, and analysts to enhance the quality, timeliness, and accessibility of data. Contribute to the evolution of modern cloud-based data infrastructure , working with tools such as Airflow, Kafka, Spark, and AWS . Monitor and troubleshoot data workflows, ensuring continuous delivery of high-quality, analysis-ready datasets. Play a visible role in enhancing the firm’s broader … Strong programming ability in Python (including libraries such as pandas and NumPy ) and proficiency with SQL . Confident working with ETL frameworks , data modelling principles, and modern data tools (Airflow, Kafka, Spark, AWS). Experience working with large, complex datasets from structured, high-quality environments — e.g. consulting, finance, or enterprise tech. STEM degree in Mathematics, Physics, Computer Science, Engineering More ❯

with researchers, technologists, and analysts to enhance the quality, timeliness, and accessibility of data. Contribute to the evolution of modern cloud-based data infrastructure , working with tools such as Airflow, Kafka, Spark, and AWS . Monitor and troubleshoot data workflows, ensuring continuous delivery of high-quality, analysis-ready datasets. Play a visible role in enhancing the firm’s broader … Strong programming ability in Python (including libraries such as pandas and NumPy ) and proficiency with SQL . Confident working with ETL frameworks , data modelling principles, and modern data tools (Airflow, Kafka, Spark, AWS). Experience working with large, complex datasets from structured, high-quality environments — e.g. consulting, finance, or enterprise tech. STEM degree in Mathematics, Physics, Computer Science, Engineering More ❯

with researchers, technologists, and analysts to enhance the quality, timeliness, and accessibility of data. Contribute to the evolution of modern cloud-based data infrastructure , working with tools such as Airflow, Kafka, Spark, and AWS . Monitor and troubleshoot data workflows, ensuring continuous delivery of high-quality, analysis-ready datasets. Play a visible role in enhancing the firm’s broader … Strong programming ability in Python (including libraries such as pandas and NumPy ) and proficiency with SQL . Confident working with ETL frameworks , data modelling principles, and modern data tools (Airflow, Kafka, Spark, AWS). Experience working with large, complex datasets from structured, high-quality environments — e.g. consulting, finance, or enterprise tech. STEM degree in Mathematics, Physics, Computer Science, Engineering More ❯

with researchers, technologists, and analysts to enhance the quality, timeliness, and accessibility of data. Contribute to the evolution of modern cloud-based data infrastructure , working with tools such as Airflow, Kafka, Spark, and AWS . Monitor and troubleshoot data workflows, ensuring continuous delivery of high-quality, analysis-ready datasets. Play a visible role in enhancing the firm’s broader … Strong programming ability in Python (including libraries such as pandas and NumPy ) and proficiency with SQL . Confident working with ETL frameworks , data modelling principles, and modern data tools (Airflow, Kafka, Spark, AWS). Experience working with large, complex datasets from structured, high-quality environments — e.g. consulting, finance, or enterprise tech. STEM degree in Mathematics, Physics, Computer Science, Engineering More ❯

with researchers, technologists, and analysts to enhance the quality, timeliness, and accessibility of data. Contribute to the evolution of modern cloud-based data infrastructure , working with tools such as Airflow, Kafka, Spark, and AWS . Monitor and troubleshoot data workflows, ensuring continuous delivery of high-quality, analysis-ready datasets. Play a visible role in enhancing the firm’s broader … Strong programming ability in Python (including libraries such as pandas and NumPy ) and proficiency with SQL . Confident working with ETL frameworks , data modelling principles, and modern data tools (Airflow, Kafka, Spark, AWS). Experience working with large, complex datasets from structured, high-quality environments — e.g. consulting, finance, or enterprise tech. STEM degree in Mathematics, Physics, Computer Science, Engineering More ❯

ECS images – largely in NodeJS.) ETL Pipeline Management: Develop and optimise data pipelines to enable seamless data flow and transformation. (We currently use a mix of SSIS, ETL Works, Airflow, Snowflake and are moving to Airflow/Snowflake only architecture.) Snowflake Management: Create production-ready procedures in Snowflake for moving and analysing data. System Optimisation: Improve existing backend … Can handle sensitive and confidential information Experience working with non-data stakeholders to translate their needs and generate useful results presented in an understandable way Familiarity with orchestration tools (Airflow, DBT) and data warehouse modelling Managing other data engineers Experience with customer and commercial datasets, especially in retail or FMCG A love of pets! About Jollyes Pets Jollyes are More ❯

data integrity, consistency, and accuracy across systems. Optimize data infrastructure for performance, cost efficiency, and scalability in cloud environments. Develop and manage graph-based data systems (e.g. Kuzu, Neo4j, Apache AGE) to model and query complex relationships in support of Retrieval Augmented Generation (RAG) and agentic architectures. Contribute to text retrieval pipelines involving vector embeddings and knowledge graphs, for … workflows. Proficiency with cloud platforms such as Azure, AWS, or GCP and their managed data services. Desirable: Experience with asynchronous python programming Experience with graph technologies (e.g., Kuzu, Neo4j, Apache AGE). Familiarity with embedding models (hosted or local): OpenAI, Cohere etc or HuggingFace models/sentence-transformers. Solid understanding of data modeling, warehousing, and performance optimization. Experience with … messaging middleware + streaming (e.g. NATS Jetstream, Redis Streams, Apache Kafka or Pulsar etc.) Hands-on experience with data lakes, lakehouses, or components of the modern data stack. Exposure to MLOps tools and best practices. Exposure to workflow orchestration frameworks (e.g. Metaflow, Airflow, Dagster) Exposure to Kubernetes Experience working with unstructured data (e.g., logs, documents, images). Awareness More ❯

data integrity, consistency, and accuracy across systems. Optimize data infrastructure for performance, cost efficiency, and scalability in cloud environments. Develop and manage graph-based data systems (e.g. Kuzu, Neo4j, Apache AGE) to model and query complex relationships in support of Retrieval Augmented Generation (RAG) and agentic architectures. Contribute to text retrieval pipelines involving vector embeddings and knowledge graphs, for … workflows. Proficiency with cloud platforms such as Azure, AWS, or GCP and their managed data services. Desirable: Experience with asynchronous python programming Experience with graph technologies (e.g., Kuzu, Neo4j, Apache AGE). Familiarity with embedding models (hosted or local): OpenAI, Cohere etc or HuggingFace models/sentence-transformers. Solid understanding of data modeling, warehousing, and performance optimization. Experience with … messaging middleware + streaming (e.g. NATS Jetstream, Redis Streams, Apache Kafka or Pulsar etc.) Hands-on experience with data lakes, lakehouses, or components of the modern data stack. Exposure to MLOps tools and best practices. Exposure to workflow orchestration frameworks (e.g. Metaflow, Airflow, Dagster) Exposure to Kubernetes Experience working with unstructured data (e.g., logs, documents, images). Awareness More ❯

data integrity, consistency, and accuracy across systems. Optimize data infrastructure for performance, cost efficiency, and scalability in cloud environments. Develop and manage graph-based data systems (e.g. Kuzu, Neo4j, Apache AGE) to model and query complex relationships in support of Retrieval Augmented Generation (RAG) and agentic architectures. Contribute to text retrieval pipelines involving vector embeddings and knowledge graphs, for … workflows. Proficiency with cloud platforms such as Azure, AWS, or GCP and their managed data services. Desirable: Experience with asynchronous python programming Experience with graph technologies (e.g., Kuzu, Neo4j, Apache AGE). Familiarity with embedding models (hosted or local): OpenAI, Cohere etc or HuggingFace models/sentence-transformers. Solid understanding of data modeling, warehousing, and performance optimization. Experience with … messaging middleware + streaming (e.g. NATS Jetstream, Redis Streams, Apache Kafka or Pulsar etc.) Hands-on experience with data lakes, lakehouses, or components of the modern data stack. Exposure to MLOps tools and best practices. Exposure to workflow orchestration frameworks (e.g. Metaflow, Airflow, Dagster) Exposure to Kubernetes Experience working with unstructured data (e.g., logs, documents, images). Awareness More ❯

data integrity, consistency, and accuracy across systems. Optimize data infrastructure for performance, cost efficiency, and scalability in cloud environments. Develop and manage graph-based data systems (e.g. Kuzu, Neo4j, Apache AGE) to model and query complex relationships in support of Retrieval Augmented Generation (RAG) and agentic architectures. Contribute to text retrieval pipelines involving vector embeddings and knowledge graphs, for … workflows. Proficiency with cloud platforms such as Azure, AWS, or GCP and their managed data services. Desirable: Experience with asynchronous python programming Experience with graph technologies (e.g., Kuzu, Neo4j, Apache AGE). Familiarity with embedding models (hosted or local): OpenAI, Cohere etc or HuggingFace models/sentence-transformers. Solid understanding of data modeling, warehousing, and performance optimization. Experience with … messaging middleware + streaming (e.g. NATS Jetstream, Redis Streams, Apache Kafka or Pulsar etc.) Hands-on experience with data lakes, lakehouses, or components of the modern data stack. Exposure to MLOps tools and best practices. Exposure to workflow orchestration frameworks (e.g. Metaflow, Airflow, Dagster) Exposure to Kubernetes Experience working with unstructured data (e.g., logs, documents, images). Awareness More ❯

data integrity, consistency, and accuracy across systems. Optimize data infrastructure for performance, cost efficiency, and scalability in cloud environments. Develop and manage graph-based data systems (e.g. Kuzu, Neo4j, Apache AGE) to model and query complex relationships in support of Retrieval Augmented Generation (RAG) and agentic architectures. Contribute to text retrieval pipelines involving vector embeddings and knowledge graphs, for … workflows. Proficiency with cloud platforms such as Azure, AWS, or GCP and their managed data services. Desirable: Experience with asynchronous python programming Experience with graph technologies (e.g., Kuzu, Neo4j, Apache AGE). Familiarity with embedding models (hosted or local): OpenAI, Cohere etc or HuggingFace models/sentence-transformers. Solid understanding of data modeling, warehousing, and performance optimization. Experience with … messaging middleware + streaming (e.g. NATS Jetstream, Redis Streams, Apache Kafka or Pulsar etc.) Hands-on experience with data lakes, lakehouses, or components of the modern data stack. Exposure to MLOps tools and best practices. Exposure to workflow orchestration frameworks (e.g. Metaflow, Airflow, Dagster) Exposure to Kubernetes Experience working with unstructured data (e.g., logs, documents, images). Awareness More ❯

and strengthen the organisation’s data engineering and analytics capability within its AWS-based environment. We’re ideally looking for someone with strong hands-on experience across AWS services, Airflow, Python, and SQL. You’ll play a key role in designing, building, and maintaining modern data infrastructure that powers insight-led decision-making across the business. Working within a … and key stakeholders to deliver practical, scalable solutions that make a real impact. Key Responsibilities Design, build, and maintain robust, scalable ETL/ELT pipelines using tools such as Airflow and AWS services (S3, Redshift, Glue, Lambda, Athena). Integrate new data sources and continuously optimise performance and cost efficiency. Ensure data quality, integrity, and security across all systems. … with new tools and trends in data engineering, particularly within the AWS ecosystem. Skills & Experience Strong hands-on experience with AWS (S3, Redshift, Glue, Lambda, Athena). Skilled in Airflow for workflow orchestration. Advanced SQL and proficient in Python for data engineering. Experience with data modelling (e.g. dimensional) and familiarity with NoSQL databases (e.g. Elasticsearch). Confident using Git More ❯

teams (Data Scientists, Quality, Manufacturing, IT) to define data requirements and deliver reliable data solutions. Develop and maintain ETL/ELT workflows using modern orchestration and integration tools (e.g., Airflow, Fivetran, or similar). Implement data governance, lineage, and documentation best practices. Support business intelligence tools (e.g., Tableau, Power BI) by ensuring data accessibility and consistency. Continuously evaluate emerging … hands-on experience with: Snowflake (architecture, performance tuning, cost optimisation) DBT (model development, testing, documentation, deployment) SQL (advanced query optimisation and debugging) Experience with data integration and orchestration tools (Airflow, Dagster, Prefect, or similar). Familiarity with cloud data platforms (AWS, Azure, or GCP). Contract: Initial 6-month contract Hybrid - 1 day per week on-site in London More ❯

Data Engineer (leading a team of 4). Salary: £100,000 – £130,000 + benefits Location: West London - Hybrid (3 days p/w in-office) Tech: AWS, Snowflake, Airflow, DBT, Python The Company: Immersum have engaged with a leading PropTech company on a mission to revolutionise how the property sector understands people, places, and data. By combining cutting … Implement redundancy, backups, and DB triggers to ensure reliability and data integrity. Work with Python to build scalable data solutions. Introduce and adopt new technologies such as Kafka, Docker, Airflow, and AWS . Define and enforce data hygiene practices (ontology, storage, artifacts, version control). Reduce engineering load per person through automation and efficient design. Collaborate closely with a More ❯

Data Engineer (leading a team of 4). Salary: £100,000 – £130,000 + benefits Location: West London - Hybrid (3 days p/w in-office) Tech: AWS, Snowflake, Airflow, DBT, Python The Company: Immersum have engaged with a leading PropTech company on a mission to revolutionise how the property sector understands people, places, and data. By combining cutting … Implement redundancy, backups, and DB triggers to ensure reliability and data integrity. Work with Python to build scalable data solutions. Introduce and adopt new technologies such as Kafka, Docker, Airflow, and AWS . Define and enforce data hygiene practices (ontology, storage, artifacts, version control). Reduce engineering load per person through automation and efficient design. Collaborate closely with a More ❯

Data Engineer (leading a team of 4). Salary: £100,000 – £130,000 + benefits Location: West London - Hybrid (3 days p/w in-office) Tech: AWS, Snowflake, Airflow, DBT, Python The Company: Immersum have engaged with a leading PropTech company on a mission to revolutionise how the property sector understands people, places, and data. By combining cutting … Implement redundancy, backups, and DB triggers to ensure reliability and data integrity. Work with Python to build scalable data solutions. Introduce and adopt new technologies such as Kafka, Docker, Airflow, and AWS . Define and enforce data hygiene practices (ontology, storage, artifacts, version control). Reduce engineering load per person through automation and efficient design. Collaborate closely with a More ❯

Data Engineer (leading a team of 4). Salary: £100,000 – £130,000 + benefits Location: West London - Hybrid (3 days p/w in-office) Tech: AWS, Snowflake, Airflow, DBT, Python The Company: Immersum have engaged with a leading PropTech company on a mission to revolutionise how the property sector understands people, places, and data. By combining cutting … Implement redundancy, backups, and DB triggers to ensure reliability and data integrity. Work with Python to build scalable data solutions. Introduce and adopt new technologies such as Kafka, Docker, Airflow, and AWS . Define and enforce data hygiene practices (ontology, storage, artifacts, version control). Reduce engineering load per person through automation and efficient design. Collaborate closely with a More ❯

Data Engineer (leading a team of 4). Salary: £100,000 – £130,000 + benefits Location: West London - Hybrid (3 days p/w in-office) Tech: AWS, Snowflake, Airflow, DBT, Python The Company: Immersum have engaged with a leading PropTech company on a mission to revolutionise how the property sector understands people, places, and data. By combining cutting … Implement redundancy, backups, and DB triggers to ensure reliability and data integrity. Work with Python to build scalable data solutions. Introduce and adopt new technologies such as Kafka, Docker, Airflow, and AWS . Define and enforce data hygiene practices (ontology, storage, artifacts, version control). Reduce engineering load per person through automation and efficient design. Collaborate closely with a More ❯

Machine Learning Engineer Machine Learning Engineer - AI for Advanced Materials - Oxford/Remote (UK) (Tech stack: Python, PyTorch, TensorFlow, Scikit-learn, MLflow, Airflow, Docker, Kubernetes, AWS, Azure, GCP, Pandas, NumPy, SciPy, CI/CD, MLOps, Data Visualization, Bayesian Modelling, Probabilistic Programming, Terraform) We're looking for a Machine Learning Engineer to join a rapidly scaling deep-tech company that … Our client is seeking Machine Learning Engineers with experience in some or all of the following (full training provided to fill any gaps): Python, PyTorch, TensorFlow, Scikit-learn, MLflow, Airflow, Docker, Kubernetes, Pandas, NumPy, SciPy, CI/CD, Data Visualization, Bayesian Modelling, Probabilistic Programming, Terraform, Azure, AWS, GCP, Git, and Agile methodologies. Join a team that's fusing AI More ❯

management to analyze and improve our business processes Conduct workload and complexity assessments Design, plan and implement new efficient software solutions in Python and Go Maintain and enhance our Airflow data pipelines Improve observability and scalability to support our constantly growing client base Continuously adapt to changing requirements in a business driven environment Build and extend knowledge of financial … innate curiosity to learn new things Preferred qualifications Background in traditional finance or digital assets, ideally in trading domain Hands-on experience with Python libraries and frameworks (NumPy, Pandas, Airflow, FastAPI, Flask, SQLAlchemy) Highly proficient in asynchronous, event driven distributed systems Working knowledge of cloud-native architectures, GCP preferred Experience in Go and working with real-time data streams More ❯

management to analyze and improve our business processes Conduct workload and complexity assessments Design, plan and implement new efficient software solutions in Python and Go Maintain and enhance our Airflow data pipelines Improve observability and scalability to support our constantly growing client base Continuously adapt to changing requirements in a business driven environment Build and extend knowledge of financial … innate curiosity to learn new things Preferred qualifications Background in traditional finance or digital assets, ideally in trading domain Hands-on experience with Python libraries and frameworks (NumPy, Pandas, Airflow, FastAPI, Flask, SQLAlchemy) Highly proficient in asynchronous, event driven distributed systems Working knowledge of cloud-native architectures, GCP preferred Experience in Go and working with real-time data streams More ❯

management to analyze and improve our business processes Conduct workload and complexity assessments Design, plan and implement new efficient software solutions in Python and Go Maintain and enhance our Airflow data pipelines Improve observability and scalability to support our constantly growing client base Continuously adapt to changing requirements in a business driven environment Build and extend knowledge of financial … innate curiosity to learn new things Preferred qualifications Background in traditional finance or digital assets, ideally in trading domain Hands-on experience with Python libraries and frameworks (NumPy, Pandas, Airflow, FastAPI, Flask, SQLAlchemy) Highly proficient in asynchronous, event driven distributed systems Working knowledge of cloud-native architectures, GCP preferred Experience in Go and working with real-time data streams More ❯