351 to 375 of 477 Apache Airflow Jobs in the UK

stakeholder communication skills Desirable: Experience overseeing or supporting data ingestion pipelines, including APIs and event-driven data sources Familiarity with orchestration tools such as Airflow and modern ELT architectures Experience governing or implementing data CI/CD pipelines (e.g. dbt tests, deployment pipelines, automated checks). We currently … design input, reviews, and mentoring Influence how analytics data is built, trusted, and operated at scale Work with a modern stack: AWS, Snowflake, dbt, Airflow, SQL, and Python Join us as we redefine travel experiences and create memories for millions of passengers. At Jet2.com and Jet2holidays, your potential ...

data flow, including supporting delivery in air-gapped and other restricted environments.* Delivering data applications in an automated and continuous fashion.* Utilising tools like Airflow for orchestration and automating data pipeline deployments using DevOps tools and techniques (Docker, Containers, Terraform, Kubernetes)* Building data pipelines using both cloud-native … experience as a DataOps Engineer delivering DataOps solutions in public sector or similarly regulated environments.* Developing, orchestrating and maintaining data pipelines using tools like Airflow, Prefect, or Dagster.* Containerising data applications using Docker and deploying them to Container Platforms (EKS, AKS and Kubernetes).* Implementing CI/CD pipelines ...

At Bionic, we’re on a mission to make it radically easier to run a small business. As the UK’s leading business comparison and switching service, we help thousands of small and medium‐size ...

About this role: At Astronomer, we’re redefining how companies run Apache Airflow at scale. Our R&D organization is home to some of the most innovative minds in cloud infrastructure and open-source software. You can’t spell “Data Orchestration” without “Data”, and we’re looking … data platforms from cloud-native component parts - we have a healthy mix of build vs. buy; sometimes building is the right choice. Experience with Apache Airflow. #LI-Hybrid At Astronomer, we value diversity. We are an equal opportunity employer: we do not discriminate on the basis of race, religion ...

3+ years experience working in version control environments using platforms such as Gitlab or Github 2+ years experience working with job orchestration tools like Apache Airflow, both as a pipeline developer and reviewer 2+ years experience with data ingestion and transformation frameworks (e.g., dbt, Fivetran, or custom/ ...

role involves using technology to automate data processes, working with SQL, DBT, Snowflake, AWS, Airflow, and Python. About Hard Rock Digital Hard Rock Digital is a company providing digital solutions for the iGaming industry. Estimated Benefits Health Insurance Paid Time Off Benefits estimated based on industry standards #J ...

applications in air-gapped environments. You will implement and manage monitoring and observability to ensure data quality across the data flow, using tools like Airflow, Docker, Terraform and Kubernetes, with a strong emphasis on CI/CD and IaC practices. #J-18808-Ljbffr ...

Senior Data Engineer to design, build, and operate enterprise-scale data solutions. You will leverage Snowflake with hands-on Python, PySpark, AWS and Airflow to create scalable data platforms and robust analytics capabilities. The role emphasizes technical leadership, governance, and collaboration with cross-functional teams to deliver high-performance ...

devices and platforms to surface key metrics. The role emphasizes coding in Python, strong SQL, and experience with large data ecosystems (HDFS, Hive, Spark, Airflow). You will influence architecture and own initiatives from concept to delivery. Hybrid work from Cambridge Office. #J-18808-Ljbffr ...

design, build, and maintain data pipelines and infrastructure to support secure, reliable, and scalable public sector services. You will work with AWS, Terraform, Spark, Airflow, Docker, and GitLab CI/CD within a hybrid model, contributing to secure coding practices and collaborating across cross-functional teams. #J-18808-Ljbffr ...

platform and expanding their engineering capability. The Role Own and develop the MLOps infrastructure supporting AI services. Build and maintain orchestration pipelines using Dagster, Airflow, or Prefect. Deploy and manage ML workloads on Kubernetes and cloud platforms. Implement CI/CD, observability, and monitoring across production systems. Develop infrastructure ...

other engineering and product teams. Skills and Experience Strong commercial Data Engineering experience Experience designing and building scalable data pipelines Strong experience with Airflow Experience working with Databricks Experience working closely with Data Science or advanced analytics teams Ability to take ownership of complex technical problems and drive solutions ...

given real ownership, exposure to experienced director level mentors & Senior Data Engineers, alongside the opportunity to grow towards senior-level responsibilities. Tech StackSpark | Airflow | Kubernetes | Azure | CubeJSWhat You'll Be DoingData Pipeline Development – designing & developing efficient, scalable & robust Data PipelinesSupport and main the data platform to ensure security, reliability ...

skills Ability to translate data into compelling narratives Ability to take work beyond analysis and deliver results Nice to have: Fintech experience, knowledge of Airflow/GitHub/DBT, experience with user-facing products and data Условия Office role in London, England, United Kingdom Visa sponsorship is not available ...

join our dynamic, expanding team. Over the last few years we've built a solid data foundation using best in class technologies (dbt, BigQuery, Airflow) and are just at the start of our journey to leverage this data in a more sophisticated way. About Zapp: Zapp is London ...

lifecycle, exception management. · Experience troubleshooting market and static data related issues that impact trade flow. · Familiarity with enterprise scheduling tools such as Active Batch, Airflow, Control-M, AutoSys · Experience using/building monitoring on platforms like ITRS Geneos, Zabbix ...

ideally within a large‐scale or regulated environment. AWS Experience: Strong working knowledge of AWS and cloud‐first data pipeline orchestration tools such as Airflow, Glue, or EMR. A Security Mindset: Understanding of compliance and security when managing sensitive data pipelines. Strong Automation Skills: Comfortable using Python and Shell ...

narrativesHustler-mentality. You can take work beyond the analysis and get things done. Good to have: Experience in Fintech domain Knowledge of utilities like Airflow/Github/DBTExperience with user-facing products and data*** Please note we are not able to offer visa sponsorship for this level ***Additional ...

Strong programming skills and production experience in Python. Experience building and maintaining data or ML pipelines with an orchestration tool such as Dagster (or Airflow, Prefect, etc.). Hands-on experience with common ML libraries and frameworks, e.g. PyTorch, scikit-learn, and gradient-boosting libraries such as XGBoost ...

large‐scale or regulated environment. AWS Experience: You have a strong working knowledge of AWS and cloud‐first data pipeline orchestration tools (like Airflow, Glue, or EMR). A Security Mindset: You understand the importance of compliance and security when managing sensitive data pipelines. Strong Automation Skills ...

computational improvements Making improvements and/or fixing bugs by submitting patches to open-source projects in our stack, such as Spark, Iceberg, Hadoop, Airflow, and many others Acting as an expert on Spark and Scala Mentoring engineers (including through pairing, design discussions, and knowledge-sharing sessions) and helping ...

large-scale or regulated environment.* AWS Experience: You have a strong working knowledge of AWS and cloud-first data pipeline orchestration tools (like Airflow, Glue, or EMR).* A Security Mindset: You understand the importance of compliance and security when managing sensitive data pipelines.* Strong Automation Skills ...

idiomatic Python used for reliable, well-tested systems (not exploratory notebooks). Design and operation of large-scale ETL/ELT pipelines, including orchestration (Airflow, Prefect, or similar) and reliability patterns such as retries, backfills, and exactly-once semantics. Deep experience with Azure, including AKS, Helm, EventHub, observability tools … Advanced experience operating Delta tables at scale, covering transaction semantics, schema evolution, partitioning, and compaction, alongside highly optimised analytical query execution using DuckDB or Apache Spark. Production-grade relational database expertise, particularly PostgreSQL (query tuning, indexing, partitioning, replication, and schema design across OLTP and analytics). Strong KDB experience ...

data engineering Experience in large-scale data processing, microservices, API design, Kafka, Redis, MemCached, observability tools (Dynatrace, Splunk, Grafana), and orchestration frameworks (Airflow, Temporal) Advanced working knowledge of relational and NoSQL databases, vector stores, data lake architectures, and data governance Practical cloud-native experience (AWS, Azure, or GCP) Ability … hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks and model serving infrastructure or managed endpoints (AWS Bedrock, Azure OpenAI) Familiarity with emerging technologies in data engineering ...

PostgreSQL (or similar relational databases) and NoSQL databases. Experience with vector databases such as Qdrant, Milvus or pgvector . Familiarity with technologies such as Apache Spark, Airflow, Kafka, Elasticsearch/OpenSearch, Pandas and Polars . Strong understanding of data modelling, storage architecture and performance optimisation. Desirable Experience working ...