3 of 3 Permanent Apache Airflow Jobs in Shrewsbury

data pipelines at scale, you'll thrive here. Tech stack: Micro-services Container Platforms (Kubernetes, CRC, Docker) Big Data Technologies (Apache.... Spark, Flink, HDFS, Airflow, Trino, Iceberg, Hive) Dependency injection frameworks (Spring) Observability (Loki/Grafana) Large scale data processing (Kafka) CI/CD Build tools ( Maven, Git, Jenkins ...

strong ability to learn it quickly. Strong SQL skills; working familiarity with Python for scripting and DBT automation. Experience integrating DBT with orchestration tools (Airflow, Dagster, Prefect, etc.). Solid understanding of modern data engineering, ELT patterns, and version-controlled analytics development. Preferred Prior experience operationalizing ML workflows inside ...

Extensive experience building and consuming RESTful APIs Experience using Relational and Analytical databases Extensive experience of highly efficient and scalable ETL pipelines, ideally including Airflow and Dataflow on GCP Quality is part of everything that you do, including robust test and release automation Proactively removes bottlenecks, toil and repetitive … Passionate about building the best possible developer experience for our engineers Experience working with and building CI/CD pipelines Detailed understanding of Apache Beam and Pub/Sub or the streaming paradigm in general About working for us Our ambition is to be the leading UK business ...