6 of 6 Apache Airflow Jobs in Derbyshire

tools, helping the business make confident, data-driven decisions. Why this role is exciting: • Work in a modern data environment with tools like dbt, Airflow, Python, AWS, Databricks and Looker/BI platforms • Build scalable data models, pipelines and self-serve analytics solutions • Automate processes and improve operational efficiency ...

Data Engineer - GCP/Python/DBT - OutsideIR35 - £500 per day Role: Contract Data Engineer Tech: GCP/Python/DBT/Airbyte/Airflow Rate: £500 per day Determination: Outside IR35 Duration: 3-6 months A start-up client of ours are on the hunt for a Contract ...

start-ups or high-growth scale-ups • Strong technical grounding across Node.js, Typescript, React, MySQL and cloud-native architectures (AWS, ECS/K8s, Kafka, Airflow) • Comfortable driving Agile and DevOps culture, and setting high standards for clean, testable, secure code in fast-moving environments If you want ...

resilience and data residency Confidence working with senior stakeholders to make pragmatic, commercial platform decisions Tech environment includes: AWS, Azure, Kubernetes (EKS), ECS, Terraform, Airflow, EFK/Prometheus/Grafana, MySQL/PostgreSQL/Redis/Elasticsearch/Kafka, GitHub Actions, plus services written in Python, Node.js and Go. ...

have strong Python backend software engineer skills You have experience working with large data sets You have experience of using PySpark and ideally also Apache Spark You believe in automating wherever possible You're a collaborative problem solver with great communication skills Other technology in the stack includes: FastAPI … Django, Airflow, Kafka, ETL, CI/CD, experience with some or all would be beneficial but you'll pick it up on the job What's in it for you: Salary to £100k + bonus Health Insurance Life Assurance 25 days holiday Training and self-development budget Impactful role ...

fast-paced, challenging environment. Key Responsibilities: Design, implement, and debug ETL pipelines to process and manage complex datasets. Leverage big data tools, including Apache Kafka, Spark, and Airflow, to deliver scalable solutions. Collaborate with stakeholders to ensure data quality and alignment with business goals. Utilize programming expertise … data engineering projects Good hands-on experience of designing, implementing, debugging ETL pipeline Expertise in Python, PySpark and SQL languages Expertise with Spark and Airflow Experience of designing data pipelines using cloud native services on AWS Extensive knowledge of AWS services like API Gateway, Lambda, Redshift, Glue, Cloudwatch, etc. ...