6 of 6 Apache Airflow Jobs in Derby

tools, helping the business make confident, data-driven decisions. Why this role is exciting: • Work in a modern data environment with tools like dbt, Airflow, Python, AWS, Databricks and Looker/BI platforms • Build scalable data models, pipelines and self-serve analytics solutions • Automate processes and improve operational efficiency ...

Data Engineer - GCP/Python/DBT - OutsideIR35 - £500 per day Role: Contract Data Engineer Tech: GCP/Python/DBT/Airbyte/Airflow Rate: £500 per day Determination: Outside IR35 Duration: 3-6 months A start-up client of ours are on the hunt for a Contract ...

start-ups or high-growth scale-ups • Strong technical grounding across Node.js, Typescript, React, MySQL and cloud-native architectures (AWS, ECS/K8s, Kafka, Airflow) • Comfortable driving Agile and DevOps culture, and setting high standards for clean, testable, secure code in fast-moving environments If you want ...

team to make sure our data function not only delivers but also drives strategic decision-making. Our Tech Stack: Python, Docker, Dagster, dbt, Fivetran, Apache Iceberg, Snowflake, S3, Glue, ECS, and Omni. We're constantly evolving our stack and welcome input from engineering leaders on how we can improve … scaling data platforms in a high-growth or start-up environment. Strong expertise in Python and SQL, with deep experience in orchestration frameworks (Dagster, Airflow, Prefect). Advanced knowledge of data modelling and architecture (Kimball dimensional modelling, Data Vault etc). Hands-on experience with dbt, modern data warehouses ...

have strong Python backend software engineer skills You have experience working with large data sets You have experience of using PySpark and ideally also Apache Spark You believe in automating wherever possible You're a collaborative problem solver with great communication skills Other technology in the stack includes: FastAPI … Django, Airflow, Kafka, ETL, CI/CD, experience with some or all would be beneficial but you'll pick it up on the job What's in it for you: Salary to £100k + bonus Health Insurance Life Assurance 25 days holiday Training and self-development budget Impactful role ...

fast-paced, challenging environment. Key Responsibilities: Design, implement, and debug ETL pipelines to process and manage complex datasets. Leverage big data tools, including Apache Kafka, Spark, and Airflow, to deliver scalable solutions. Collaborate with stakeholders to ensure data quality and alignment with business goals. Utilize programming expertise … data engineering projects Good hands-on experience of designing, implementing, debugging ETL pipeline Expertise in Python, PySpark and SQL languages Expertise with Spark and Airflow Experience of designing data pipelines using cloud native services on AWS Extensive knowledge of AWS services like API Gateway, Lambda, Redshift, Glue, Cloudwatch, etc. ...