76 to 100 of 116 Apache Airflow Jobs in England

needs into technical requirements. Possess outstanding communication and interpersonal skills, facilitating clear and effective collaboration within and outside the team. Desirables: Familiarity with the Apache Airflow platform. Basic knowledge of BI tools such as Power BI to support data visualization and insights. Experience with version control using ...

leaders and ambitious start-ups across media, e-commerce, healthcare and more. Requirements Must have strong Python and SQL Solid experience with Spark/Airflow and Kafka Strong experience with large cloud-based systems (AWS) Location: London (3 days per week on-site) Start: ASAP Rate ...

experience with Google Cloud Platform (GCP), ideally BigQuery. Proficiency in SQL for data transformation and optimisation. Experience with automation tools such as Python, Airflow, dbt, Power Automate, or similar. Understanding of data security, permissions, and governance best practices. Soft Skills: Excellent communication and ability to translate complex data concepts ...

programming skills in Python; experience with ML libraries such as Snowpark, PySpark or PyTorch. Experience with containerization tools like Docker and orchestration tools like Airflow or Astronomer. Familiarity with cloud platforms (AWS, Azure) and ML services (e.g., SageMaker, Vertex AI). Experience with CI/CD pipelines and automation ...

with analytics, architecture, and delivery stakeholders. Balance operational leadership with longer-term planning and strategy. YOUR SKILLS & EXPERIENCE Essential: Strong experience with Snowflake, AWS, Airflow, and dbt. Proven background leading data engineers in production environments. Experience supporting data platform migrations or major transformations. Confident making technical trade-offs ...

product'. Ability to influence senior stakeholders and collaborate effectively with technology architects. Familiarity with contemporary data engineering tooling (e.g. Snowflake-centric stacks, DBT, Airflow, Fivetran). If you'd like to learn more, please contact Jacob Ferdinand ...

cases are developed in a scalable and sustainable way Communicate complex technical decisions clearly to non-technical stakeholders Technical Environment Strong experience required: Snowflake Airflow dbt Nice to have: AWS (lower priority) Ideal Background Senior or Lead Data Engineer who has progressed into a management/technical leadership role ...

outcomes Experience in startups, scale-ups, or consultancies is helpful — but not required. Nice to Have (Not Required) Experience with tools like Databricks, dbt, Airflow , or similar platforms Some exposure to API development or backend systems Experience integrating enterprise systems (ERP, CRM, operational platforms) Familiarity with dashboards or data ...

engineering and product teams to support evolving data requirements Requirements: SQL Server T-SQL DBA Skills Power BI ETL (SSIS or other, such as Airflow) MySQL would be useful but certainly not essential. Apply Now! If you have a range of experience in Data Engineering and you are looking ...

Tech Lead Manager in a data, platform or backend context · Background in data or backend engineering (e.g. AWS, Python/Scala, Spark/EMR, Airflow or similar) – enough to challenge designs and make informed decisions · Experience owning or supporting analytics/data/reporting products for internal or external ...

Tech Lead Manager in a data, platform or backend context · Background in data or backend engineering (e.g. AWS, Python/Scala, Spark/EMR, Airflow or similar) – enough to challenge designs and make informed decisions · Experience owning or supporting analytics/data/reporting products for internal or external ...

Tech Lead Manager in a data, platform or backend environment A background in data or backend engineering, such as AWS, Python or Scala, Spark, Airflow or similar Experience owning or supporting analytics, data or reporting products Strong people leadership skills including hiring, coaching and performance management A track record ...

Tech Lead Manager in a data, platform or backend environment A background in data or backend engineering, such as AWS, Python or Scala, Spark, Airflow or similar Experience owning or supporting analytics, data or reporting products Strong people leadership skills including hiring, coaching and performance management A track record ...

healthcare, fintech, or other regulated environments Exposure to LLM infrastructure, model serving, or agentic AI frameworks in production Familiarity with data platforms (BigQuery, Airflow, data pipelines) Experience with CI/CD pipelines (GitHub Actions, Cloud Build) and policy-as-code tools Exposure to observability stacks (OpenTelemetry, Prometheus, Cloud Monitoring ...

visualisation tools. Background in Financial Services is a plus. Experience with cloud data environments (e.g. Redshift, Azure) welcomed. Knowledge of automation tools such as Airflow is beneficial. Excellent communication skills, confident engaging with senior stakeholders. Proactive, results-driven, and comfortable working in a fast-paced environment. ...

including managing dependencies and build pipelines without internet access Proven background building APIs for data enrichment services Orchestration & data pipeline experience with Prefect or Airflow, and K8s or Swarm Configuration and automation of business workflow tooling (e.g., Jira) Hands-on experience with a range of databases and storage technologies ...

AI. Comfortable working in a fast-paced, agile environment. Excellent communication and collaboration skills. Nice to Have Experience with workflow orchestration tools (e.g., Temporal, Airflow). Familiarity with vector databases or semantic search tools. Experience building internal tooling or developer productivity enhancements using AI. Exposure to customer support ...

Quantitative Developer, to come onto the desk and build trading tools and signal generation frameworks for the investment professionals. Stack: Python, Linux, Airflow The team has some excellent analysts and researchers, and they need an equally talented developer to come and build an array of tools and applications ...

What you'll be doing: Design, develop, and maintain scalable data architectures and ETL pipelines Build and manage data models and data warehouse solutions (Airflow, dbt, and Redshift) Write clean, efficient Python and SQL code for data processing and transformation Integrate data from internal and third-party APIs … principles Ability to optimise data pipelines for performance and maintainability Strong collaboration skills and a proactive, problem-solving mindset Bonus Points For Experience with Airflow and/or dbt Experience working in Agile environments (Scrum/Kanban) Exposure to DevOps practices or CI/CD pipelines You'll join ...

Senior Data Engineer (AWS, Airflow, Python) Based at client locations, working remotely, or based in our Godalming or Milton Keynes offices. Salary up to £65k plus company benefits. About Us Triad Group Plc is an award-winning digital, data, and solutions consultancy with over 35 years' experience primarily serving … maintain cloud data solutions. Maintain modular Terraform based IaC for reliable provisioning of AWS infrastructure. Develop, optimise and maintain robust data pipelines using Apache Airflow. Implement data transformation processes using Python to clean, preprocess, and enrich data for analytical use. Collaborate with data analysts, data scientists, developers, and other ...

deliver reliable, high-performance data solutions using Databricks and modern cloud technologies. Key Responsibilities Design, develop, and maintain scalable data pipelines using Databricks, Apache Spark, and Delta Lake Build and optimize ETL/ELT workflows for batch and streaming data Develop data models to support analytics, reporting, and machine … data pipelines, architectures, and best practices Required Qualifications 3+ years of experience in data engineering or a similar role Strong experience with Databricks and Apache Spark Proficiency in Python and SQL Experience with Delta Lake, data modeling, and performance tuning Hands-on experience with cloud platforms (AWS, Azure ...

looking for Extensive experience in data engineering, including time in a lead role Strong Python and SQL skills Experience with orchestration tools (Airflow, Dagster, Prefect) Hands-on dbt , AWS, and modern data warehouses Strong data modelling and architectural capability Background scaling data platforms in high-growth environments Nice … have Snowflake or Apache Iceberg Infrastructure-as-Code (Terraform) Observability-driven data systems Package & Benefits Salary up to £120,000 Fully remote working Home-office setup Private healthcare and income protection 25 days holiday + enhanced parental leave Strong learning and development budget ...

with engineers, architects, and product managers on data solutions. Support deployment, testing, and documentation of data products. Work with cloud-based tools, including BigQuery, Airflow, Terraform, DBT, and GIT. Continuously learn new tools and technologies, contributing to team knowledge and best practices. Key Skills & Experience: 1–3 years’ experience … roles. Strong SQL and Python skills. Exposure to cloud platforms (GCP preferred; Azure/AWS acceptable) . Familiarity with data tooling: DBT, GIT, Terraform, Airflow, Docker (nice to have). Good problem-solving skills, attention to detail, and collaborative mindset. Interested in Agile practices, Test-Driven Design, and modern ...

with engineers, architects, and product managers on data solutions. Support deployment, testing, and documentation of data products. Work with cloud-based tools, including BigQuery, Airflow, Terraform, DBT, and GIT. Continuously learn new tools and technologies, contributing to team knowledge and best practices. Key Skills & Experience: 1–3 years' experience … roles. Strong SQL and Python skills. Exposure to cloud platforms (GCP preferred; Azure/AWS acceptable) . Familiarity with data tooling: DBT, GIT, Terraform, Airflow, Docker (nice to have). Good problem-solving skills, attention to detail, and collaborative mindset. Interested in Agile practices, Test-Driven Design, and modern ...

Desired Skills (Bonus Points) Experience with MLOps tooling (MLflow, Kubeflow, Weights & Biases, or similar) Building data pipelines (real-time or batch) using tools like Apache Spark, Kafka, Airflow, or dbt Familiarity with recommender systems, transformers, or graph neural networks Exposure to model optimisation techniques (quantisation, distillation, efficient inference ...