301 to 325 of 365 Apache Airflow Jobs

how data flows through everything they build. What You’ll Do Build and own data pipelines that connect product, analytics, and operations Design scalable architectures using tools like dbt , Airflow , and Snowflake/BigQuery Work with engineers and product teams to make data easily accessible and actionable Help evolve their data warehouse and ensure high data quality and reliability … ML-ready datasets Influence technical decisions across the stack — they love new ideas What You Bring Hands-on experience in Python and SQL Experience with modern data tools (dbt, Airflow, Prefect, Dagster, etc.) Knowledge of cloud platforms like AWS , GCP , or Azure An understanding of data modelling and ETL best practices Curiosity, creativity, and a mindset that thrives in More ❯

be doing: Managing and maintaining a Python-based data warehouse , ensuring reliable data ingestion and transformation. Developing and monitoring data pipelines using Meltano and orchestration tools like Dagster or Airflow . Designing and optimising SQL transformations (DBT experience a plus). Working within Azure cloud infrastructure following Infrastructure-as-Code (IaC) principles. Managing Power BI semantic models , DAX measures … data stack for ETL/ELT processes and data warehousing. Strong SQL and Python skills, with an understanding of Kimball-style data modelling . Experience with DBT, Dagster, or Airflow for transformation and orchestration. Hands-on experience with Azure (preferred), or other cloud environments (GCP/AWS). Familiarity with Git-based version control , CI/CD, and DevOps More ❯

be doing: Managing and maintaining a Python-based data warehouse , ensuring reliable data ingestion and transformation. Developing and monitoring data pipelines using Meltano and orchestration tools like Dagster or Airflow . Designing and optimising SQL transformations (DBT experience a plus). Working within Azure cloud infrastructure following Infrastructure-as-Code (IaC) principles. Managing Power BI semantic models , DAX measures … data stack for ETL/ELT processes and data warehousing. Strong SQL and Python skills, with an understanding of Kimball-style data modelling . Experience with DBT, Dagster, or Airflow for transformation and orchestration. Hands-on experience with Azure (preferred), or other cloud environments (GCP/AWS). Familiarity with Git-based version control , CI/CD, and DevOps More ❯

to the statistical experimentation engine in a scalable and future-proof manner. What will you bring to the team? Dedication to Data Engineering such as Google Vertex AI pipelines, Airflow/DBT Proficiency in Python for engineering applications Experience with setting up, deploying, and managing cloud infrastructure using Infrastructure as Code (Terraform). Strong application of engineering best practices … across the product development lifecycle, including automated testing, CI/CD, and code reviews. Comfortable working with various technologies across the software and data engineering stack, including Airflow, Vertex AI, Kubernetes, Docker, GitHub Actions, Jenkins, Google Cloudbuild, Prometheus, and Grafana. Solid experience in cloud data storage , with particular expertise in Google BigQuery (GBQ), GCS/S3 Demonstrable ability to More ❯

teams (Data Scientists, Quality, Manufacturing, IT) to define data requirements and deliver reliable data solutions. Develop and maintain ETL/ELT workflows using modern orchestration and integration tools (e.g., Airflow, Fivetran, or similar). Implement data governance, lineage, and documentation best practices. Support business intelligence tools (e.g., Tableau, Power BI) by ensuring data accessibility and consistency. Continuously evaluate emerging … hands-on experience with: Snowflake (architecture, performance tuning, cost optimisation) DBT (model development, testing, documentation, deployment) SQL (advanced query optimisation and debugging) Experience with data integration and orchestration tools (Airflow, Dagster, Prefect, or similar). Familiarity with cloud data platforms (AWS, Azure, or GCP). Contract: Initial 6-month contract Hybrid - 1 day per week on-site in London More ❯

management to analyze and improve our business processes Conduct workload and complexity assessments Design, plan and implement new efficient software solutions in Python and Go Maintain and enhance our Airflow data pipelines Improve observability and scalability to support our constantly growing client base Continuously adapt to changing requirements in a business driven environment Build and extend knowledge of financial … innate curiosity to learn new things Preferred qualifications Background in traditional finance or digital assets, ideally in trading domain Hands-on experience with Python libraries and frameworks (NumPy, Pandas, Airflow, FastAPI, Flask, SQLAlchemy) Highly proficient in asynchronous, event driven distributed systems Working knowledge of cloud-native architectures, GCP preferred Experience in Go and working with real-time data streams More ❯

management to analyze and improve our business processes Conduct workload and complexity assessments Design, plan and implement new efficient software solutions in Python and Go Maintain and enhance our Airflow data pipelines Improve observability and scalability to support our constantly growing client base Continuously adapt to changing requirements in a business driven environment Build and extend knowledge of financial … innate curiosity to learn new things Preferred qualifications Background in traditional finance or digital assets, ideally in trading domain Hands-on experience with Python libraries and frameworks (NumPy, Pandas, Airflow, FastAPI, Flask, SQLAlchemy) Highly proficient in asynchronous, event driven distributed systems Working knowledge of cloud-native architectures, GCP preferred Experience in Go and working with real-time data streams More ❯

Location: London – Hybrid (2-3 days/week onsite, plus client visits). Salary: From £90,000 + bonus, negotiable. Term: Permanent/Full-time (flexible working arrangements). About the Company Our client is a next-generation Data & AI More ❯

Location: London – Hybrid (2-3 days/week onsite, plus client visits). Salary: From £90,000 + bonus, negotiable. Term: Permanent/Full-time (flexible working arrangements). About the Company Our client is a next-generation Data & AI More ❯

Senior Data Engineer - FinTech Unicorn - Python, SQL, DBT, Airflow, AWS/GCP OB have partnered with a UK FinTech Unicorn, who's Data function is undergoing rapid growth, and in-turn are looking to grow their Data team, with 2 highly skilled Data Engineers. You'll be working on shaping the companies Data function, driving Data best practices, and … collaborate with a variety of stakeholders to ensure the company are making Data driven decisions. Senior Data Engineer - FinTech Unicorn - Python, SQL, DBT, Airflow, AWS/GCP Tech Stack: Python & SQL DBT, AirFlow & BigQuery AWS/GCP ETL Pipelines Base salary of £90k-£115k depending on skills and experience Excellent overall package including a sizeable bonus and stock … options Hybrid working in Central London You must be UK based, and sadly sponsorship is unavailable Senior Data Engineer - FinTech Unicorn - Python, SQL, DBT, Airflow, AWS/GCP More ❯

Senior Data Engineer - FinTech Unicorn - Python, SQL, DBT, Airflow, AWS/GCP OB have partnered with a UK FinTech Unicorn, who's Data function is undergoing rapid growth, and in-turn are looking to grow their Data team, with 2 highly skilled Data Engineers. You'll be working on shaping the companies Data function, driving Data best practices, and … collaborate with a variety of stakeholders to ensure the company are making Data driven decisions. Senior Data Engineer - FinTech Unicorn - Python, SQL, DBT, Airflow, AWS/GCP Tech Stack: Python & SQL DBT, AirFlow & BigQuery AWS/GCP ETL Pipelines Base salary of £90k-£115k depending on skills and experience Excellent overall package including a sizeable bonus and stock … working in Central London with 1-2 days a week required You must be UK based, and sadly sponsorship is unavailable Senior Data Engineer - FinTech Unicorn - Python, SQL, DBT, Airflow, AWS/GCP More ❯

Senior Data Engineer - FinTech Unicorn - Python, SQL, DBT, Airflow, AWS/GCP OB have partnered with a UK FinTech Unicorn, who's Data function is undergoing rapid growth, and in-turn are looking to grow their Data team, with 2 highly skilled Data Engineers. You'll be working on shaping the companies Data function, driving Data best practices, and … collaborate with a variety of stakeholders to ensure the company are making Data driven decisions. Senior Data Engineer - FinTech Unicorn - Python, SQL, DBT, Airflow, AWS/GCP Tech Stack: Python & SQL DBT, AirFlow & BigQuery AWS/GCP ETL Pipelines Base salary of £90k-£115k depending on skills and experience Excellent overall package including a sizeable bonus and stock … working in Central London with 1-2 days a week required You must be UK based, and sadly sponsorship is unavailable Senior Data Engineer - FinTech Unicorn - Python, SQL, DBT, Airflow, AWS/GCP More ❯

Senior Data Engineer - FinTech Unicorn - Python, SQL, DBT, Airflow, AWS/GCP OB have partnered with a UK FinTech Unicorn, who's Data function is undergoing rapid growth, and in-turn are looking to grow their Data team, with 2 highly skilled Data Engineers. You'll be working on shaping the companies Data function, driving Data best practices, and … collaborate with a variety of stakeholders to ensure the company are making Data driven decisions. Senior Data Engineer - FinTech Unicorn - Python, SQL, DBT, Airflow, AWS/GCP Tech Stack: Python & SQL DBT, AirFlow & BigQuery AWS/GCP ETL Pipelines Base salary of £90k-£115k depending on skills and experience Excellent overall package including a sizeable bonus and stock … working in Central London with 1-2 days a week required You must be UK based, and sadly sponsorship is unavailable Senior Data Engineer - FinTech Unicorn - Python, SQL, DBT, Airflow, AWS/GCP More ❯

Lead Data Engineer - Python, SQL, DBT, Airflow, BigQuery, AWS/GCP OB are partnered with a UK FinTech Unicorn, undergoing huge growth within their Data function, and are therefore looking for a Lead Data Engineer to join their Data team. This is a key role, where you'll be leading a team of up to 6 engineers, helping set … the technical direction, collaborating with a variety of stakeholders across the business, working on several exciting greenfield projects and scaling their data systems. Lead Data Engineer - Python, SQL, DBT, Airflow, BigQuery, AWS/GCP Key skills and experience: 2+ years of experience in a Leadership role Python/SQL DBT, BigQuery, Airflow AWS/GCP, Terraform Data warehousing … ETL Hybrid working with offices based in Central London Base salary of £120k-£140k + Bonus up to 15% and stock options Lead Data Engineer - Python, SQL, DBT, Airflow, BigQuery, AWS/GCP More ❯

Lead Data Engineer - Python, SQL, DBT, Airflow, BigQuery, AWS/GCP OB are partnered with a UK FinTech Unicorn, undergoing huge growth within their Data function, and are therefore looking for a Lead Data Engineer to join their Data team. This is a key role, where you'll be leading a team of up to 6 engineers, helping set … the technical direction, collaborating with a variety of stakeholders across the business, working on several exciting greenfield projects and scaling their data systems. Lead Data Engineer - Python, SQL, DBT, Airflow, BigQuery, AWS/GCP Key skills and experience: 2+ years of experience in a Leadership role Python/SQL DBT, BigQuery, Airflow AWS/GCP, Terraform Data warehousing … ETL Hybrid working with offices based in Central London Base salary of £120k-£140k + Bonus up to 15% and stock options Lead Data Engineer - Python, SQL, DBT, Airflow, BigQuery, AWS/GCP More ❯

Senior Data Engineer - Python, SQL, Airflow, Redshift, Snowflake I've partnered with a high-growth start-up looking to expand their Data function, by bringing on a Senior Data Engineer on a contract basis - more info below: Senior Data Engineer: Tech stack - Python, SQL, ETL Pipelines, Airflow, BigQuery, Redshift, Snowflake, AWS/GCP Experience with event-stream and … Modelling Hybrid working in Central London - Monday in the office is essential Pays £450-£500 p/d Outside IR35 3-month initial engagement Senior Data Engineer - Python, SQL, Airflow, Redshift, Snowflake More ❯

Senior Data Engineer - Python, SQL, Airflow, Redshift, Snowflake I've partnered with a high-growth start-up looking to expand their Data function, by bringing on a Senior Data Engineer on a contract basis - more info below: Senior Data Engineer: Tech stack - Python, SQL, ETL Pipelines, Airflow, BigQuery, Redshift, Snowflake, AWS/GCP Experience with event-stream and … Modelling Hybrid working in Central London - Monday in the office is essential Pays £450-£500 p/d Outside IR35 3-month initial engagement Senior Data Engineer - Python, SQL, Airflow, Redshift, Snowflake More ❯

Senior Data Engineer Tech Stack: Snowflake/DBT/Fivetran/Atlan/Airflow/Python Salary: £70,000 - £75,000 + 15% Bonus + 10% Pension Location: Milton Keynes - 1 day per month onsite This is a fantastic opportunity for a Senior Data Engineer to join a growing data function within a rapidly expanding financial services organisation. The … junior team members. The organisation is investing heavily in Snowflake, building an enterprise-wide Snowflake platform from the ground up. You'll be working with modern tools including DBT, Airflow, Atlan, Fivetran, and Tableau Cloud. With several AI use cases already identified, the team has started exploring Snowflake Cortex. With a strong commitment to becoming a data-centric organisation … a purpose-driven environment that values innovation, people, and progress. Experience Required: Proven experience in Data Engineering Must have hands-on experience with Snowflake Proficiency with DBT, Fivetran, Atlan, Airflow, and Python Desirable (but not essential): Experience in the financial services sector Familiarity with Tableau Cloud Exposure to Snowflake Cortex If you're interested and have most of the More ❯

Senior Data Engineer Tech Stack: Snowflake/DBT/Fivetran/Atlan/Airflow/Python Salary: 70,000 - 75,000 + 15% Bonus + 10% Pension Location: Milton Keynes - 1 day per month onsite This is a fantastic opportunity for a Senior Data Engineer to join a growing data function within a rapidly expanding financial services organisation. The … junior team members. The organisation is investing heavily in Snowflake, building an enterprise-wide Snowflake platform from the ground up. You'll be working with modern tools including DBT, Airflow, Atlan, Fivetran, and Tableau Cloud. With several AI use cases already identified, the team has started exploring Snowflake Cortex. With a strong commitment to becoming a data-centric organisation … a purpose-driven environment that values innovation, people, and progress. Experience Required: Proven experience in Data Engineering Must have hands-on experience with Snowflake Proficiency with DBT, Fivetran, Atlan, Airflow, and Python Desirable (but not essential): Experience in the financial services sector Familiarity with Tableau Cloud Exposure to Snowflake Cortex If you're interested and have most of the More ❯

models are learning, and improving, in production. 🧠 What You’ll Be Doing Architect and maintain real-time streaming data systems (Kafka, Kinesis, or Flink) Build robust feature pipelines using Airflow, Prefect, or Dagster Manage and optimise data storage solutions (Snowflake, BigQuery, Redshift, or Delta Lake) Automate and scale model training pipelines in close partnership with ML engineers Deploy, observe … across the platform 🧩 The Tech Environment You’ll likely be working with some combination of: Languages: Python, Scala, Go Streaming: Kafka/Flink/Spark Structured Streaming Workflow orchestration: Airflow/Prefect/Dagster Data storage & processing: Snowflake/Detabricks/BigQuery/Redshift Infrastructure: Docker/Kubernetes/Terraform/dbt Monitoring: Prometheus/Grafana/OpenTelemetry Cloud More ❯

models are learning, and improving, in production. 🧠 What You’ll Be Doing Architect and maintain real-time streaming data systems (Kafka, Kinesis, or Flink) Build robust feature pipelines using Airflow, Prefect, or Dagster Manage and optimise data storage solutions (Snowflake, BigQuery, Redshift, or Delta Lake) Automate and scale model training pipelines in close partnership with ML engineers Deploy, observe … across the platform 🧩 The Tech Environment You’ll likely be working with some combination of: Languages: Python, Scala, Go Streaming: Kafka/Flink/Spark Structured Streaming Workflow orchestration: Airflow/Prefect/Dagster Data storage & processing: Snowflake/Detabricks/BigQuery/Redshift Infrastructure: Docker/Kubernetes/Terraform/dbt Monitoring: Prometheus/Grafana/OpenTelemetry Cloud More ❯

platform, ensuring scalability, reliability, and security. Drive modernisation by transitioning from legacy systems to a lean, scalable platform. Act as a lead expert for technologies such as AWS, DBT, Airflow, and Databricks. Establish best practices for data modelling, ingestion, storage, streaming, and APIs. Governance & Standards Ensure all technical decisions are well-justified, documented, and aligned with business needs. Lead … in data engineering and cloud engineering, including data ingestion, transformation, and storage. Significant hands-on experience with AWS and its data services. Expert-level skills in SQL, Python, DBT, Airflow and Redshift. Confidence in coding, scripting, configuring, versioning, debugging, testing, and deploying. Ability to guide and mentor others in technical best practices. A product mindset, focusing on user needs More ❯

platform, ensuring scalability, reliability, and security. Drive modernisation by transitioning from legacy systems to a lean, scalable platform. Act as a lead expert for technologies such as AWS, DBT, Airflow, and Databricks. Establish best practices for data modelling, ingestion, storage, streaming, and APIs. Governance & Standards Ensure all technical decisions are well-justified, documented, and aligned with business needs. Lead … in data engineering and cloud engineering, including data ingestion, transformation, and storage. Significant hands-on experience with AWS and its data services. Expert-level skills in SQL, Python, DBT, Airflow and Redshift. Confidence in coding, scripting, configuring, versioning, debugging, testing, and deploying. Ability to guide and mentor others in technical best practices. A product mindset, focusing on user needs More ❯

and governance through robust access controls, including RBAC, SSO, token policies, and pseudonymisation frameworks. Develop resilient data flows for both batch and streaming workloads using technologies such as Kafka, Airflow, DBT, and Terraform. Shape data strategy and standards by contributing to architectural decisions, authoring ADRs, and participating in reviews, data councils, and platform enablement initiatives. What we’d love … requirements Direct exposure to cloud-native data infrastructures (Databricks, Snowflake) especially in AWS environments is a plus Experience in building and maintaining batch and streaming data pipelines using Kafka, Airflow, or Spark Familiarity with governance frameworks, access controls (RBAC), and implementation of pseudonymisation and retention policies Exposure to enabling GenAI and ML workloads by preparing model-ready and vector More ❯

Akkodis is a global leader in engineering, technology, and R&D, harnessing the power of connected data to drive digital transformation and innovation for a smarter, more sustainable future. As part of the Adecco Group, Akkodis combines the expertise of More ❯