51 to 75 of 221 Apache Airflow Jobs

technologies . You will be utilising and playing with tools across the entire data ecosystem. 🚀Essential tech skills include proficiency in Python, Spark, and Airflow , alongside experience with major data platforms such as Snowflake, Databricks, and BigQuery . 🚀Familiarity with data transformation and infrastructure as code tools like ...

modern data warehouse such as Snowflake, Redshift, or BigQuery. Experience building and maintaining ETL pipelines and data models. Knowledge of orchestration tools such as Airflow or Dagster. Infrastructure-as-code experience such as Terraform or similar. A background working in smaller, high-growth companies or strong engineering-led environments. ...

while contributing to best practices across the wider platform. You'll be working heavily with Python , SQL and Spark , using tools such as Databricks , Airflow , dbt and Kafka within AWS . Experience with modern data stacks is important, along with a solid understanding of data warehousing concepts, ETL/ ...

peer to peer feedback and evolving healthy, curious and humble teams. Tech Stack: Python, Javascript/Typescript, React/React Native, AWS, GraphQL, Snowflake, Airflow, DDD. This is an incredible opportunity for a Senior Software Engineer to join a unique company as they embark on a period of significant ...

cloud data platforms (AWS, Azure or GCP) Exposure to big data technologies (Hadoop, Spark, Kafka) Familiarity with ETL/orchestration tools (e.g. Informatica, Talend, Airflow) Experience with API integration and microservices data flows Familiarity with AI/ML data pipelines or analytics platforms Experience using UML/SysML Security ...

where priorities evolve and things aren’t always fully specified Nice to Have (Not Essential) Experience with modern data platforms (e.g. Databricks, Snowflake, dbt, Airflow, Foundry) Some exposure to backend development or API design TypeScript experience Familiarity with enterprise systems (ERP, CRM, etc.) Exposure to AI-enabled systems , generative ...

where priorities evolve and things aren't always fully specified Nice to Have (Not Essential) Experience with modern data platforms (e.g. Databricks, Snowflake, dbt, Airflow, Foundry) Some exposure to backend development or API design TypeScript experience Familiarity with enterprise systems (ERP, CRM, etc.) Exposure to AI-enabled systems, generative ...

databases Ideally you will have experience with some of the following technology that is also in the tech stack: data pipeline orchestration tools (e.g. Airflow, Prefect, Dagster), cloud data platforms (e.g. AWS, S3, Glue, Athena, Redshift, Kinesis), data warehouse concepts and dimensional modelling, data streaming tools (e.g. Kafka, Kinesis ...

Testing). Familiarity with C++ or Go is a significant plus. Tooling & Orchestration: Deep experience with containerization (Docker, Kubernetes) and orchestration tools like Kubeflow, Airflow, or Metaflow. Cloud Architecture: Expertise in deploying ML workloads on AWS, GCP, or Azure, utilizing managed services like SageMaker or Vertex AI. Data Foundations ...

Required Data Integration & Ingestion Data Manipulation & Processing GitHub, GitHub Actions, Azure DevOps Azure Data Factory Databricks SQL Database Azure Synapse Stream Analytics AWS Glue Apache Airflow AWS Kinesis Amazon Redshift SonarQube PyTest Optional/Nice to Have Experience managing projects or running Scrum teams Experience with BPC/ ...

Location: London, UK (3 Days/Week Onsite) Type: Fixed Term Contract (6 Months) Mandatory Skills Needed : SQL ( Advanced) , AWS Cloud (Glue,Ethena,EMR), Airflow, Kafka/Kenesis ,Python, Terraform DBT & Snowflake (Basic) AWS Data Engineer Design, develop, and maintain data pipelines for collecting, transforming, and loading data into ...

analytics Fraud, AML, or transaction monitoring models ☁️ Cloud platforms (AWS, GCP, Azure) Experimentation & optimisation frameworks ⚙️ Typical Tech Stack Python • SQL • Spark • AWS/GCP • Airflow • Tableau/Power BI • Git 🚀 Why Join Work with large-scale behavioural datasets unique to iGaming Direct commercial impact on product & trading decisions Fast ...

commercial experience working as a Data Engineer in AWS. Solid programming skills in Python and strong SQL capability. Exposure to orchestration tools such as Airflow or Dagster. Experience with modern data warehouses such as Snowflake, Redshift or BigQuery. Infrastructure-as-code experience, ideally Terraform or Pulumi. BENEFITS The successful ...

commercial experience working as a Data Engineer in AWS. Solid programming skills in Python and strong SQL capability. Exposure to orchestration tools such as Airflow or Dagster. Experience with modern data warehouses such as Snowflake, Redshift or BigQuery. Infrastructure-as-code experience, ideally Terraform or Pulumi. BENEFITS The successful ...

commercial experience working as a Data Engineer in AWS. Solid programming skills in Python and strong SQL capability. Exposure to orchestration tools such as Airflow or Dagster. Experience with modern data warehouses such as Snowflake, Redshift or BigQuery. Infrastructure-as-code experience, ideally Terraform or Pulumi. BENEFITS The successful ...

commercial experience working as a Data Engineer in AWS. Solid programming skills in Python and strong SQL capability. Exposure to orchestration tools such as Airflow or Dagster. Experience with modern data warehouses such as Snowflake, Redshift or BigQuery. Infrastructure-as-code experience, ideally Terraform or Pulumi. BENEFITS The successful ...

understanding ML pipelines and models in a production setting. Direct experience with Google Cloud Platform, BigQuery, and associated tooling. Experience with workflow tools like Airflow or Kubeflow. Familiarity with dbt (Data Build Tool). Please send your CV for more information on these roles. Reasonable Adjustments: Respect and equality ...

platforms in a cloud-native environment (AWS, GCP, or Azure). Deep understanding of modern data stacks (e.g. Snowflake/BigQuery/Redshift, dbt, Airflow, BI tools. Comfort operating at both strategic and hands-on levels. Track record of partnering with non-technical stakeholders and influencing at exec level. ...

platforms in a cloud-native environment (AWS, GCP, or Azure). Deep understanding of modern data stacks (e.g. Snowflake/BigQuery/Redshift, dbt, Airflow, BI tools. Comfort operating at both strategic and hands-on levels. Track record of partnering with non-technical stakeholders and influencing at exec level. ...

behavioural data (web, apps, ads, etc.) Awareness of privacy and governance considerations Familiarity with AWS-based data stacks (S3, Spark/EMR, Athena, Airflow, notebooks) How you'll work Hybrid role, Manchester-based 2 days per week in the office, the rest flexible Flexible start and finish times Full ...

behavioural data (web, apps, ads, etc.) Awareness of privacy and governance considerations Familiarity with AWS-based data stacks (S3, Spark/EMR, Athena, Airflow, notebooks) How you'll work Hybrid role, Manchester-based 2 days per week in the office, the rest flexible Flexible start and finish times Full ...

/lending/risk/portfolio datasets Time series familiarity (trend/seasonality, cohorts over time, monitoring) Experience with data tools such as dbt, Airflow, Snowflake/BigQuery/Databricks (or similar) Experience creating automated data quality frameworks or reconciliation checks Benefits: £45,000 – £55,000 salary Hybrid working ...

mindset, with openness to feedback and diverse perspectives. Bonus points if you have the following. Experience building and maintaining production-grade data pipelines (e.g. Airflow, Dagster) or integrating data from APIs, web scraping, or third-party providers. Familiarity with cloud environments such as Google Cloud or AWS, and deploying ...

mindset, with openness to feedback and diverse perspectives. Bonus points if you have the following. Experience building and maintaining production-grade data pipelines (e.g. Airflow, Dagster) or integrating data from APIs, web scraping, or third-party providers. Familiarity with cloud environments such as Google Cloud or AWS, and deploying ...

other engineers What we are looking for Strong experience in Python and Linux Experience in Python data processing pipelines such as Dagster or Apache Airflow Knowledge of security, encryption and compliance standards for AS networks Experience building and maintaining bespoke Docker containers Experience using server-less AWS cloud ...