26 to 50 of 114 Apache Airflow Jobs in the UK

Expertise: Strong understanding of AWS services (e.g., Lambda, Step Functions, ECS). • Data Platforms: Hands-on experience with Snowflake and data stack technologies like Apache Iceberg and Spark. • Workflow Orchestration: Exposure to tools like Apache Airflow, Prefect, Dagster, or DBT. • Data Services: Familiarity with AWS Glue, Lake ...

Glue or EKS Hands on experience with modern analytics stacks such as Snowflake, dbt and Iceberg Familiarity with orchestration tools such as Dagster or Airflow Strong understanding of data modelling concepts and analytics best practice A software engineering mindset, including Git, testing and CI/CD workflows What They ...

Glue or EKS Hands on experience with modern analytics stacks such as Snowflake, dbt and Iceberg Familiarity with orchestration tools such as Dagster or Airflow Strong understanding of data modelling concepts and analytics best practice A software engineering mindset, including Git, testing and CI/CD workflows What They ...

Glue or EKS Hands on experience with modern analytics stacks such as Snowflake, dbt and Iceberg Familiarity with orchestration tools such as Dagster or Airflow Strong understanding of data modelling concepts and analytics best practice A software engineering mindset, including Git, testing and CI/CD workflows What They ...

with a strong focus on ETL/ELT. • Advanced SQL and Python development skills. • Hands-on experience with DBT, GIT, Terraform, Docker, IAM, and Airflow (Composer). • Proven experience working on cloud platforms – ideally GCP (BigQuery), but Azure or AWS also considered. • Strong understanding of Data Mesh, Test Driven ...

building and deploying machine learning and AI solutions in production. Hands‐on experience with: Python (PyTorch, TensorFlow, scikit‐learn) Data engineering tools (SQL, Spark, Airflow or similar) LLMs, NLP, and document intelligence (e.g. RAG, embeddings) Experience with cloud platforms (AWS, Azure, or GCP). Understanding of MLOps , CI/ ...

Software Developer Permanent | Hybrid (willing to travel to Newcastle) | Python | Apache | Data | SC cleared Hybrid work arrangement. Office attendance is up to 60%. Location is flexible: London, Leeds, Newcastle, Sheffield, Blackpool, Manchester and Birmingham. You must be willing to travel to Newcastle when required. The Role … looking for Software Developers with strong Python and data processing with Apache Spark responsible to lead the design, development, and operation of data-driven applications and pipelines in a collaborative Dev and DevOps environment. The role focuses on writing and improving application code while working closely with DevOps engineers ...

1classification ) Strong SQL&Python Hands-onETL/ELTexperience(e.g.,Matillion,Talend,Fivetran,ADF) Experiencewith Snowflake (AWS/Azure/GCPbeneficial) Strongdatamodellingknowledge Understandingofdatagovernanceandsecuritybestpractices Abilitytotranslatebusinessneedsintoscalablesolutions Desirable Airflow,dbt,Kafka,CI/CD,BItools,governanceplatforms,financialservicesexperience. Interestedinbuildingmodern,enterprise-scaledataplatformsinahighlyregulatedenvironment Applynow ...

successful Senior Data Engineer will have the following skills and experience: Strong Python and SQL skills AWS or GCP (NOT Azure) Orchestration, ideally with Airflow or Dagsta but open to others Data warehousing - Snowflake, Redshift, BigQuery (NOT Databricks) Terraform BENEFITS The successful Senior Data Engineer will receive the following ...

successful Senior Data Engineer will have the following skills and experience: Strong Python and SQL skills AWS or GCP (NOT Azure) Orchestration, ideally with Airflow or Dagsta but open to others Data warehousing - Snowflake, Redshift, BigQuery (NOT Databricks) Terraform BENEFITS The successful Senior Data Engineer will receive the following ...

Ability to create clean, structured datasets for reporting and analytics Comfortable working in a fast-paced, evolving data environment Nice to Have Experience with Airflow or Dagster Working with JSON/semi-structured data Familiarity with CI/CD pipelines and Git Why Join Work with high-volume, real ...

Glue or EKS Hands on experience with modern analytics stacks such as Snowflake, dbt and Iceberg Familiarity with orchestration tools such as Dagster or Airflow Strong understanding of data modelling concepts and analytics best practice A software engineering mindset, including Git, testing and CI/CD workflows What They ...

Glue or EKS Hands on experience with modern analytics stacks such as Snowflake, dbt and Iceberg Familiarity with orchestration tools such as Dagster or Airflow Strong understanding of data modelling concepts and analytics best practice A software engineering mindset, including Git, testing and CI/CD workflows What They ...

performance marketing data Experience working on large-scale data transformation or platform modernisation projects Tech Stack Warehouse: Snowflake Transformation: dbt BI: Looker Orchestration: Airflow Version Control: GitHub Other Tools: Adverity, OpenMetadata, Jira, Confluence Benefits Hybrid working (minimum of 3 days per week in office) 25 days annual leave plus ...

checks across migration and ingestion pipelines. Optimize SQL queries and data processing performance (indexing, partitioning, tuning). Use orchestration and automation tools such as Airflow and Terraform. Apply data security and governance standards (GDPR, ISO 27001, NIST, PCI-DSS) using AWS features like IAM and KMS. Collaborate with stakeholders ...

/T-SQL with proven experience refactoring and optimising complex logic Hands-on experience with cloud data warehouses (e.g. BigQuery, Snowflake), ingestion tools (Airflow, Airbyte), and analytics tooling such as dbt and Power BI Strong working knowledge of Git/version control, CI/CD pipelines, and Python ...

Azure, or Google Cloud) including data lakes, warehouses, and lakehouse solutions. Transform and process structured and unstructured data using modern ETL/ELT frameworks (Apache Spark, Airflow, dbt). Collaborate closely with product managers, analysts, and software developers to ensure seamless integration and high-quality data availability. Develop ...

with Python-based development workflows and tooling Technology Stack: Azure Cloud Services C# (.NET 10) Python React.js and modern JavaScript (ES6+) Snowflake (Data Warehouse) Apache Airflow Terraform dbt SQL Server ...

with Python-based development workflows and tooling Technology Stack: Azure Cloud Services C# (.NET 10) Python React.js and modern JavaScript (ES6+) Snowflake (Data Warehouse) Apache Airflow Terraform dbt SQL Server ...

experience with Time Series Forecasting, Sequence Modelling, Signal Processing or Quantitive Analysis Proficient in Python and SQL. Experience with frameworks like PyTorch, Spark, or Airflow is highly desirable. Familiarity with AWS (SageMaker, Lambda) and CI/CD automation. Strong understanding of MLOps, data versioning, and quality management What ...

Data Engineer within GCP environments Hands-on experience with BigQuery, Dataflow and Spanner Strong programming capability in Python, Java or Scala Experience with Apache Beam/Dataflow and distributed processing frameworks Experience designing and managing ETL/ELT pipelines Solid understanding of data modelling and database design Experience with … workflow orchestration tools such as Apache Airflow Strong understanding of data governance, security and scalability Desirable Skills for the GCP Data Engineer: Experience with Pub/Sub, Cloud Composer or Cloud Data Fusion Exposure to CI/CD, DevOps and Infrastructure as Code Experience with real-time streaming ...

Experience working within cloud environments (AWS or Azure) Strong SQL skills and experience working with large-scale datasets Familiarity with orchestration tools such as Airflow or similar Good understanding of data modelling and distributed data processing concepts Comfortable working across multiple client environments and stakeholders 🎁 What’s on Offer ...

Snowflake best practices for data ingestion and transformation. Enhancing performance and query optimisation, ensuring cost-effective and high-performing workloads. Working with dbt and Airflow to transform raw data into structured datasets for analytical consumption. Creating clear documentation to communicate technical processes to non-technical teams. KEY SKILLS ...

market behaviours that drive them, and the operational trade lifecycle. Strong expertise in relational databases and SQL. Proficiency with technologies such as S3, Kafka, Airflow, or Iceberg. Demonstrated experience managing large, complex financial datasets sourced from multiple vendors. Confidence working with a team that is newer to these asset ...

projects are approached and ensuring delivery standards are upheld Designing and governing scalable pipelines using BigQuery, Dataflow, Datastream, Data Fusion, Dataproc and Cloud Composer (Airflow) Leading best practice across dbt, Terraform, Docker and CI/CD Driving Data Mesh adoption, domain ownership, and interoperable data products Setting modelling standards ...