101 to 125 of 475 Apache Airflow Jobs in the UK

Following Distributed computing technologies such as Spark and Databricks Cloud platforms including AWS, Azure, or GCP Workflow orchestration tools such as Airflow CI/CD, version control, and infrastructure as code Experience within financial services, consulting, or risk environments What’s on Offer Opportunity to make an impact from ...

Areas Such As KYC AML Transaction Monitoring Screening Risk Ratings Compliance Case Management Strong data governance, lineage and data quality experience Experience with dbt, Airflow, Azure Data Factory, Dagster or similar tooling CI/CD, Git and modern engineering practices Strong stakeholder engagement and communication skills #J-18808-Ljbffr ...

Senior Data Engineer: Passionfor building scalable, resilient cloud data platforms Strongexperience with Databricks or Snowflake on AWS ProvenPython skills, including Spark and Airflow expertise AdvancedSQL skills and end-to-end data modelling experience Experiencebuilding batch and real-time data integrations Hands-onCICD skills with Git, Jenkins or similar Abilityto ...

areas such as: KYC AML Transaction Monitoring Screening Risk Ratings Compliance Case Management Strong data governance, lineage and data quality experience Experience with dbt, Airflow, Azure Data Factory, Dagster or similar tooling CI/CD, Git and modern engineering practices Strong stakeholder engagement and communication skills Why Apply? Opportunity ...

/ELT, and various database technologies. Technical Versatility: Fluency in data processing languages (Python, SQL, PySpark) and openness to tech stacks such as SSIS, Airflow, Spark, Databricks, Fabric. Cloud Capability: Experience with at least one major cloud provider (AWS, Azure, or Google Cloud) and curiosity to learn others. Bridging ...

automated testing and data quality practice. A collaborative mindset and a genuine interest in building things well. Desirable Experience with orchestration tools such as Airflow, Dagster, Prefect or Azure Data Factory. Experience working within AWS, Azure, GCP or another enterprise cloud ecosystem. Experience with complex customer, transactional, digital ...

field. Strong SQL skills and a good understanding of data modelling principles. Experience with data transformation tools (e.g. dbt, Spark) and workflow orchestration (e.g. Airflow or similar). Familiarity with cloud-based data platforms, ideally AWS. Understanding of data pipeline design and ETL/ELT patterns. Exposure to streaming ...

Kubernetes Spark & distributed computing dbt Terraform Data Warehousing (we use Databricks but experience with other platforms is fine) MLOps implementation (desirable but not required) Airflow (or other orchestration tooling) Governance Why else you'll love it here Wondering what the salary for this role is? Just ...

maintaining scalable data platforms. Strong SQL and data modelling skills, with experience designing analytical datasets. Experience with modern data stack tools (e.g. dbt, Spark, Airflow, or similar orchestration and transformation frameworks). Experience with cloud‐based data platforms, ideally AWS. Understanding of medallion architecture or similar data layering approaches. ...

formats like Parquet. MLOps Exposure: Experience with tools and frameworks for training, tracking, deploying, and monitoring models in production (e.g., MLflow, Optuna, Prefect, or Airflow). Background in supply chain forecasting, enterprise AI, or retail analytics M.S. or Ph.D. in Computer Science, Artificial Intelligence, Statistics, Data Science ...

frameworks for large-scale batch and near real-time processing, with hands-on experience using orchestration and transformation technologies such as Airflow and dbt. Strong knowledge of software engineering best practices, including coding standards, code reviews, testing strategies, version control systems such as Git, and CI/CD processes. ...

just how fast. We expect you to enjoy leveraging AI and agentic systems to operate more effectively. Tech environmentScala | Spark | Databricks | AWS | Claude | Airflow | Kubernetes | Terraform | Functional ProgrammingYou will thrive here if youEnjoy end-to-end ownership, from writing the code to architecture design to coaching others through delivery. ...

formats like Parquet. MLOps Exposure: Experience with tools and frameworks for training, tracking, deploying, and monitoring models in production (e.g., MLflow, Optuna, Prefect, or Airflow). Desirable Background in supply chain forecasting, enterprise AI, or retail analyticsM.S. or Ph.D. in Computer Science, Artificial Intelligence, Statistics, Data Science ...

experienced with modern cloud data platforms such as BigQuery, Snowflake, or Databricks. You've worked with data orchestration tools such as Dagster, Airflow, or Prefect. We use Dagster. You're comfortable owning cloud infrastructure. You can work with infrastructure-as-code such as Terraform and own the infrastructure your ...

senior or lead-level technical role. Deep expertise in Google Cloud Platform: BigQuery, Dataflow, Pub/Sub, Cloud Storage, and Cloud Composer (Airflow) as the primary data platform stack. Advanced Python and SQL skills, including writing performant, production grade code and conducting rigorous code reviews. Proven experience designing ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real-time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern ...

operating ETL/ELT pipelines and large-scale data architectures. Hands-on experience with modern data stacks — our tech includes Python, SQL, Snowflake, Apache Iceberg, AWS S3, PostgresDB, Airflow, dbt, and Apache Spark, deployed via AWS, Docker, and Terraform (experience with similar technologies is essential).Ability ...

tooling, or cloud cost management across at least one major cloud provider (Azure, AWS, or GCP). Technical Skills Data engineering: strong proficiency with Apache Spark, dbt, Airflow/Azure Data Factory or equivalent orchestration, Data Lake/Apache Iceberg, and advanced SQL for large‐scale transformations. ...

similar language. Proficiency in database technologies (SQL, NoSQL, time-series databases) and data modelling. Strong understanding of data pipeline orchestration tools (e.g., Apache Airflow, Kubernetes). You thrive when working as part of a team Comfortable in a fast-paced environment Have excellent written and verbal English skills ...

Experience with cloud platforms (AWS, GCP, or Azure) Knowledge of data warehousing concepts and tools (Snowflake, BigQuery, Redshift) Experience with ETL tools (Airflow, dbt, or similar) Familiarity with version control (Git) and CI/CD practices What We Offer Competitive salary based on experience 25 days annual leave plus ...

with using and integrating BI tools such as QuickSight, Looker, Power BI, Tableau Business Intelligence (BI) knowledge/experience Knowledge on tools like Terraform, Airflow, DBT and Harness Modern data engineering practises The environment is that of Facebook or Google, relaxed open with time to think and make ...