301 to 325 of 476 Apache Airflow Jobs in the UK

Axiom (plus) and regulatory reporting flows (plus) Excellent communication; proven stakeholder engagement Ability to learn/adapt to new technologies Skilled PySpark, HDFS, SQL, Airflow, data modeling, and ETL processing. Familiarity with GitLab and Jupyter Notebook is preferred, and knowledge of Java will be considered an added advantage. ...

tools such as make and CMake, and automated build systems such as spack or easybuild Experience with workflow orchestration tools such as Argo Workflow, Airflow, Nextflow, Snakemake, VisTrails, or Cromwell Experience with application performance tuning and optimization in parallel and distributed computing, including MPI, OpenMP, or Gloo Deep understanding ...

tools (Git), Fluent English – for international communication and collaboration. Nice to have: Experience with LLMs, or Time Series, Familiarity with tools like Docker, MLflow, Airflow, AWS/GCP/Azure, Background in research or R&D, Experience working in cross-functional or international teams. Soft Skills: Curiosity and problem ...

agile methodologies such as CI/CD, Applicant Resiliency, and Security, Jules, Jenkins, Git/Stash Preferred qualifications, capabilities, and skills Knowledge of Airflow, Data Mesh architecture Experience with data analysis #J-18808-Ljbffr ...

degree, preferably in Computer Science, Engineering, Mathematics, or similar technical discipline. Nice to Have Snowflake SQL expertise. AWS Cloud experience – including EC2 & S3. Airflow/MWAA or equivalent job scheduler experience. Kubernetes, EKS, Lambda, or serverless experience in AWS. Personal Attributes Team player with strong analytical and problem‐solving ...

similar databases. Experience designing data models, schemas and transformation layers for complex datasets. Experience with directed acyclic graph–based orchestration tools such as Airflow, Dagster, Prefect or similar systems. Familiarity with data warehouses, object storage, queues, APIs and cloud infrastructure. Experience with data quality testing, lineage, observability, versioning ...

product partners Preferred Qualifications, Capabilities, and Skills Experience building agentic tools and AI agents that support engineering workflows in production environments Experience with Airflow ABOUT US J.P. Morgan is a global leader in financial services, providing strategic advice and products to the world's most prominent corporations, governments, wealthy ...

product partners Preferred Qualifications, Capabilities, and Skills Experience building agentic tools and AI agents that support engineering workflows in production environments Experience with Airflow ABOUT US J.P. Morgan is a global leader in financial services, providing strategic advice and products to the world's most prominent corporations, governments, wealthy ...

track record of delivering impact Desirable: Experience with GenAI/LLM evaluation, AI safety, prompt engineering, experimentation frameworks or data pipeline technologies such as Airflow or Dagster. What we’ll provide you This is a unique role that will put you in the position to be part ...

understanding of functional paradigms and type theory. Confident JVM knowledge. Modern programming languages knowledge in our primary languages (Java, Python, Clojure). Experience with Airflow or other Python‐based workflow orchestration tools. Proficiency in domain‐driven design and domain modeling. Exposure to Kubernetes, Docker, Linux, Kafka, RabbitMQ, or git. ...

monitoring infrastructure that catches drift and quality degradation before business KPIs move. You'll work on a GCP-native stack — Vertex AI, BigQuery, dbt, Airflow, and Terraform — on problems that matter from day one, with the autonomy to shape how the function scales and who joins it next. ...

Batch, ECS, EKS, S3, RDS or Postgres, Athena, SageMaker, Bedrock, or equivalent services. Scientific workflow and data orchestration frameworks such as Nextflow, Dagster, Airflow or similar. Platform security, privacy or governance controls for sensitive biomedical or clinical data. Identity platforms and federation technologies such as Entra ...

with expertise in Python and experience building reusable tooling and platform services. Experience with modern platform and engineering tooling such as GitHub Actions, Apigee, Airflow, and related cloud‐native technologies. Expertise with observability platforms such as Data Dog, Prometheus, Grafana, ELK, Splunk or equivalent, including monitoring, logging, tracing, reliability ...

data storytelling. A Data Architect: You have a high bar for data quality and have experience working within modern data stacks (e.g BigQuery, dbt, Airflow) What’s in it for you: A range of flexible working options to dedicate time to what matters to you Competitive compensation package + ...

Batch, ECS, EKS, S3, RDS or Postgres, Athena, SageMaker, Bedrock, or equivalent services. Scientific workflow and data orchestration frameworks such as Nextflow, Dagster, Airflow or similar. Platform security, privacy or governance controls for sensitive biomedical or clinical data. Identity platforms and federation technologies such as Entra ...

data storytelling. A Data Architect: You have a high bar for data quality and have experience working within modern data stacks (e.g BigQuery, dbt, Airflow) What’s in it for you: Competitive compensation package + bonus 25 days holiday per year, increasing to 28 days after 2 years ...

integration with enterprise systems. Data Engineering & Platforms Ability to build and maintain data pipelines ingestion, transformation, serving, and monitoring using tools such as Airflow, Kafka, dbt, or equivalents. Working familiarity with modern data platforms (Snowflake, Databricks, BigQuery, or similar), including data modeling and performance fundamentals. Strong debugging instincts with ...

practices (Git, CI/CD, testing frameworks, type-hinting, code reviews); and can build scalable, maintainable solutionsNice-to-have skills: Experience with DevOps tools (Airflow, Kubernetes, Terraform, GCP), data integration/ETL and pipeline optimization, or reinforcement learning algorithmsCustomer collaborator: Comfortable working directly with clients and cross-functional teams ...

cloud‐native data architecture (AWS/GCP/Snowflake). Architect and implement scalable ingestion and transformation pipelines using Fivetran, Databricks, and Airflow/DBT. Design and code modular data services and APIs that unify campaign, conversion, and audience datasets across 20+ marketing platforms. Build and optimize schemas, transformations … Hands‐on experience as a Data Engineer or Data Platform Developer, including direct contributions to production codebases. Expert‐level proficiency in Python, SQL, and Apache Spark for data pipeline development. Proven experience building ELT workflows using Fivetran, Airflow, DBT, or Databricks. Solid understanding of data modeling, dimensional design ...

platformsAdvanced Python and SQL skills, with experience in modern engineering practices such as CI/CD and TDDExperience with big data frameworks such as Apache Spark or similar technologiesSolid understanding of data modelling, data warehousing, OLTP and data lake architecturesExperience working with cloud ecosystems such as AWS, Azure … GCPFamiliarity with tools such as Kafka, Airflow, Hive, Delta, or similar technologiesStrong understanding of software engineering principles and production supportExperience with Linux, containerisation and enterprise scheduling toolsKnowledge of data governance, security and data privacy principles including GDPRConfident communicator, able to present complex technical concepts to varied audiencesA proactive, self ...

files, webhooks and event streams; Shape the engineering approach across Google Cloud Platform, including BigQuery, Cloud Storage, Pub/Sub, Datastream, Cloud Composer/Airflow, Terraform and infrastructure‐as‐code; Set and champion engineering standards for data modelling, dbt transformations, testing, monitoring, documentation, deployment, version control and cost optimisation … production‐ready data solutions Strong experience with cloud data warehouses, ideally BigQuery, and working knowledge of the wider Google Cloud Platform ecosystem Experience with Airflow/Cloud Composer, dbt, Git/GitHub, CI/CD and Terraform or other infrastructure‐as‐code tooling Understanding of data modelling, dimensional modelling ...

transaction data.• Develop reusable transformation models and curated datasets in Snowflake and dbt for analytics and operational use cases.• Orchestrate complex dependencies with Airflow, Dagster, or a comparable workflow platform.• Design data models and interfaces that are clear, scalable, and easy for downstream teams to use.Raise reliability and data … modern cloud data platform, plus practical knowledge of dimensional and analytical data modeling.• Production experience with dbt or a comparable transformation framework and with Airflow, Dagster, Prefect, or similar orchestration tooling.• Experience with AWS data services and cloud storage; equivalent experience on another major cloud platform is welcome. ...

Hybrid : London or Manchester - 2 days per week. This role requires the ability to hold an active security clearance. Skills : Python and SQL . Apache Airflow for DAG orchestration and monitoring. AWS data services: Redshift , OpenSearch , Lambda , Glue , Step Functions , Batch . CI/CD pipelines and YAML ...

Hybrid : London or Manchester - 2 days per week. This role requires the ability to hold an active security clearance. Skills : Python and SQL . Apache Airflow for DAG orchestration and monitoring. AWS data services: Redshift , OpenSearch , Lambda , Glue , Step Functions , Batch . CI/CD pipelines and YAML ...

years of experience working in version control environments such as GitLab or GitHub; Have 2+ years of experience with job orchestration tools such as Apache Airflow as both a pipeline developer and reviewer; Have 2+ years of experience with data ingestion and transformation frameworks such as dbt, Fivetran ...