201 to 225 of 315 Apache Airflow Jobs in London

with expertise in Python and experience building reusable tooling and platform services. Experience with modern platform and engineering tooling such as GitHub Actions, Apigee, Airflow, and related cloud‐native technologies. Expertise with observability platforms such as Data Dog, Prometheus, Grafana, ELK, Splunk or equivalent, including monitoring, logging, tracing, reliability ...

data storytelling. A Data Architect: You have a high bar for data quality and have experience working within modern data stacks (e.g BigQuery, dbt, Airflow) What’s in it for you: Competitive compensation package + bonus 25 days holiday per year, increasing to 28 days after 2 years ...

practices (Git, CI/CD, testing frameworks, type-hinting, code reviews); and can build scalable, maintainable solutionsNice-to-have skills: Experience with DevOps tools (Airflow, Kubernetes, Terraform, GCP), data integration/ETL and pipeline optimization, or reinforcement learning algorithmsCustomer collaborator: Comfortable working directly with clients and cross-functional teams ...

cloud‐native data architecture (AWS/GCP/Snowflake). Architect and implement scalable ingestion and transformation pipelines using Fivetran, Databricks, and Airflow/DBT. Design and code modular data services and APIs that unify campaign, conversion, and audience datasets across 20+ marketing platforms. Build and optimize schemas, transformations … Hands‐on experience as a Data Engineer or Data Platform Developer, including direct contributions to production codebases. Expert‐level proficiency in Python, SQL, and Apache Spark for data pipeline development. Proven experience building ELT workflows using Fivetran, Airflow, DBT, or Databricks. Solid understanding of data modeling, dimensional design ...

platformsAdvanced Python and SQL skills, with experience in modern engineering practices such as CI/CD and TDDExperience with big data frameworks such as Apache Spark or similar technologiesSolid understanding of data modelling, data warehousing, OLTP and data lake architecturesExperience working with cloud ecosystems such as AWS, Azure … GCPFamiliarity with tools such as Kafka, Airflow, Hive, Delta, or similar technologiesStrong understanding of software engineering principles and production supportExperience with Linux, containerisation and enterprise scheduling toolsKnowledge of data governance, security and data privacy principles including GDPRConfident communicator, able to present complex technical concepts to varied audiencesA proactive, self ...

files, webhooks and event streams; Shape the engineering approach across Google Cloud Platform, including BigQuery, Cloud Storage, Pub/Sub, Datastream, Cloud Composer/Airflow, Terraform and infrastructure‐as‐code; Set and champion engineering standards for data modelling, dbt transformations, testing, monitoring, documentation, deployment, version control and cost optimisation … production‐ready data solutions Strong experience with cloud data warehouses, ideally BigQuery, and working knowledge of the wider Google Cloud Platform ecosystem Experience with Airflow/Cloud Composer, dbt, Git/GitHub, CI/CD and Terraform or other infrastructure‐as‐code tooling Understanding of data modelling, dimensional modelling ...

transaction data.• Develop reusable transformation models and curated datasets in Snowflake and dbt for analytics and operational use cases.• Orchestrate complex dependencies with Airflow, Dagster, or a comparable workflow platform.• Design data models and interfaces that are clear, scalable, and easy for downstream teams to use.Raise reliability and data … modern cloud data platform, plus practical knowledge of dimensional and analytical data modeling.• Production experience with dbt or a comparable transformation framework and with Airflow, Dagster, Prefect, or similar orchestration tooling.• Experience with AWS data services and cloud storage; equivalent experience on another major cloud platform is welcome. ...

Hybrid : London or Manchester - 2 days per week. This role requires the ability to hold an active security clearance. Skills : Python and SQL . Apache Airflow for DAG orchestration and monitoring. AWS data services: Redshift , OpenSearch , Lambda , Glue , Step Functions , Batch . CI/CD pipelines and YAML ...

years of experience working in version control environments such as GitLab or GitHub; Have 2+ years of experience with job orchestration tools such as Apache Airflow as both a pipeline developer and reviewer; Have 2+ years of experience with data ingestion and transformation frameworks such as dbt, Fivetran ...

infrastructure. Well versed and proven experience in programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem-solving skills and ability to work in a fast-paced environment. Excellent communication and collaboration skills. Longstanding experience ...

infrastructure. Well versed and proven experiencein programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem-solving skills and ability to work in a fast-paced environment. Excellent communication and collaboration skills. Longstanding experience ...

join our Data Engineering team in the UK. You will build and govern data infrastructure powering our platforms, using Python ingestion pipelines, Airflow orchestration, and Snowflake/Databricks to move data securely from source to decision-ready output. You will implement end-to-end ingestion sources, investigate ...

analytics and governance while promoting self-service insights for business users. Key skills include data lakehouse design (Iceberg), AWS/Azure data services, dbt, Airflow, and BI/dashboard experience. The role emphasizes automation, quality, and collaboration with architects. #J-18808-Ljbffr ...

Product-oriented approach focused on production outcomes; Comfortable owning ambiguity and making trade-offs; English; Nice to have: workflow orchestration tools such as Temporal, Airflow, or Step Functions; experience building internal tools or agents; familiarity with regulated or enterprise environments; exposure to MLOps or AI evaluation frameworks. Условия: Hybrid ...

improve platform reliability. Required Skills & Qualifications: Extensive hands-on experience with Google Cloud Platform , including BigQuery , GCS , IAM , and Kubernetes . Proficiency in Python, Airflow, dbt, and familiarity with Terraform and CI/CD pipelines. Experience with data governance tools like Alation , Fivetran , and Tableau . Strong understanding ...

production Solid software engineering skills (Python, APIs, systems) Good understanding of MLOps stack (CI/CD, monitoring, pipelines) Familiarity with tools like MLflow, Airflow, Evidently, DVC, Docker, Kubernetes. Cloud experience (AWS/GCP/Azure) Some mentoring/leadership experience + desire to grow into management Nice to have ...

results post-migration (before/after comparison) -Release management — experience managing releases in an enterprise environment Nice to have - Experience with other orchestration tools (Airflow, AWS Glue Workflows) - AWS certification (Solutions Architect/DevOps Engineer) - Knowledge of AWS Lambda, EventBridge (commonly used- alongside Step Functions) - Experience in financial domain ...

results post-migration (before/after comparison) Release management — experience managing releases in an enterprise environment Nice to have Experience with other orchestration tools (Airflow, AWS Glue Workflows) AWS certification (Solutions Architect/DevOps Engineer) Knowledge of AWS Lambda, EventBridge (commonly used alongside Step Functions) Experience in financial domain ...

integration and deployment Experience supporting production systems Experience with any of the following: gRPC microservices, Postgres, Pandas, Golang, R, Git, Jenkins, Bazel, Prometheus, Grafana, Airflow, Kubernetes Equal Opportunity EmployerThe the company Group is an Equal Opportunity employer. Applicants are considered without regard to race, color, religion, creed, national origin ...

happens next. Technical Mastery: You bring expert-level SQL skills and are fully comfortable building and maintaining your own robust data pipelines using dbt, Airflow, and Snowflake. Beyond querying, you use Python for advanced automation and forecasting, and you apply statistical rigor (e.g., Bayesian statistics, causal inference) to solve ...

narratives Entrepreneurial mentality: You can take work beyond the analysis and drive outcomes. Useful additional experience: Experience in Fintech domain Knowledge of utilities like Airflow/Github/DBT Experience with user-facing products and data Please note: we are not able to offer visa sponsorship for this role ...

focused on what works in production. Comfortable owning ambiguity and making trade-overs. Languages: English A plus, but not required: workflow orchestration tools (Temporal, Airflow, Step Functions); experience building internal tools or agents; familiarity with regulated or enterprise environments; exposure to MLOps or AI evaluation frameworks. Why Planet Planet ...

will include Design, build and maintain robust, scalable data pipelines that support data science workflows and advanced analytics use cases Develop and manage complex Airflow orchestration, ensuring pipelines are reliable, observable and maintainable Work hands-on with Databricks suite to deliver high-quality data engineering solutions for data science ...

understanding of data pipelines, databases and warehouses Experience reconciling data from multiple, heterogeneous sources Hands-on experience with orchestration and transformation tools such as Airflow, Dagster or dbt Familiarity with columnar data systems such as ClickHouse or DuckDB Experience with distributed systems and third-party integrations A pragmatic mindset ...

such as DDP or FSDP. Experience with observability tools such as Prometheus, Grafana, Datadog, or OpenTelemetry. Experience with data pipeline orchestration tools such as Airflow, Flyte, Ray, Metaflow, or Argo Workflows. Experience with containerisation and infrastructure tooling such as Docker, Kubernetes, or Terraform.Experience profiling or optimising ML systems ...