76 to 100 of 194 Apache Airflow Jobs in England

cloud-native platforms in AWS and/or GCP.Experience designing and supporting data pipelines within complex technical environments.Familiarity with workflow orchestration tools such as Airflow, Prefect or Dagster.Experience implementing monitoring, logging, observability and platform governance practices.Strong understanding of software engineering principles, testing and deployment best practices.Ability to work collaboratively ...

Python and SQL, familiarity with Scala or R advantageous Experience with data orchestration and workflow management tooling such as Azure Data Factory or Airflow Please see full job description attached. What you can expect from us We believe doing your best work starts with feeling supported both professionally ...

your personal data: roberthalf.com/gb/en/privacy-notice.RequirementsSolution Architect, Credit Risk, Pre-sales, AI, AI Enablement, Artificial Intelligence, GCP, Azure, AWS, Airflow, MicrosoftJob typeContractingIndustryFinancial Services ...

languages and database querying languagesExperience in large-scale data processing, microservices, API design, Kafka, Redis, MemCached, Observability tools (Dynatrace, Splunk, Grafana), and Orchestration tools (Airflow, Temporal)Proficiency in automation, continuous delivery methods, and all aspects of the Software Development Life CycleAdvanced understanding of agile methodologies, CI/CD, application ...

SaaS business models and B2B channel structuresTechnical Mastery: A background in Analytics, Business Intelligence or Data Science (SQL, Python, AI-driven development, dbt, Airflow)Snowflake is growing fast, and we’re scaling our team to help enable and accelerate our growth. We are looking for people who share ...

improvementRequirementsAdvanced SQL, ETL/ELT frameworks, and cloud data platforms such as Azure, AWS, or GCPData modelling and pipeline orchestration using tools such as Airflow, Data Factory, dbt, or similarIntegrate CDP data sources across digital, CRM, transactional, and behavioural data; support identity resolution, consent handling, audience activation, journey events ...

labeling workflowsFamiliarity with ML frameworks (e.g., PyTorch, TensorFlow)Experience with CI/CD tools and processesExperience with data pipelines and orchestration tools (e.g., Airflow, Metaflow)Familiarity with MLOps practices (model monitoring, drift, deployment checks)Experience with ML evaluation methods, metrics, and benchmarkingPassion for learning new technologies and improving existing ...

with data validation tooling (e.g., Great Expectations) or labeling workflowsFamiliarity with ML frameworks (e.g., PyTorch, TensorFlow)Experience with data pipelines and orchestration tools (e.g., Airflow, Metaflow)Knowledge of MLOps practices (e.g., model monitoring, drift detection, deployment validation)Knowledge of ML evaluation methods, metrics, and benchmarkingPassion for learning new technologies ...

labeling workflowsFamiliarity with ML frameworks (e.g., PyTorch, TensorFlow)Experience with CI/CD tools and processesExperience with data pipelines and orchestration tools (e.g., Airflow, Metaflow)Familiarity with MLOps practices (model monitoring, drift, deployment checks)Experience with ML evaluation methods, metrics, and benchmarkingPassion for learning new technologies and improving existing ...

labeling workflowsFamiliarity with ML frameworks (e.g., PyTorch, TensorFlow)Experience with CI/CD tools and processesExperience with data pipelines and orchestration tools (e.g., Airflow, Metaflow)Familiarity with MLOps practices (model monitoring, drift, deployment checks)Experience with ML evaluation methods, metrics, and benchmarkingPassion for learning new technologies and improving existing ...

with data validation tooling (e.g., Great Expectations) or labeling workflowsFamiliarity with ML frameworks (e.g., PyTorch, TensorFlow)Experience with data pipelines and orchestration tools (e.g., Airflow, Metaflow)Knowledge of MLOps practices (e.g., model monitoring, drift detection, deployment validation)Knowledge of ML evaluation methods, metrics, and benchmarkingPassion for learning new technologies ...

labeling workflowsFamiliarity with ML frameworks (e.g., PyTorch, TensorFlow)Experience with CI/CD tools and processesExperience with data pipelines and orchestration tools (e.g., Airflow, Metaflow)Familiarity with MLOps practices (model monitoring, drift, deployment checks)Experience with ML evaluation methods, metrics, and benchmarkingPassion for learning new technologies and improving existing ...

labeling workflowsFamiliarity with ML frameworks (e.g., PyTorch, TensorFlow)Experience with CI/CD tools and processesExperience with data pipelines and orchestration tools (e.g., Airflow, Metaflow)Familiarity with MLOps practices (model monitoring, drift, deployment checks)Experience with ML evaluation methods, metrics, and benchmarkingPassion for learning new technologies and improving existing ...

with data validation tooling (e.g., Great Expectations) or labeling workflowsFamiliarity with ML frameworks (e.g., PyTorch, TensorFlow)Experience with data pipelines and orchestration tools (e.g., Airflow, Metaflow)Knowledge of MLOps practices (e.g., model monitoring, drift detection, deployment validation)Knowledge of ML evaluation methods, metrics, and benchmarkingPassion for learning new technologies ...

languages and database querying languagesExperience in large-scale data processing, microservices, API design, Kafka, Redis, MemCached, Observability tools (Dynatrace, Splunk, Grafana), and Orchestration tools (Airflow, Temporal)Demonstrated experience leading effective use of enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, code review, test ...

skills.Experience designing and implementing batch and stream data processing systems.Experience with Datadog, SQL, Terraform, Docker, AWS (ECS, Kinesis, SQS, Cloudwatch), GCP (BigQuery).Knowledge of Airflow, Kafka, Flink, dbt, Kubernetes is highly beneficial.Good understanding of AI platforms, experience building the infrastructure for LLM orchestration (e.g., Vector DBs, RAG pipelines ...

Data Scientists use (we don't expect applicants to have experience with all of these):Python and Databricks for Data Science, Spark, MLFlow and Airflow for ML Workflows, Google Cloud Platform for our analytics infrastructure, dbt and BigQuery for data modelling and warehousing.Discover more about our Analytics Community ...

necessary infrastructure, resources, and interfaces to enable data loading and LLM workflows.Use Python/Java and large-scale data workflow orchestration platforms e.g. Airflow to construct software artifacts for ETL, interfacing with diverse data formats and storage technologies, and incorporate them into robust data workflows and dynamic systemsWhat ...

necessary infrastructure, resources, and interfaces to enable data loading and LLM workflows.Use Python/Java and large-scale data workflow orchestration platforms e.g. Airflow to construct software artifacts for ETL, interfacing with diverse data formats and storage technologies, and incorporate them into robust data workflows and dynamic systemsWhat ...

observability practices in dbt or similar frameworks.PreferredVisualization: Experience structuring data for BI tools such as Tableau, focusing on scalability and performance.Ingestion & Orchestration: Familiarity with Airflow, or similar tools for data ingestion and orchestration.Reverse ETL: Working knowledge of tools like Hightouch for operationalizing insights back into business systems (e.g., Salesforce ...

knowledge in the following:PythonAWSKubernetesSpark & distributed computingdbtTerraformData Warehousing (we use Databricks but experience with other platforms is fine)MLOps implementation (desirable but not required)Airflow (or other orchestration tooling)GovernanceWhy else you'll love it hereð Wondering what the salary for this role is? Just ...

applying DevSecOps practices within cloud or controlled environments Exposure to large language models or generative AI systems Experience with data engineering tools (e.g. Spark, Airflow, Databricks) Experience applying AI and automation to operational or productivity-focused use cases Experience working in secure, restricted, or air-gapped environments Experience supporting ...

models, schemas to support business requirementsDevelop and maintain data ingestion and processing systems using various tools and technologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc.Implement data storage solutions using different types of databases, such as relational, non-relational, or cloud-based.Working collaboratively with the client and cross …/Azure SQL, PostgreSQL) You have framework experience within either Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc.Data acquisition and development of data sets and improving data ...

pipelines, and well-governed data products.Job responsibilitiesDesign and implement batch and streaming data pipelines using Databricks (Spark), Delta Lake, and orchestrators (e.g., Workflows, Airflow, ADF).Develop and optimize Spark jobs (PySpark/Scala) and SQL transformations for performance, reliability, and cost efficiency.Build and maintain curated data models (bronze/… development and automation capabilities, to improve the value realized by automationRequired qualifications, skills and capabilitiesExperience with building data pipelines on Databricks and/or Apache Spark in production.Strong coding skills in Python (PySpark) and SQL (Scala a plus).Hands-on experience with Delta Lake (MERGE/UPSERT patterns, schema ...

Databricks-based Lakehouse that drives real-time data, analytics, and reporting across the Tote.You’ll build streaming and batch data pipelines on AWS using Apache Spark Structured Streaming, Delta Live Tables (DLT), and Kafka (MSK), ensuring our business teams across Liquidity, Product, Marketing, Finance, and Compliance have fast, trusted … looking for:We’re looking for an experienced Data Engineer with proven expertise in building pipelines in Databricks and a strong grasp of Apache Spark, whether in PySpark or Scala, including Structured Streaming. You should have experience with Kafka (MSK) and real-time data ingestion, as well ...