76 to 100 of 449 Apache Airflow Jobs in England

Redshift), and data transformation tools (such as dbt). Pipeline mastery: Practical experience building and operating batch or streaming pipelines using orchestration tools like Airflow, Prefect, or Dagster. Strong communicator: Skilled at writing clear technical specifications and explaining complex trade-offs to both technical and non-technical colleagues. Growth ...

automated testing and data quality practice. A collaborative mindset and a genuine interest in building things well. Desirable Experience with orchestration tools such as Airflow, Dagster, Prefect or Azure Data Factory. Experience working within AWS, Azure, GCP or another enterprise cloud ecosystem. Experience with complex customer, transactional, digital ...

data modelling Python, Git, Docker ETL pipelines and data platforms Relational database engines, including PostgreSQL and DuckDB Orchestration (e.g. Step Functions, Airflow) AI-accelerated development workflows and tools including Claude Code and Codex AWS cloud infrastructure, including Lambda and ECS End-to-end data pipeline testing strategy and implementation ...

pipelines. Knowledge graphs, ontologies, RDF, linked data or advanced semantic technologies. Databricks or cloud architecture/data-engineering certification. Tools such as dbt, Kafka, Airflow, Terraform, Power BI, Tableau, Collibra or Microsoft Purview. Architecture across multiple products, domains or business units in B2B software, information services, consulting or regulated ...

maintaining scalable data platforms. Strong SQL and data modelling skills, with experience designing analytical datasets. Experience with modern data stack tools (e.g. dbt, Spark, Airflow, or similar orchestration and transformation frameworks). Experience with cloud‐based data platforms, ideally AWS. Understanding of medallion architecture or similar data layering approaches. ...

statistical & analytical skills (e.g. sampling methods), attention to detail, and a proactive empirical mindsetFamiliarity with data modelling & modern data tech stack tools such as Airflow, dbt, Kafka, Iceberg, Trino, Superset etc. Familiarity with some data visualization tools (Tableau, QlikSense, Power BI, or similar) to communicate quality insightsFamiliarity with ...

formats like Parquet. MLOps Exposure: Experience with tools and frameworks for training, tracking, deploying, and monitoring models in production (e.g., MLflow, Optuna, Prefect, or Airflow). Background in supply chain forecasting, enterprise AI, or retail analytics M.S. or Ph.D. in Computer Science, Artificial Intelligence, Statistics, Data Science ...

certifications are a plus!). Containerization: Familiarity with Docker or the concept of containerized applications. Data Tools: Exposure to any data processing tools like Airflow, Kafka, or Spark. Infrastructure as Code: A desire to learn tools like Terraform/Terragrunt. Financial Tech Interest: An interest in Open Banking ...

frameworks for large-scale batch and near real-time processing, with hands-on experience using orchestration and transformation technologies such as Airflow and dbt. Strong knowledge of software engineering best practices, including coding standards, code reviews, testing strategies, version control systems such as Git, and CI/CD processes. ...

relational databases (e.g., PostgreSQL, DuckDB). Experience with the modern data stack, building data ingestion pipelines and working with ETL and orchestration tools (e.g., Airflow, Luigi, Argo, dbt), big data technologies (Spark, Kafka, Parquet), and web frameworks for model serving (e.g. Flask or FastAPI). Data Science: Familiarity ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern ...

tooling, or cloud cost management across at least one major cloud provider (Azure, AWS, or GCP). Technical Skills Data engineering: strong proficiency with Apache Spark, dbt, Airflow/Azure Data Factory or equivalent orchestration, Data Lake/Apache Iceberg, and advanced SQL for large‐scale transformations. ...

similar language. Proficiency in database technologies (SQL, NoSQL, time-series databases) and data modelling. Strong understanding of data pipeline orchestration tools (e.g., Apache Airflow, Kubernetes). You thrive when working as part of a team Comfortable in a fast-paced environment Have excellent written and verbal English skills ...

with using and integrating BI tools such as QuickSight, Looker, Power BI, Tableau Business Intelligence (BI) knowledge/experience Knowledge on tools like Terraform, Airflow, DBT and Harness Modern data engineering practises The environment is that of Facebook or Google, relaxed open with time to think and make ...

workflows Skills and experience: Passionfor building scalable, resilient cloud data platforms Strongexperience with Databricks or Snowflake on AWS ProvenPython skills, including Spark and Airflow expertise AdvancedSQL skills and end‐to‐end data modelling experience Experiencebuilding batch and real-time data integrations Hands-onCICD skills with Git, Jenkins or similar ...

Strong Python and SQL skills, with experience building production-grade data pipelines Data Platform Experience: Hands-on experience with modern data tools (e.g. Snowflake, Airflow, dbt) and cloud environments (preferably AWS) Engineering Best Practice: Knowledge of CI/CD, testing, version control and infrastructure as code Data Quality & Governance ...

experience with AWS data and cloud services, including designing secure, scalable, and cost-effective production architectures. Experience designing and orchestrating production workflows with Airflow or comparable tools. Cloud infrastructure experience in AWS, Azure, or Google Cloud. Strong understanding of data modeling, large-scale dataset performance, time-series data ...

MarTech, and marketing teams to align data solutions with business needsRequirementsStrong SQL skills and experience with ETL/ELT and pipeline orchestration tools (e.g., Airflow, dbt, Data Factory)Experience with cloud data platforms (e.g., Azure, AWS, or GCP)Proficiency in data modelling (dimensional, entity-relationship, event-driven)Understanding ...

marketing teams to align data solutions with business needs Requirements Strong SQL skills and experience with ETL/ELT and pipeline orchestration tools (e.g., Airflow, dbt, Data Factory) Experience with cloud data platforms (e.g., Azure, AWS, or GCP) Proficiency in data modelling (dimensional, entity-relationship, event-driven) Understanding ...

/T-SQL with proven experience refactoring and optimising complex logic Hands-on experience with cloud data warehouses (e.g. BigQuery, Snowflake), ingestion tools (Airflow, Airbyte), and analytics tooling such as dbt and Power BI Strong working knowledge of Git/version control, CI/CD pipelines, and Python ...

analyse large datasets and communicate insights effectively. Experience with LLMs, generative AI, and prompt engineering. Knowledge of MLOps tools and frameworks (MLflow, Kubeflow, Airflow). Familiarity with SQL, NoSQL, and distributed data technologies. Experience deploying AI models in production environments. Publications, patents, or open-source contributions in ML/ ...

technical roadmap for data engineering across Elliptic. Leverage and deploy AI and agentic systems to operate more effectively. Tech environment Scala | Spark | Databricks | AWS | Airflow | Kubernetes | Terraform | Functional Programming You will thrive here if you Enjoy end‐to‐end ownership, from writing the code to architecture design to coaching ...

consulting experience within BFSI, leading complex enterprise transformations. Platform Expertise: Deep technical proficiency in modern data platforms (Databricks, Snowflake) and toolsets (dbt, Airflow, Kafka). Advanced Architecture & AI: Mastery of Lakehouse, Data Mesh, Streaming, MLOps, and GenAI integration to drive continuous innovation. Governance & Compliance: Expertise in zero-trust security ...