151 to 175 of 458 Apache Airflow Jobs in England

experience as a Data Engineer or Senior Data Engineer Expert-level Python development skills Extensive hands-on experience with Databricks in enterprise environments Strong Apache Spark and PySpark expertise Advanced SQL development and optimisation skills Experience designing and building large-scale ETL and data integration solutions Strong understanding … environments Exposure to risk, trading, treasury or regulatory data domains Experience with Kafka, streaming technologies or real-time data processing Databricks certifications Experience with Airflow, Databricks Workflows or similar orchestration tools CI/CD pipeline development and DevOps practices Docker and Kubernetes Experience supporting data science or machine learning ...

operating ETL/ELT pipelines and large‐scale data architectures. Deep hands‐on experience with modern data stacks — our tech includes Python, SQL, Snowflake, Apache Iceberg, AWS S3, PostgresDB, Airflow, dbt, and Apache Spark, deployed via AWS, Docker, and Terraform (experience with similar technologies is essential). ...

environments. Technical Skills: Experience building and operating ETL/ELT pipelines. Hands-on experience with modern data stacks — our tech includes Python, SQL, Snowflake, Apache Iceberg, AWS S3, PostgresDB, Airflow, dbt, and Apache Spark, deployed via AWS, Docker, and Terraform (experience with some of these or similar ...

operating ETL/ELT pipelines and large-scale data architectures. Deep hands‐on experience with modern data stacks — our tech includes Python, SQL, Snowflake, Apache Iceberg, AWS S3, PostgresDB, Airflow, dbt, and Apache Spark, deployed via AWS, Docker, and Terraform (experience with similar technologies is essential). ...

tooling, automated testing and reliable deployment processes. Startup Mindset: Proactive, resourceful and comfortable taking responsibility in a small, fast‐moving engineering team. Experience with Apache Airflow, Kubernetes, real‐time data platforms, AI/ML infrastructure, LLM agents, GPU infrastructure or financial‐market systems would be useful ...

validate transformations and trace data across platforms. Tooling/Delivery Methods Working knowledge of scheduling/orchestration tools such as Autosys and/or Apache Airflow (monitoring schedules, reruns, failure triage). Experience with CI/CD and release controls (Git, Harness, UrbanCode Deploy (UCD), Red Hat OpenShift ...

concepts, experience with LLMs, prompt engineering, or integrating AI capabilities into applications• Data Technologies – Experience with Kafka, PySpark, Parquet and Avro data formats, Apache Airflow for workflow management, or Streamlit for building interactive data applications• Advanced Data Management – Strong SQL design, query optimization, and database architecture expertise• Observability ...

data Experience with data visualization tools to create dashboards and reports Understanding of data engineering concepts (ETL, data pipelines) and automation tools such as Apache Airflow Familiarity with cloud based computing resources such as AWS Interviewing with Veeva We value your time and believe in a transparent hiring ...

collaborate with engineers, scientists and product teams to design and optimise data pipelines across our analytics platform. The ideal candidate has strong Python, Spark, Airflow and SQL skills, plus experience with Databricks or Snowflake on AWS, and familiarity with CI/CD and Terraform. Hybrid working within ...

still comfortable operating at a technical level. Ideally, you'll bring experience across: AWS including S3, EC2, Lambda and Glue Snowflake Python & SQL Airflow or similar ETL/orchestration tooling Streaming technologies such as Kinesis Data warehousing and data modelling CI/CD and modern engineering practices Building ...

data warehousing and data modelling knowledge Strong comminication skills. Nice to Have Experience with Claude Code or AI-assisted code conversion tools. Amazon MWAA (Airflow) experience. AWS Certifications. Experience working on large-scale legacy modernisation programmes. Please apply now - this hiring process should be expected to finish by next ...

related field, or equivalent proven experience in database and data pipeline development Hands-on experience with code-driven orchestration tools such as Dagster or Airflow Solid experience with relational databases and SQL, preferably PostgreSQL Strong Python and OOP skills Experience modelling data for transactional and analytical systems Strong debugging ...

technologies such as Terraform, Bicep, or Pulumi. Knowledge of monitoring and observability tooling such as Prometheus and Grafana. Experience with orchestration platforms including Dagster, Airflow, Prefect, or similar. BENEFITS The successful Senior MLOps Engineer will receive the following benefits: Salary between £75,000 - £85,000 - depending on experience ...

support critical systems Core Skills and Technologies Experience running distributed data and analytics systems at scale using tools such as Spark, Kafka, Trino or Airflow Strong Linux skills and proficiency in Python for automation and integration Familiarity with infrastructure as code, using Terraform or Ansible Deep understanding ...

workstreams or managing delivery teams. Working within highly regulated or public sector environments. Experience with technologies such as Databricks, Snowflake, Fabric, Spark, Data Factory, Airflow or dbt would be highly advantageous. Please note that SC Clearance is required for this position Apply now or send your CV directly ...

workstreams or managing delivery teams. Working within highly regulated or public sector environments. Experience with technologies such as Databricks, Snowflake, Fabric, Spark, Data Factory, Airflow or dbt would be highly advantageous. Please note that SC Clearance is required for this position Apply now or send your CV directly ...

workstreams or managing delivery teams. Working within highly regulated or public sector environments. Experience with technologies such as Databricks, Snowflake, Fabric, Spark, Data Factory, Airflow or dbt would be highly advantageous. Please note that SC Clearance is required for this position Apply now or send your CV directly ...

workstreams or managing delivery teams. Working within highly regulated or public sector environments. Experience with technologies such as Databricks, Snowflake, Fabric, Spark, Data Factory, Airflow or dbt would be highly advantageous. Please note that SC Clearance is required for this position Apply now or send your CV directly ...

Arrow, plus an analytical engine, e.g. DuckDB, or a warehouse such as Snowflake. Orchestrated batch pipelines you've operated, not just written: Dagster or Airflow, S3-based data flows, and a habit of testing outputs for correctness rather than only for exceptions. Applied ML in production: embeddings and semantic ...

scalable data assets that can be used in BI and other user facing tools. Experience working with data pipeline orchestration tools like Prefect or Airflow and comfortable working with Python for data orchestration. Ability to communicate clearly with both technical and non-technical stakeholders, translating data into business value. ...

wait to be told what to analyze next. Nice to Have Experience in crypto, payments, banking, fraud, or compliance. Familiarity with dbt, Airflow, or similar data-stack tooling. Exposure to causal inference (difference-in-differences, propensity scoring, uplift modeling). Experience deploying models to production (batch or real-time ...

orchestration It would be nice if you could bring (desirables): Professional experience with PySpark, MySQL, Docker, Kubernetes Experience with best-practice pipeline orchestration software (Airflow, Dagster). Experience migrating code from prototype notebooks to .py, while maintaining logic and transparency of underlying code Owned a project across a whole ...

languages and database querying languagesExperience in large-scale data processing, microservices, API design, Kafka, Redis, MemCached, Observability tools (Dynatrace, Splunk, Grafana), and Orchestration tools (Airflow, Temporal)Proficiency in automation, continuous delivery methods, and all aspects of the Software Development Life CycleAdvanced understanding of agile methodologies, CI/CD, application ...

manipulation and transformationSQL: ability to write complex SQL that runs efficiently especially on cloud data platforms (E.g. Snowflake)Orchestration: Proficiency with orchestration tools (E.g. Airflow)DataOps: Experience with git & CI/CD, and appreciation of FinOpsCloud: Proficiency with cloud services (ideally AWS)Agile ways of working: Understanding of Agile ...

database querying languages Experience in large-scale data processing, microservices, API design, Kafka, Redis, MemCached, Observability tools (Dynatrace, Splunk, Grafana), and Orchestration tools (Airflow, Temporal) Demonstrated experience leading effective use of enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, code review, test acceleration ...