4 of 4 Remote/Hybrid Apache Jobs in Fife

warehouses (BigQuery preferred, or Snowflake/Redshift). Strong experience with orchestration tools (Airflow, Dagster), ELT pipelines (Fivetran, dbt), and distributed data processing frameworks (Apache Spark, Flink). Hands-on experience using AI tools to accelerate engineering workflows - code generation, code review, pipeline debugging, or documentation Strong coding experience ...

platforms, ideally Microsoft Azure. Experience using technologies such as Spark, Databricks and data lake architectures. Knowledge of data storage and transformation formats such as Apache Parquet and Delta Lake. Experience with containerisation and orchestration technologies, including Docker and Kubernetes. Experience using Git/GitHub and working within collaborative development ...

. Good understanding of cloud environments (ideally Azure), distributed computing and scaling workflows and pipelines Understanding of common data transformation and storage formats, e.g. Apache Parquet. Awareness of data standards such as GA4GH ( ) and FAIR (). Experience with Spark, Databricks, data lakes. Follow best practices like code reviews, clean ...

with machine learning engineers on model development and deployment Desirable : Direct experience with elements of our technology stack (Azure IoT Edge, Azure Storage, dbt , Apache Iceberg, Trino, Dagster , Dask ) Experience with IoT data processing or edge computing environments Familiarity with time-series data and acoustic signal processing What ...