3 of 3 Remote/Hybrid Apache Spark Jobs in West Yorkshire

structured data. Experience with batch and near real-time processing across multiple sources and targets. Practical capability with Azure Data Factory and Databricks or Spark, plus Azure Blob Storage or Azure Data Lake. Understanding of data modelling, data marts, metadata-driven development, data dictionaries and lineage. Experience delivering through ...

Building and maintaining data pipelines. Data modelling and warehousing fundamentals. dbt or similar modern transformation frameworks Experience with AWS data services. Exposure to Kafka, Spark, streaming data, or modern BI tools. Interest in AI, analytics engineering, and data products THE BENEFITS You will receive a salary ...

data architectures, including cloud-based and distributed systems. Strong proficiency in SQL and Python . Experience with data engineering and pipeline technologies such as Apache Airflow and Spark . Experience working with cloud platforms, particularly AWS and Azure . Knowledge of big data technologies and distributed data processing. ...