2 of 2 Permanent Apache Jobs in Berkshire

architectural strategies, blueprints for hybrid and cloud-native solutions ELT/ETL Frameworks & Pipelines Essential Develop robust ELT/ETL pipelines using tools like Apache Airflow, DBT, AWS Glue, Azure Data Factory, or Kafka Connect. Desirable Optimize data transformations for performance, reusability, and modular design (e.g., using SQL/ ...

across batch and streaming workloads. Skilled in building and maintaining data-streaming pipelines (e.g., Kafka, Spark Streaming, or equivalent). Proficiency with Databricks and Apache Spark for large-scale data processing. Experience with Hadoop and/or wider Apache ecosystem tools (e.g., Kafka, NiFi, Airflow). Strong understanding … multi-national environments. Key Responsibilities: Design, build, and optimise data ingestion, transformation, and integration pipelines. Implement scalable processing frameworks using Databricks, Spark, Hadoop, and Apache technologies. Develop and support real-time and near-real-time data-streaming pipelines for engineering and operational data. Integrate engineering datasets across ...