2 of 2 Apache Spark Jobs in Scotland

orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law. Job Description: We are looking for an experienced Java/Spark/Scala Developer to join our team in Glasgow . The ideal candidate will have strong hands-on development experience in Java, Apache Spark, and Scala , with a passion for building scalable, high-performance data processing applications. Knowledge of AI/ML concepts will be considered a strong advantage. Key Responsibilities Design, develop, and maintain scalable applications using Java, Scala, and Apache Spark Build and optimize large-scale data ...

validation (e.g., schema tests, data quality checks). Manage data documentation and lineage within DBT. Design and develop scalable data pipelines using Databricks and Apache Spark. Build and optimize data workflows for batch and real-time processing. Transform and process large datasets using PySpark, SQL, and Delta Lake. Implement … terraform enterprise , Snowflake terraform provider knowledge. Snowflake : Snow sight , Python SDK for snowflake , Stage , storage integration , Data marketplace , direct shares , listings , catalog linked database , Apache Iceberg , external tables , Catalog integrations , Snowpipe , external volume , Cortex ai ,privatelink. Airflow : Dag creation , operators , connections , deployment on Kubernetes , Astronomer. DBT. ...