2 of 2 Remote PySpark Jobs in Scotland

and data stores to support organizational requirements. Skills/Qualifications: 4+ years of experience developing data pipelines and data warehousing solutions using Python and libraries such as Pandas, NumPy, PySpark, etc. 3+ years hands-on experience with cloud services, especially Databricks, for building and managing scalable data pipelines 3+ years of proficiency in working with Snowflake or similar cloud More ❯

Data Factory or equivalent cloud ETL tools, with experience building scalable, maintainable pipelines is essential. Extensive experience as a senior data or integrations engineer. Hands on experience on Python, Pyspark or Spark in an IDE. Data Bricks highly preferred. Proven track record in complex Data Engineering environments, including data integration and orchestration. Experience integrating external systems via REST APIs More ❯