2 of 2 Permanent PySpark Jobs in Worcestershire

Software Developer (SFIA 4) SC / Newcastle - CEA

Hiring Organisation
Peregrine
Location
Kidderminster, Worcestershire, West Midlands, United Kingdom
Employment Type
Permanent, Work From Home
mentoring junior engineers and promoting engineering best practices Skills & Experience: Understanding of data processing using Apache Spark Use of Python, SQL, and familiarity with PySpark Experience using Apache Airflow for task orchestration Understanding of EMR and reviewing output logs Use of Jupyter notebooks and/or Amazon Athena ...

Data Engineer

Hiring Organisation
SF Partners Admin
Location
Worcester, Worcestershire, West Midlands, United Kingdom
Employment Type
Permanent, Work From Home
Salary
£85,000
engineering within distributed systems Proven ability to build and optimise data pipelines at scale Solid Python skills with exposure to tools such as Spark, PySpark, and Hadoop Strong understanding of data ingestion and batch processing methodologies Experience with text or unstructured data is advantageous but not essential A hands ...