2 of 2 Permanent Spark SQL Jobs in Tyne and Wear

more of: GCP, Azure, AWS. An intermediate or better level coding in one or more mainstream coding languages (i.e., Python, SQL, Java, Scala, and R), and critically review the code of other data engineers. Develop code for a range of data products including data matching, rule development, scans … date with these. Typical Data Engineering Experience required (5+ yrs): Knowledge and experience of Azure/AWS Cloud data solution provision. Proficient in SQL . Ability to develop and deliver complex visualisation, reporting and dashboard solutions using tools like Power BI . Enterprise-scale experience with ETL tools ...

cloud-based data pipelines for ingesting, transforming, and storing large volumes of data. Implement scalable, fault-tolerant systems using modern frameworks such as Spark, Temporal, Airflow o r Dagster . Develop APIs and services that expose reliable data access, transformation, and orchestration capabilities. Contribute to geospatial data processing … applications. Desired Qualifications: 3-5years of experience in data engineering, ideally working with large-scale or geospatial systems. Proficiency in Python and SQL (Spark SQL preferred); experience with distributed data processing frameworks such as Spark, Flink, or Beam. Familiarity with orchestration ...