1 of 1 Contract Apache Spark Jobs in the West Midlands

Databricks Engineer

Hiring Organisation
Intuition IT Solutions Ltd
Location
West Midlands, United Kingdom
Employment Type
Contract
Contract Rate
GBP Annual
Title: Databricks Engineer Location: Coventry UK (Hybrid) Employment type: contract (Inside Ir35) Job Description: Role: Configure Databricks Auto Loader or Apache Spark Structured Streaming to securely subscribe to the relevant SAP AEM topics. Develop the PySpark/SQL data pipelines to process the incoming JSON payloads through … Carry out data modelling in Databricks. Expose the Delta tables to the visualisation layer. Ensure that the data pipelines are optimised. Skillsets: Expert in Apache Spark Structured Streaming and Databricks Auto Loader. Fluent in PySpark and Databricks SQL. Proven experience building Databricks architecture patterns. Familiarity with Unity Catalog ...