Databricks Engineer
- Hiring Organisation
- Intuition IT Solutions Ltd
- Location
- West Midlands, United Kingdom
- Employment Type
- Contract
- Contract Rate
- GBP Annual
Title: Databricks Engineer Location: Coventry UK (Hybrid) Employment type: contract (Inside Ir35) Job Description: Role: Configure Databricks Auto Loader or Apache Spark Structured Streaming to securely subscribe to the relevant SAP AEM topics. Develop the PySpark/SQL data pipelines to process the incoming JSON payloads through … Carry out data modelling in Databricks. Expose the Delta tables to the visualisation layer. Ensure that the data pipelines are optimised. Skillsets: Expert in Apache Spark Structured Streaming and Databricks Auto Loader. Fluent in PySpark and Databricks SQL. Proven experience building Databricks architecture patterns. Familiarity with Unity Catalog ...