3 of 3 Apache Spark Jobs in the Midlands

Ecosystem (Preferred/Good to Have) Azure data services experience in one or more: Azure Synapse Analytics/Dedicated SQL Pools Azure Databricks/Spark ADLS Gen2, Azure SQL DB, Managed Instance Event Hub/Kafka, Stream Analytics (if real-time involved) Monitoring & observability: Azure Monitor, Log Analytics, Application ...

integration. Proficiency with Databricks for data processing and analytics. Working knowledge of NodeJS would be an added advantage. Solid programming skills in Python , PySpark, Spark . Candidate must be adept at working with large-scale datasets , S3 , Python , and data cataloguing tools . Familiarity with data engineering best practices ...

engineering across ingestion, transformation and data centralisation. Experience with tools such as Glue, Fivetran, Kafka, Dataflow, ADF or Kinesis. Transformation experience using dbt, Spark or Databricks. Confidence working directly with clients and engaging in technical discussions. Exposure to dashboards, analytics, ML or LLM concepts is beneficial, but not essential. ...