2 of 2 Contract Spark Streaming Jobs in London

British Citizenship, or ILR (Indefinite Leave to Remain), or UK Settlement Visa. We do not provide visa sponsorship. Key Requirements: Must have skills: -Spark & Scala Nice to have skills: -Spark Streaming, Hadoop, -Hive, -SQL, -Sqoop, - Impala Detailed Job Description: At least 8+ years … fundamental Data Structures and their usage At least 8+ years of experience in designing and developing large scale, distributed data processing pipelines using Apache Spark and related technologies. Having expertise in Spark Core, Spark SQL and Spark Streaming. Experience with Hadoop, HDFS ...

maintain cloud data assets using Azure Databricks, Synapse and Data Lake technologies. Deliver real-time data processing using Kafka, Event Hub and Spark Streaming. Establish and maintain data governance, quality frameworks and PHI/PII compliance. Collaborate with stakeholders to design and deploy a Power BI 'Master Dashboard … semantic modelling. Required Skills & Experience Extensive experience with Azure Databricks, Azure Data Factory, Synapse and Unity Catalog Strong proficiency in Python, PySpark and Spark SQL Demonstrated experience with high-frequency time-series data Expertise in Star Schema, Snowflake Schema and Lakehouse architectures Experience with Great Expectations, Grafana ...