SC CLEARED Azure Databricks Technical Consultant
- Hiring Organisation
- Focus Cloud Limited
- Location
- Reading, Berkshire, United Kingdom
- Employment Type
- Contract
- Contract Rate
- GBP 85 - 90 Hourly
unstructured data from multiple sources, including telemetry, operational datasets, OSINT and SOCMINT. Key Responsibilities Design, build and maintain scalable data pipelines using Azure Databricks, Spark/PySpark and Azure Data Lake Storage Ingest, transform and process large volumes of structured, semi-structured and unstructured data from multiple sources Develop … Excellent Python/PySpark and SQL data engineering skills Strong experience designing and developing ETL/ELT and large-scale data pipelines Experience with Apache Spark and Databricks Lakehouse architectures Strong knowledge of Azure Data Lake Storage (ADLS) Experience integrating Databricks with wider Azure data and analytics services ...