3 of 3 Apache Spark Jobs in Reading

with strong Foundry depth). Proven, hands-on experience working with Palantir Foundry in a production environment. Strong proficiency in Python, SQL, PySpark and Spark SQL Experience delivering production pipelines in AWS, Azure, or GCP environments. Solid understanding of data modeling, schema design, metadata management, and governance. Familiarity with ...

unstructured data from multiple sources, including telemetry, operational datasets, OSINT and SOCMINT. Key Responsibilities Design, build and maintain scalable data pipelines using Azure Databricks, Spark/PySpark and Azure Data Lake Storage Ingest, transform and process large volumes of structured, semi-structured and unstructured data from multiple sources Develop … Excellent Python/PySpark and SQL data engineering skills Strong experience designing and developing ETL/ELT and large-scale data pipelines Experience with Apache Spark and Databricks Lakehouse architectures Strong knowledge of Azure Data Lake Storage (ADLS) Experience integrating Databricks with wider Azure data and analytics services ...

unstructured data from multiple sources, including telemetry, operational datasets, OSINT and SOCMINT. Key Responsibilities Design, build and maintain scalable data pipelines using Azure Databricks, Spark/PySpark and Azure Data Lake Storage Ingest, transform and process large volumes of structured, semi-structured and unstructured data from multiple sources Develop … Excellent Python/PySpark and SQL data engineering skills Strong experience designing and developing ETL/ELT and large-scale data pipelines Experience with Apache Spark and Databricks Lakehouse architectures Strong knowledge of Azure Data Lake Storage (ADLS) Experience integrating Databricks with wider Azure data and analytics services ...