4 of 4 PySpark Jobs in the Thames Valley

Considerable experience designing and building operationally efficient pipelines, utilising core Cloud components, such as Azure Data Factory, Big Query, AirFlow, Google Cloud Composer and Pyspark etc Proven experience in modelling data through a medallion-based architecture, with curated dimensional models in the gold layer built for analytical use Strong ...

ground running Comfortable operating in high-pressure, delivery-focused environments Able to explain how you moved data, not just which tools you used Python (PySpark/Pandas/NumPy) and SQL using practically for data transformation Desirable Experience migrating data into Dynamics (or similar ERP platforms) Experience working with ...

data-driven decisions, while learning from experienced team members and developing your technical and business skills. Key Responsibilities: Build and maintain data pipelines, leveraging PySpark and/or Typescript within Foundry, to transform raw data into reliable, usable datasets. Familiarity with Palantir Foundry, PySpark, Kafka, TypeScript, PowerBI preferable. … years of experience building data pipelines at work or through internships is helpful. You can write clear and reliable Python/PySpark code. You are familiar with popular analytics tools (like pandas, numpy, matplotlib), big data frameworks (like Spark), and cloud services (like Palantir, AWS, Azure, or Google Cloud ...

responsible for: Designing end-to-end data architecture aligned with modern best practices. Building and managing ingestion pipelines using Databricks and related tools. Developing PySpark/Spark SQL notebooks for complex transformations and cleansing. Applying governance, security, and CI/CD best practices across cloud environments. Leading technical discussions … producing professional documentation. To be successful in this role, you will have: Hands-on experience with Databricks including Unity Catalog. Strong PySpark/Spark SQL skills for large-scale transformations. Experience integrating with diverse data sources such as APIs, cloud storage and databases. Experience with the Azure cloud data ...