1 of 1 Permanent Databricks Jobs in Woking

the development and maintenance of IDBS's software platforms adheres to IDBS's architecture vision. What we'll get you doing: Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark (PySpark) to support analytics and other data-driven initiatives. Support the elaboration of requirements, formulation of the technical implementation plan and backlog refinement. Provide technical perspective to … regulatory teams. Enabled regulatory compliance by implementing secure, auditable, and GxP-aligned data workflows with robust access controls. Improved system performance and cost-efficiency by optimizing Spark jobs and Databricks clusters, leading to measurable reductions in compute costs and processing times. Fostered cross-functional collaboration by building reusable. testable, well-documented Databricks notebooks and APIs that empower data scientists, analysts … CD automation, and mentoring, resulting in higher code quality, faster deployments, and increased team productivity. It would be a plus if you also possess previous experience in: Deployment of Databricks functionality in a SaaS environment (via infrastructure as code) with experience of Spark, Python and a breadth of database technologies Event-driven and distributed systems, using messaging systems like Kafka More ❯