3 of 3 Contract PySpark Jobs in Central London

security measures across the platform. Leverage Terraform or similar IaC tools for controlled and reproducible deployments. Databricks Development Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations ...

strong focus on graph analytics. Proficiency in graph analytics tools and libraries such as Neo4j, NetworkX, GraphX, or similar. Strong programming skills in Python & PySpark, with experience in relevant machine learning libraries (e.g., scikit-learn, TensorFlow, PyTorch). Expertise in graph algorithms including shortest path, centrality, community detection ...

solutions. GenAI Implementation: Hands-on deployment of Azure OpenAI, Vector Databases, and RAG patterns. Data Engineering: Oversee large-scale data processing using Python and PySpark to support AI model fine-tuning. Leadership: Manage technical delivery teams and deliver upskilling sessions to the customer. Stakeholder Management: Gain consensus on complex … roadmaps with diverse client groups. Technical Skills & Experience Core AI: Azure OpenAI, Prompt Engineering, Cognitive Search, Form Recognizer. Data/Coding: Expert-level Python, PySpark, and Vector DB integration. Ops: Practical knowledge of MLOps and LLMOps lifecycles. Security: Must hold active UK Government SC Clearance. Certifications Mandatory ...