10 of 10 Remote/Hybrid PySpark Jobs in Central London

security measures across the platform. Leverage Terraform or similar IaC tools for controlled and reproducible deployments. Databricks Development Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations ...

security measures across the platform. Leverage Terraform or similar IaC tools for controlled and reproducible deployments. Databricks Development Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations ...

teams ✔ Strong Insurance domain experience (Policy, Claims, Regulatory Data) ✔ 8–10+ years in Data Engineering/Integration ✔ Deep expertise in Azure & Databricks ✔ Strong Spark (PySpark/SparkSQL) skills ✔ Experience designing scalable, high-performance data platforms ✔ Confident with SQL, CI/CD & DevOps practices Why Join? You’ll be part ...

across multiple time zones, including offshore development teams Skills required: Proven track record building scalable data pipelines (batch and streaming) in production Expert Python, PySpark, Celery and RabbitMQ skills; deep experience with AWS data stack (Glue, OpenSearch, RDS) Expert skills within SQL with experience in both transactional RDBMS systems ...

troubleshooting and incident response for deployed ML systems Required Skills and Experience Strong programming skills in Python; experience with ML libraries such as Snowpark, PySpark, or PyTorch Experience with containerization tools like Docker and orchestration tools like Airflow or Astronomer Familiarity with cloud platforms (AWS, Azure) and ML services ...

timely manner. Key Experience, Skills and Knowledge: Proven 2 yrs+ experience as a Data Engineer or similar role, with a strong focus on PySpark, SQL, Microsoft Azure Data platforms and Power BI an advantage Proficiency in development languages suitable for intermediate-level data engineers, such as: Python/PySpark ...

Pipeline Builder Knowledge of end-to-end work - Ontology and Data connection Experience around Architectural principles Programming Skills - proficiency in Python, SQL and PySpark Data modeling and basic concepts of data science (classification, clustering, regression) Strong client-facing skills: You are comfortable interacting with both business and technical clients ...

solutions. Hands-on knowledge of Palantir Foundry (Ontology, pipelines, apps, AIP); Palantir certifications desirable. Proficiency in at least one coding language (e.g., Python/PySpark, R, Java, SQL, Typescript) and experience with object-oriented design or software engineering. Strong understanding of data engineering, modelling, platform integration, UX design ...

Adapt and deploy the platform to customer-specific contexts and priorities Design and implement scalable generative AI-enabled workflows Execute complex data integrations using PySpark and distributed data technologies Collaborate closely with stakeholders to define success metrics and outcomes What We’re Looking For 2–4+ years’ experience … strong desire to work in such environments) Proven ability to translate ambiguous business requirements into clean, maintainable data pipelines Strong fundamentals in Python, PySpark, and SQL Ability to learn new technologies quickly and operate with a high degree of ownership Nice to Have Experience with dashboarding or data visualisation ...

champion best practice methods; upskill the team through coaching and code reviews. Query and engineer large datasets (e.g., Python/R/SQL/PySpark) on modern platforms (e.g., Azure Databricks). Communicate pricing proposals and insights clearly and persuasively to stakeholders at all levels. Collaborate with Modelling, Optimisation … insurance pricing. Strong technical expertise in predictive modelling techniques (e.g. GLMs and machine learning models). Proficiency in programming languages such as R, Python, PySpark, SAS, or SQL. Good knowledge of Azure Databricks and modern data technologies. Experience with WTW Radar software and optimisation tools. A quantitative degree ...