12 of 12 Permanent PySpark Jobs in the City of London

Advanced SQL skills for complex query validation. Experience with Agile/DevOps delivery models and JIRA test management. Familiarity with automation frameworks (SQL/PySpark preferred). Knowledge of CI/CD and release management processes. Experience with Power BI, Alteryx, and VS Code , particularly in testing integrations with ...

with Databricks SQL endpoints for data access. Ensure performance, scalability, and security of backend systems. Databricks & Data Engineering Develop ETL pipelines and workflows using PySpark on Databricks. Work with Delta Lake, Unity Catalog, and Databricks REST APIs. Optimize queries and pipelines for cost efficiency in cloud environments (Azure/ ...

with Databricks SQL endpoints for data access. Ensure performance, scalability, and security of backend systems. Databricks & Data Engineering Develop ETL pipelines and workflows using PySpark on Databricks. Work with Delta Lake, Unity Catalog, and Databricks REST APIs. Optimize queries and pipelines for cost efficiency in cloud environments (Azure/ ...

programming, concurrency, multithreading) Expertise in RESTful API design, OpenAPI/Swagger documentation and API lifecycle best practices Hands-on experience with ML libraries: PyTorch, PySpark, scikit-learn, Hugging Face Transformers Proficiency in AI tooling: Azure ML, Databricks, MLflow, LangChain, LangGraph Proven experience with Git, unit testing, containerisation and agile ...

outputs Set up monitoring and ensure data health for outputs What we are looking for Proficiency in Python, with experience in Apache Spark and PySpark Previous experience with data analytics softwares Ability to scope new integrations and translate user requirements into technical specifications What ...

outputs Set up monitoring and ensure data health for outputs What we are looking for Proficiency in Python, with experience in Apache Spark and PySpark Previous experience with data analytics softwares Ability to scope new integrations and translate user requirements into technical specifications What ...

impact. Key Responsibilities Design and deliver end-to-end technical solutions across complex data environments Build and maintain applications using technologies such as Python, PySpark, TypeScript, and React Develop AI-driven workflows and operational tooling Work directly with client stakeholders in fast-paced delivery environments Present demos, gather feedback ...

work directly with stakeholders, build modern data workflows, and help deliver meaningful transformation projects. You’ll work across technologies including Python, SQL, PySpark, TypeScript/React, and Palantir Foundry, contributing to everything from data engineering and AI workflows to user-facing applications. What You’ll Do Build and support ...

ownership of client problems, handling everything from deep data engineering knowing that may require low/no code Palantir Foundry tooling, or Python and PySpark code repos - to building user-facing front-end applications and widgets in TypeScript or REACT Lead Client Advisory: Sit directly alongside clients, goals ...

related discipline Working knowledge of Monte Carlo simulations, Bayesian methodologies or stochastic modelling Proficient in Python as your primary modelling tool; familiarity with PySpark, Hive, Docker or Kubernetes is advantageous but not essential What's in it for you? Genuine scope to shape something new. This is a freshly ...

Lakehouse architecture Design and deliver high-quality, analytics-ready data models that support trusted reporting Translate complex business requirements into robust SQL and PySpark transformation pipelines Shape how data is structured, modelled and served across multiple domains Embed data quality, testing, reliability and performance standards into pipelines Contribute … Experience Strong commercial experience as an Analytics Engineer operating in a modern data platform Advanced data modelling capability, including dimensional and semantic modelling Strong PySpark development experience within a Lakehouse environment Advanced SQL skills for complex transformations Hands-on experience with Databricks, including pipelines and governance tooling A strong ...

workstreams from discovery through to validated delivery Architect and build the Claude Code agentic workflow: Parse existing data movement pipelines and logic Generate equivalent PySpark transformations Produce Airflow DAGs Operate, iterate, and scale across the full data pipeline estate Ensure rigorous creation and management of the PySpark data … architectural standards on complex, multi-workstream programmes Hands-on capability to build solutions as well as design them Deep expertise in Python and PySpark: Strong track record delivering large-scale distributed data systems Experience with Claude Code or similar agentic AI platforms: Prompt engineering Context management Workflow design ...