Migration Architect - Palantir to Databricks (Hedge Fund)

Take full ownership of a high-stakes data platform migration, and position yourself as the go-to expert in enterprise-scale Palantir to Databricks transitions.

You’ll lead the entire migration strategy across a high-functioning data ecosystem, giving you unmatched exposure to complex pipeline redesigns, performance optimisation, and stakeholder collaboration at the highest level. This isn’t just a technical move - it’s a chance to sharpen your influence across engineering, DevOps, and business teams.

Working in a hedge fund environment means you’ll have the budget and autonomy to do things properly. There are no unnecessary blockers, so you can focus on delivering clean, scalable solutions that set new standards.

You’ll also broaden your career options. Whether you want to stay deeply technical or pivot towards pre-sales or solution architecture, this migration gives you the credibility and hands-on experience to do both. Plus, you can work fully remotely or choose to spend time in the London office to stay close to the action.

On top of that, you’ll benefit from world-class internal training, structured career development support, and direct access to senior architects who’ve led similar transformations. It’s a rare chance to learn while leading.

What you’ll do

You'll define and execute the end-to-end migration roadmap from Palantir Foundry to Databricks, including target architecture, data models, security, and governance frameworks.

Analyzing existing Foundry pipelines, datasets, and ontologies, you'll redesign them into scalable Databricks (Delta Lake) ETL/ELT workflows using PySpark and SQL, ensuring high performance and cost-efficient operations.

Collaborating with data engineers, platform teams, and business stakeholders, you'll minimize migration risk, ensure smooth cutover, and maintain production stability.

What you’ll need

• Deep knowledge of Databricks architecture, job orchestration, cluster management, and performance tuning.
• Proven experience leading or executing platform migrations from Palantir to Databricks.
• Expert-level PySpark & Python skills, strong ability to design, optimise, and refactor distributed data processing workflows.
• Advanced SQL & data modelling expertise, including dimensional modelling, lakehouse architecture patterns and query optimisation.
• Hands-on experience deploying and managing data platforms in cloud environments, Azure preferred.
• Expertise in Palantir Foundry pipelines, ontologies, data lineage, transformations, and platform governance.

About the company

Luxoft is a global technology and engineering firm (part of DXC Technology) that partners with leading financial institutions to deliver high‐impact transformation. Luxoft specialises in capital markets, banking, and wealth management, providing expertise across front‐to-back office platforms, trading systems, data and analytics, and cloud modernisation.

Please click the ‘Apply’ button. Don’t worry if your CV isn’t up to date. Just send what you have and we’ll deal with that later. Alternatively you can email me at michael.kamen@dxc.com