Palantir Foundry SME/Lead Data Engineer
Palantir Foundry SME/Lead Data Engineer
Location: London with occasional international travel
Contract - 6-12 months
Inside IR35
Rate: Negotiable DOE
Our client is looking for a Palantir Foundry SME, to take ownership of the platform architecture, data modelling standards, pipeline development and integration strategy. You will work closely with stakeholders across business, data, and engineering teams to translate operational problems into scalable Foundry solutions.
This is a hands-on engineering role combined with some architectural leadership.
Key Responsibilities
- Design and implement scalable data pipelines within Palantir Foundry
- Develop and maintain Ontology objects, operational workflows and applications within Foundry
- Build and optimise data transformations using PySpark, SQL and Python
- Integrate Foundry with cloud platforms such as Amazon Web Services, Microsoft Azure, or Google Cloud Platform
- Implement CI/CD workflows using tools such as Jenkins, GitLab, or GitHub Actions
- Work with containerised deployments using Docker and orchestration via Kubernetes
- Implement governance, data lineage, and security best practices
- Optimise performance, cost and reliability of Foundry pipelines
- Build operational dashboards and data applications for business users
- Mentor internal teams and establish platform standards and best practices
- Act as the senior technical interface with Palantir
Essential Experience
- Proven commercial experience implementing and scaling Palantir Foundry
- Strong experience in Python, SQL and Spark (PySpark preferred)
- Experience building data models and ontologies
- Strong understanding of ETL/ELT design patterns
- Cloud-native architecture experience (AWS/Azure/GCP)
- Experience with REST APIs and system integrations
- Familiarity with DevOps and Infrastructure-as-Code principles (eg Terraform)
- Strong understanding of data governance and security controls
Desirable Skills
- Experience with big data tooling (eg Apache Spark, Kafka)
- Experience integrating Foundry with ERP/CRM platforms
- Knowledge of data science and ML workflows
- Experience in regulated or security-sensitive environments
- Exposure to operational decision-support systems