51 to 56 of 56 PySpark Jobs in London

Skills and Experience Essential Skills Strong hands‐on experience with Palantir Foundry , including Code Repositories, Workshop, AIP Logic, and Automate Proficiency in Python and PySpark or TypeScript Experience working with AWS services such as S3, Lambda, Glue, and related data services Solid understanding of data pipeline architectures, ETL processes … problem‐solving skills with the ability to communicate clearly with both technical and non‐technical stakeholders Preferred Qualifications Additional experience with Foundry, AIP, and PySpark Knowledge of monitoring, alerting, and logging tools and frameworks Exposure to TypeScript/React for Workshop applications and workflow orchestration Experience working within ...

Your Responsibilities: Design and maintain scalable data pipelines using PySpark, Python, and distributed computing frameworks to support high‐volume data processing. Architect and optimize AWS-based data and AI infrastructure, ensuring secure, performant, and cost‐efficient ingestion, transformation, and storage. Develop, finetune, benchmark, and evaluate GenAI/LLM models … cross-functional teams to integrate GenAI capabilities into production systems and ensure high-quality data, governance, and operational reliability Your Profile: Strong experience with PySpark, distributed data processing, and largescale ETL/ELT pipelines. Strong SQL expertise including star/snowflake schema design, indexing strategies, writing optimized queries ...

models within a Lakehouse environment Own dimensional and semantic modelling to enable consistent, trusted reporting across the business Build and maintain complex SQL and PySpark transformation pipelines using Databricks Drive data quality, testing, reliability and performance across the curated or gold data layer Work closely with data engineers … experience: Strong commercial experience as an Analytics Engineer within a modern data platform or Lakehouse architecture Expert level SQL and strong hands on PySpark capability Proven experience designing and owning dimensional data models for analytics and reporting Experience working with Databricks, including pipelines and governed data environments Solid understanding ...

Lakehouse architecture Design and deliver high-quality, analytics-ready data models that support trusted reporting Translate complex business requirements into robust SQL and PySpark transformation pipelines Shape how data is structured, modelled and served across multiple domains Embed data quality, testing, reliability and performance standards into pipelines Contribute … Experience Strong commercial experience as an Analytics Engineer operating in a modern data platform Advanced data modelling capability, including dimensional and semantic modelling Strong PySpark development experience within a Lakehouse environment Advanced SQL skills for complex transformations Hands-on experience with Databricks, including pipelines and governance tooling A strong ...

making at scale. What You'll Be Doing: Building curated, analytics-ready datasets using modern modelling techniques Developing robust transformation pipelines using SQL and PySpark Collaborating with Data Engineers to enhance the data platform Translating business needs into scalable, well-structured data models Embedding data quality, testing, and governance … Looking For: Proven experience as an Analytics Engineer or similar role Strong SQL skills and experience with complex data transformations Hands-on experience with PySpark and modern data platforms (Lakehouse preferred) Solid understanding of dimensional modelling Strong communication skills - able to work across technical and business teams A passion ...

data models within a Lakehouse architecture Develop analytics‐ready datasets that power trusted reporting and dashboards Translate business requirements into well‐structured SQL and PySpark transformations Contribute to data modelling decisions across multiple business domains Apply data quality checks, testing and performance best practices to pipelines Work within existing … Analytics Engineer or in a similar data-focused role Solid data modelling skills, including experience with dimensional models Hands‐on experience writing PySpark in a Lakehouse or big data environment Strong SQL skills for building and maintaining transformation logic Experience working with Databricks or similar modern data platforms ...