101 to 124 of 124 PySpark Jobs in England

Skills and Experience Essential Skills Strong hands‐on experience with Palantir Foundry , including Code Repositories, Workshop, AIP Logic, and Automate Proficiency in Python and PySpark or TypeScript Experience working with AWS services such as S3, Lambda, Glue, and related data services Solid understanding of data pipeline architectures, ETL processes … problem‐solving skills with the ability to communicate clearly with both technical and non‐technical stakeholders Preferred Qualifications Additional experience with Foundry, AIP, and PySpark Knowledge of monitoring, alerting, and logging tools and frameworks Exposure to TypeScript/React for Workshop applications and workflow orchestration Experience working within ...

Your Responsibilities: Design and maintain scalable data pipelines using PySpark, Python, and distributed computing frameworks to support high‐volume data processing. Architect and optimize AWS-based data and AI infrastructure, ensuring secure, performant, and cost‐efficient ingestion, transformation, and storage. Develop, finetune, benchmark, and evaluate GenAI/LLM models … cross-functional teams to integrate GenAI capabilities into production systems and ensure high-quality data, governance, and operational reliability Your Profile: Strong experience with PySpark, distributed data processing, and largescale ETL/ELT pipelines. Strong SQL expertise including star/snowflake schema design, indexing strategies, writing optimized queries ...

pricing models with advanced data science techniques using WTW Radar and Emblem. Query and engineer large datasets (e.g., Python/R/SQL/PySpark) on modern platforms (e.g., Azure Databricks). Create innovative data solutions and present actionable insights to stakeholders. Communicate results clearly to key decision-makers … Street Pricing. What we’re looking for: Experience in general insurance pricing with strong modelling skills. Proficiency in programming languages such as R, Python, PySpark, SAS, or SQL. Good knowledge of Azure Databricks and modern data technologies. Experience with WTW Radar software is preferred. A quantitative degree in Mathematics ...

disciplinary engineering team. What You'll Be Doing as a Lead Architect Leading end-to-end delivery of a large-scale Azure, Databricks and PySpark programme, owning technical strategy across architecture, data engineering, software and QA workstreams. Acting as senior technical authority and escalation point for complex architecture … challenges into concise, business-focused language for executive decision-making. Qualifications Active UK SC clearance (essential). Desirable technical strengths: Terraform (IaC), Python and PySpark, Azure DevOps pipelines, Docker/Docker-Compose, Trivy scanning, medallion architecture with ADLS, parquet and delta tables, and strong SQL. Why Join? High-autonomy ...

models within a Lakehouse environment Own dimensional and semantic modelling to enable consistent, trusted reporting across the business Build and maintain complex SQL and PySpark transformation pipelines using Databricks Drive data quality, testing, reliability and performance across the curated or gold data layer Work closely with data engineers … experience: Strong commercial experience as an Analytics Engineer within a modern data platform or Lakehouse architecture Expert level SQL and strong hands on PySpark capability Proven experience designing and owning dimensional data models for analytics and reporting Experience working with Databricks, including pipelines and governed data environments Solid understanding ...

Lakehouse architecture Design and deliver high-quality, analytics-ready data models that support trusted reporting Translate complex business requirements into robust SQL and PySpark transformation pipelines Shape how data is structured, modelled and served across multiple domains Embed data quality, testing, reliability and performance standards into pipelines Contribute … Experience Strong commercial experience as an Analytics Engineer operating in a modern data platform Advanced data modelling capability, including dimensional and semantic modelling Strong PySpark development experience within a Lakehouse environment Advanced SQL skills for complex transformations Hands-on experience with Databricks, including pipelines and governance tooling A strong ...

data models within the Lakehouse Owning the transformation from enriched to curated datasets, enabling trusted reporting and insight Developing and maintaining robust SQL and PySpark transformation pipelines in Databricks Embedding data quality, testing, reliability and performance into the curated layer Working closely with data engineers, BI teams and business … Engineer within a modern data platform Excellent data modelling capability, including dimensional and semantic modelling Advanced SQL skills and strong hands on experience with PySpark Experience working with Databricks and Lakehouse architectures A solid grounding in engineering best practices, testing and data quality Confidence mentoring others and taking ownership ...

data models within the Lakehouse Owning the transformation from enriched to curated datasets, enabling trusted reporting and insight Developing and maintaining robust SQL and PySpark transformation pipelines in Databricks Embedding data quality, testing, reliability and performance into the curated layer Working closely with data engineers, BI teams and business … Engineer within a modern data platform Excellent data modelling capability, including dimensional and semantic modelling Advanced SQL skills and strong hands on experience with PySpark Experience working with Databricks and Lakehouse architectures A solid grounding in engineering best practices, testing and data quality Confidence mentoring others and taking ownership ...

data models within the Lakehouse Owning the transformation from enriched to curated datasets, enabling trusted reporting and insight Developing and maintaining robust SQL and PySpark transformation pipelines in Databricks Embedding data quality, testing, reliability and performance into the curated layer Working closely with data engineers, BI teams and business … Engineer within a modern data platform Excellent data modelling capability, including dimensional and semantic modelling Advanced SQL skills and strong hands on experience with PySpark Experience working with Databricks and Lakehouse architectures A solid grounding in engineering best practices, testing and data quality Confidence mentoring others and taking ownership ...

making at scale. What You'll Be Doing: Building curated, analytics-ready datasets using modern modelling techniques Developing robust transformation pipelines using SQL and PySpark Collaborating with Data Engineers to enhance the data platform Translating business needs into scalable, well-structured data models Embedding data quality, testing, and governance … Looking For: Proven experience as an Analytics Engineer or similar role Strong SQL skills and experience with complex data transformations Hands-on experience with PySpark and modern data platforms (Lakehouse preferred) Solid understanding of dimensional modelling Strong communication skills - able to work across technical and business teams A passion ...

data models within a Lakehouse architecture Develop analytics‐ready datasets that power trusted reporting and dashboards Translate business requirements into well‐structured SQL and PySpark transformations Contribute to data modelling decisions across multiple business domains Apply data quality checks, testing and performance best practices to pipelines Work within existing … Analytics Engineer or in a similar data-focused role Solid data modelling skills, including experience with dimensional models Hands‐on experience writing PySpark in a Lakehouse or big data environment Strong SQL skills for building and maintaining transformation logic Experience working with Databricks or similar modern data platforms ...

data models within the Lakehouse Owning the transformation from enriched to curated datasets, enabling trusted reporting and insight Developing and maintaining robust SQL and PySpark transformation pipelines in Databricks Embedding data quality, testing, reliability and performance into the curated layer Working closely with data engineers, BI teams and business … Engineer within a modern data platform Excellent data modelling capability, including dimensional and semantic modelling Advanced SQL skills and strong hands on experience with PySpark Experience working with Databricks and Lakehouse architectures A solid grounding in engineering best practices, testing and data quality Confidence mentoring others and taking ownership ...

technical leadership and taking ownership. Key responsibilities include: Designing and building curated datasets using dimensional and semantic modelling techniques Developing and maintaining SQL and PySpark transformation pipelines Partnering closely with Data Engineers Translating business requirements into clear, well-documented data models YOUR SKILLS AND EXPERIENCE: Advanced SQL, including complex … transformations and modelling Databricks PySpark and working within a Lakehouse or modern data platform Dimensional modelling and analytics engineering best practices Communicating effectively with both technical and non-technical stakeholders THE BENEFITS: You will receive a salary, dependent on experience. Salary ...

technical leadership and taking ownership. Key responsibilities include: Designing and building curated datasets using dimensional and semantic modelling techniques Developing and maintaining SQL and PySpark transformation pipelines Partnering closely with Data Engineers Translating business requirements into clear, well-documented data models YOUR SKILLS AND EXPERIENCE: Advanced SQL, including complex … transformations and modelling Databricks PySpark and working within a Lakehouse or modern data platform Dimensional modelling and analytics engineering best practices Communicating effectively with both technical and non-technical stakeholders THE BENEFITS: You will receive a salary, dependent on experience. Salary ...

technical leadership and taking ownership. Key responsibilities include: Designing and building curated datasets using dimensional and semantic modelling techniques Developing and maintaining SQL and PySpark transformation pipelines Partnering closely with Data Engineers Translating business requirements into clear, well-documented data models YOUR SKILLS AND EXPERIENCE: Advanced SQL, including complex … transformations and modelling Databricks PySpark and working within a Lakehouse or modern data platform Dimensional modelling and analytics engineering best practices Communicating effectively with both technical and non-technical stakeholders THE BENEFITS: You will receive a salary, dependent on experience. Salary ...

technical leadership and taking ownership. Key responsibilities include: Designing and building curated datasets using dimensional and semantic modelling techniques Developing and maintaining SQL and PySpark transformation pipelines Partnering closely with Data Engineers Translating business requirements into clear, well-documented data models YOUR SKILLS AND EXPERIENCE: Advanced SQL, including complex … transformations and modelling Databricks PySpark and working within a Lakehouse or modern data platform Dimensional modelling and analytics engineering best practices Communicating effectively with both technical and non-technical stakeholders THE BENEFITS: You will receive a salary, dependent on experience. Salary ...

technical leadership and taking ownership. Key responsibilities include: Designing and building curated datasets using dimensional and semantic modelling techniques Developing and maintaining SQL and PySpark transformation pipelines Partnering closely with Data Engineers Translating business requirements into clear, well-documented data models YOUR SKILLS AND EXPERIENCE: Advanced SQL, including complex … transformations and modelling Databricks PySpark and working within a Lakehouse or modern data platform Dimensional modelling and analytics engineering best practices Communicating effectively with both technical and non-technical stakeholders THE BENEFITS: You will receive a salary, dependent on experience. Salary ...

technical leadership and taking ownership. Key responsibilities include: Designing and building curated datasets using dimensional and semantic modelling techniques Developing and maintaining SQL and PySpark transformation pipelines Partnering closely with Data Engineers Translating business requirements into clear, well-documented data models YOUR SKILLS AND EXPERIENCE: Advanced SQL, including complex … transformations and modelling Databricks PySpark and working within a Lakehouse or modern data platform Dimensional modelling and analytics engineering best practices Communicating effectively with both technical and non-technical stakeholders THE BENEFITS: You will receive a salary, dependent on experience. Salary ...

Doing Leading and mentoring a team of Data Engineers Designing and building scalable data pipelines in Databricks Remaining hands on with Python/PySpark development Working closely with product, frontend, and backend teams Integrating multiple data sources, including APIs Driving best practice across the data platform Helping shape … future data architecture What We’re Looking For Essential: Strong commercial experience with Databricks Advanced Python and PySpark Solid SQL skills Experience building production data pipelines Experience working with API based data ingestion Familiarity with Azure storage connectivity Prior technical leadership or mentoring experience Nice to have: Experience with ...

delivered, and used across the business. Responsibilities Design and build end-to-end data solutions within Microsoft Fabric Develop and optimise data pipelines using PySpark and SQL Work across bronze, silver, and gold layers (medallion architecture) Perform initial data analysis and help define requirements Collaborate with analysts, Client … stakeholders Improve and automate existing processes Ensure data is secure, accurate, and scalable Requirements Technical: Strong experience with PySpark/Spark and SQL Hands-on experience with Microsoft Fabric Experience building data pipelines and models Azure Data Factory experience Understanding of modern data architectures Personal: Proactive and self-starting ...

delivered, and used across the business. Responsibilities Design and build end-to-end data solutions within Microsoft Fabric Develop and optimise data pipelines using PySpark and SQL Work across bronze, silver, and gold layers (medallion architecture) Perform initial data analysis and help define requirements Collaborate with analysts, Client … stakeholders Improve and automate existing processes Ensure data is secure, accurate, and scalable Requirements Technical: Strong experience with PySpark/Spark and SQL Hands-on experience with Microsoft Fabric Experience building data pipelines and models Azure Data Factory experience Understanding of modern data architectures Personal: Proactive and self-starting ...

business. Design and own analytics data models, transforming data from enriched layers into curated, analytics ready datasets. Develop and maintain robust SQL and PySpark transformations within Databricks. Work closely with data engineers, BI teams and stakeholders to translate complex requirements into trusted reporting. SKILLS AND EXPERIENCE The successful Analytics … following skills and experience: Strong commercial experience as an analytics focused engineer, rather than an analyst. Advanced data modelling capability, including dimensional modelling. Strong PySpark and SQL skills in production environments. Hands on experience with Databricks, including pipelines and governed data environments. A solid grounding in engineering best practices ...

business. Design and own analytics data models, transforming data from enriched layers into curated, analytics ready datasets. Develop and maintain robust SQL and PySpark transformations within Databricks. Work closely with data engineers, BI teams and stakeholders to translate complex requirements into trusted reporting. SKILLS AND EXPERIENCE The successful Analytics … following skills and experience: Strong commercial experience as an analytics focused engineer, rather than an analyst. Advanced data modelling capability, including dimensional modelling. Strong PySpark and SQL skills in production environments. Hands on experience with Databricks, including pipelines and governed data environments. A solid grounding in engineering best practices ...

business. Design and own analytics data models, transforming data from enriched layers into curated, analytics ready datasets. Develop and maintain robust SQL and PySpark transformations within Databricks. Work closely with data engineers, BI teams and stakeholders to translate complex requirements into trusted reporting. SKILLS AND EXPERIENCE The successful Analytics … following skills and experience: Strong commercial experience as an analytics focused engineer, rather than an analyst. Advanced data modelling capability, including dimensional modelling. Strong PySpark and SQL skills in production environments. Hands on experience with Databricks, including pipelines and governed data environments. A solid grounding in engineering best practices ...