126 to 143 of 143 PySpark Jobs in the UK

disciplinary engineering team. What You'll Be Doing as a Lead Architect Leading end-to-end delivery of a large-scale Azure, Databricks and PySpark programme, owning technical strategy across architecture, data engineering, software and QA workstreams. Acting as senior technical authority and escalation point for complex architecture … challenges into concise, business-focused language for executive decision-making. Qualifications Active UK SC clearance (essential). Desirable technical strengths: Terraform (IaC), Python and PySpark, Azure DevOps pipelines, Docker/Docker-Compose, Trivy scanning, medallion architecture with ADLS, parquet and delta tables, and strong SQL. Why Join? High-autonomy ...

making at scale. What You'll Be Doing: Building curated, analytics-ready datasets using modern modelling techniques Developing robust transformation pipelines using SQL and PySpark Collaborating with Data Engineers to enhance the data platform Translating business needs into scalable, well-structured data models Embedding data quality, testing, and governance … Looking For: Proven experience as an Analytics Engineer or similar role Strong SQL skills and experience with complex data transformations Hands-on experience with PySpark and modern data platforms (Lakehouse preferred) Solid understanding of dimensional modelling Strong communication skills - able to work across technical and business teams A passion ...

data models within a Lakehouse architecture Develop analytics‐ready datasets that power trusted reporting and dashboards Translate business requirements into well‐structured SQL and PySpark transformations Contribute to data modelling decisions across multiple business domains Apply data quality checks, testing and performance best practices to pipelines Work within existing … Analytics Engineer or in a similar data-focused role Solid data modelling skills, including experience with dimensional models Hands‐on experience writing PySpark in a Lakehouse or big data environment Strong SQL skills for building and maintaining transformation logic Experience working with Databricks or similar modern data platforms ...

data models within the Lakehouse Owning the transformation from enriched to curated datasets, enabling trusted reporting and insight Developing and maintaining robust SQL and PySpark transformation pipelines in Databricks Embedding data quality, testing, reliability and performance into the curated layer Working closely with data engineers, BI teams and business … Engineer within a modern data platform Excellent data modelling capability, including dimensional and semantic modelling Advanced SQL skills and strong hands on experience with PySpark Experience working with Databricks and Lakehouse architectures A solid grounding in engineering best practices, testing and data quality Confidence mentoring others and taking ownership ...

data models within the Lakehouse Owning the transformation from enriched to curated datasets, enabling trusted reporting and insight Developing and maintaining robust SQL and PySpark transformation pipelines in Databricks Embedding data quality, testing, reliability and performance into the curated layer Working closely with data engineers, BI teams and business … Engineer within a modern data platform Excellent data modelling capability, including dimensional and semantic modelling Advanced SQL skills and strong hands on experience with PySpark Experience working with Databricks and Lakehouse architectures A solid grounding in engineering best practices, testing and data quality Confidence mentoring others and taking ownership ...

data models within the Lakehouse Owning the transformation from enriched to curated datasets, enabling trusted reporting and insight Developing and maintaining robust SQL and PySpark transformation pipelines in Databricks Embedding data quality, testing, reliability and performance into the curated layer Working closely with data engineers, BI teams and business … Engineer within a modern data platform Excellent data modelling capability, including dimensional and semantic modelling Advanced SQL skills and strong hands on experience with PySpark Experience working with Databricks and Lakehouse architectures A solid grounding in engineering best practices, testing and data quality Confidence mentoring others and taking ownership ...

technical leadership and taking ownership. Key responsibilities include: Designing and building curated datasets using dimensional and semantic modelling techniques Developing and maintaining SQL and PySpark transformation pipelines Partnering closely with Data Engineers Translating business requirements into clear, well-documented data models YOUR SKILLS AND EXPERIENCE: Advanced SQL, including complex … transformations and modelling Databricks PySpark and working within a Lakehouse or modern data platform Dimensional modelling and analytics engineering best practices Communicating effectively with both technical and non-technical stakeholders THE BENEFITS: You will receive a salary, dependent on experience. Salary ...

technical leadership and taking ownership. Key responsibilities include: Designing and building curated datasets using dimensional and semantic modelling techniques Developing and maintaining SQL and PySpark transformation pipelines Partnering closely with Data Engineers Translating business requirements into clear, well-documented data models YOUR SKILLS AND EXPERIENCE: Advanced SQL, including complex … transformations and modelling Databricks PySpark and working within a Lakehouse or modern data platform Dimensional modelling and analytics engineering best practices Communicating effectively with both technical and non-technical stakeholders THE BENEFITS: You will receive a salary, dependent on experience. Salary ...

technical leadership and taking ownership. Key responsibilities include: Designing and building curated datasets using dimensional and semantic modelling techniques Developing and maintaining SQL and PySpark transformation pipelines Partnering closely with Data Engineers Translating business requirements into clear, well-documented data models YOUR SKILLS AND EXPERIENCE: Advanced SQL, including complex … transformations and modelling Databricks PySpark and working within a Lakehouse or modern data platform Dimensional modelling and analytics engineering best practices Communicating effectively with both technical and non-technical stakeholders THE BENEFITS: You will receive a salary, dependent on experience. Salary ...

technical leadership and taking ownership. Key responsibilities include: Designing and building curated datasets using dimensional and semantic modelling techniques Developing and maintaining SQL and PySpark transformation pipelines Partnering closely with Data Engineers Translating business requirements into clear, well-documented data models YOUR SKILLS AND EXPERIENCE: Advanced SQL, including complex … transformations and modelling Databricks PySpark and working within a Lakehouse or modern data platform Dimensional modelling and analytics engineering best practices Communicating effectively with both technical and non-technical stakeholders THE BENEFITS: You will receive a salary, dependent on experience. Salary ...

technical leadership and taking ownership. Key responsibilities include: Designing and building curated datasets using dimensional and semantic modelling techniques Developing and maintaining SQL and PySpark transformation pipelines Partnering closely with Data Engineers Translating business requirements into clear, well-documented data models YOUR SKILLS AND EXPERIENCE: Advanced SQL, including complex … transformations and modelling Databricks PySpark and working within a Lakehouse or modern data platform Dimensional modelling and analytics engineering best practices Communicating effectively with both technical and non-technical stakeholders THE BENEFITS: You will receive a salary, dependent on experience. Salary ...

technical leadership and taking ownership. Key responsibilities include: Designing and building curated datasets using dimensional and semantic modelling techniques Developing and maintaining SQL and PySpark transformation pipelines Partnering closely with Data Engineers Translating business requirements into clear, well-documented data models YOUR SKILLS AND EXPERIENCE: Advanced SQL, including complex … transformations and modelling Databricks PySpark and working within a Lakehouse or modern data platform Dimensional modelling and analytics engineering best practices Communicating effectively with both technical and non-technical stakeholders THE BENEFITS: You will receive a salary, dependent on experience. Salary ...

Doing Leading and mentoring a team of Data Engineers Designing and building scalable data pipelines in Databricks Remaining hands on with Python/PySpark development Working closely with product, frontend, and backend teams Integrating multiple data sources, including APIs Driving best practice across the data platform Helping shape … future data architecture What We’re Looking For Essential: Strong commercial experience with Databricks Advanced Python and PySpark Solid SQL skills Experience building production data pipelines Experience working with API based data ingestion Familiarity with Azure storage connectivity Prior technical leadership or mentoring experience Nice to have: Experience with ...

delivered, and used across the business. Responsibilities Design and build end-to-end data solutions within Microsoft Fabric Develop and optimise data pipelines using PySpark and SQL Work across bronze, silver, and gold layers (medallion architecture) Perform initial data analysis and help define requirements Collaborate with analysts, Client … stakeholders Improve and automate existing processes Ensure data is secure, accurate, and scalable Requirements Technical: Strong experience with PySpark/Spark and SQL Hands-on experience with Microsoft Fabric Experience building data pipelines and models Azure Data Factory experience Understanding of modern data architectures Personal: Proactive and self-starting ...

delivered, and used across the business. Responsibilities Design and build end-to-end data solutions within Microsoft Fabric Develop and optimise data pipelines using PySpark and SQL Work across bronze, silver, and gold layers (medallion architecture) Perform initial data analysis and help define requirements Collaborate with analysts, Client … stakeholders Improve and automate existing processes Ensure data is secure, accurate, and scalable Requirements Technical: Strong experience with PySpark/Spark and SQL Hands-on experience with Microsoft Fabric Experience building data pipelines and models Azure Data Factory experience Understanding of modern data architectures Personal: Proactive and self-starting ...

business. Design and own analytics data models, transforming data from enriched layers into curated, analytics ready datasets. Develop and maintain robust SQL and PySpark transformations within Databricks. Work closely with data engineers, BI teams and stakeholders to translate complex requirements into trusted reporting. SKILLS AND EXPERIENCE The successful Analytics … following skills and experience: Strong commercial experience as an analytics focused engineer, rather than an analyst. Advanced data modelling capability, including dimensional modelling. Strong PySpark and SQL skills in production environments. Hands on experience with Databricks, including pipelines and governed data environments. A solid grounding in engineering best practices ...

business. Design and own analytics data models, transforming data from enriched layers into curated, analytics ready datasets. Develop and maintain robust SQL and PySpark transformations within Databricks. Work closely with data engineers, BI teams and stakeholders to translate complex requirements into trusted reporting. SKILLS AND EXPERIENCE The successful Analytics … following skills and experience: Strong commercial experience as an analytics focused engineer, rather than an analyst. Advanced data modelling capability, including dimensional modelling. Strong PySpark and SQL skills in production environments. Hands on experience with Databricks, including pipelines and governed data environments. A solid grounding in engineering best practices ...

business. Design and own analytics data models, transforming data from enriched layers into curated, analytics ready datasets. Develop and maintain robust SQL and PySpark transformations within Databricks. Work closely with data engineers, BI teams and stakeholders to translate complex requirements into trusted reporting. SKILLS AND EXPERIENCE The successful Analytics … following skills and experience: Strong commercial experience as an analytics focused engineer, rather than an analyst. Advanced data modelling capability, including dimensional modelling. Strong PySpark and SQL skills in production environments. Hands on experience with Databricks, including pipelines and governed data environments. A solid grounding in engineering best practices ...