26 to 50 of 279 PySpark Jobs in the UK

Data Engineer

Location
West of England, England, United Kingdom
storage, data pipelines to ingest and transform data, and querying & reporting of analytical data. You've worked with technologies such as Python, Spark, SQL, Pyspark, PowerBI etc. You’re a problem-solver, pragmatically exploring options and finding effective solutions. An understanding of how to design and build well-structured ...

Databricks Lead Engineer

Location
Birmingham, England, United Kingdom
Experience leading or mentoring teams of engineers to deliver high-quality scalable data solutions. Technical Expertise Deep expertise with the Databricks platform (Spark/PySpark/Scala, Delta Lake, Unity Catalog, MLflow). Proficiency in ETL/ELT tools such as DBT, Matillion, Talend, or equivalent. Strong ...

Databricks Lead Engineer

Location
Greater London, England, United Kingdom
Experience leading or mentoring teams of engineers to deliver high‐quality scalable data solutions. Technical Expertise Deep expertise with the Databricks platform (Spark/PySpark/Scala, Delta Lake, Unity Catalog, MLflow). Proficiency in ETL/ELT tools such as DBT, Matillion, Talend, or equivalent. Strong ...

Databricks Lead Engineer

Hiring Organisation
The Nippon Telegraph And Telephone Corporation (NTT)
Location
London, UK
Employment Type
Full-time
Experience leading or mentoring teams of engineers to deliver high-quality scalable data solutions. Technical Expertise Deep expertise with the Databricks platform (Spark/PySpark/Scala, Delta Lake, Unity Catalog, MLflow). Proficiency in ETL/ELT tools such as DBT, Matillion, Talend, or equivalent. Strong ...

Databricks Lead Engineer

Hiring Organisation
NTT DATA
Location
Birmingham, UK
Employment Type
Full-time
Experience leading or mentoring teams of engineers to deliver high-quality scalable data solutions. Technical Expertise Deep expertise with the Databricks platform (Spark/PySpark/Scala, Delta Lake, Unity Catalog, MLflow). Proficiency in ETL/ELT tools such as DBT, Matillion, Talend, or equivalent. Strong ...

Data Engineer (Analytical Engineering)

Location
Glasgow, Scotland, United Kingdom
creating Genie Agents, configuring data assets for Natural Language Querying and using Metric Views to create semantic layers. Experience of programming languages: SQL, python & pySpark etc. Experience of development practices: the use of versioning tools such as GitHub, work tracking tools such as Azure DevOps, or equivalents. A proven ...

Lead Data Engineer - AWS / AI / SQL

Hiring Organisation
Adria Solutions
Location
Manchester, North West, United Kingdom
Employment Type
Permanent
Salary
£90,000
such as Claude Code or equivalent tools, to improve engineering productivity while maintaining high standards of quality, governance and security. Desirable experience Regulated environment. PySpark for large-scale data transformations. Migrating legacy data estates to lakehouse or metadata-driven architectures. Customer Data Platforms or event-driven systems. Data-quality ...

Senior Data Engineer – Fixed-Term Contract

Location
United Kingdom
process requirements into technical solutions and working across technical and non-technical teams. Nice To Have Skills and Experience Experience with Databricks, Spark/PySpark, Delta Lake or comparable technologies. Experience with Celonis, process mining or process intelligence. Experience with enterprise platforms such as Salesforce, SAP or ServiceNow. Exposure ...

Lead Data Engineer

Location
Bristol, England, United Kingdom
storage, data pipelines to ingest and transform data, and querying & reporting of analytical data. You’ve worked with technologies such as Python, Spark, SQL, Pyspark, PowerBI etc. You’ve got a background in software engineering, including Front End technologies like JavaScript. You’re a problem-solver, pragmatically exploring options ...

Lead Data Engineer

Location
Newcastle upon Tyne, England, United Kingdom
storage, data pipelines to ingest and transform data, and querying & reporting of analytical data. You've worked with technologies such as Python, Spark, SQL, Pyspark, PowerBI etc. You’ve got a background in software engineering, including Front End technologies like JavaScript. You’re a problem-solver, pragmatically exploring options ...

Lead Data Engineer

Location
United Kingdom
storage, data pipelines to ingest and transform data, and querying & reporting of analytical data. You've worked with technologies such as Python, Spark, SQL, Pyspark, PowerBI etc. You’ve got a background in software engineering. You’re a problem-solver, pragmatically exploring options and finding effective solutions. An understanding ...

Senior Data Engineer

Location
Greater London, England, United Kingdom
orchestrate the ingestion of data from disparate source systems into a centralised data analytics platform. Designing and implementingdata engineering solutions using T-SQL, Python, PySpark and DBT in the Azurecloud environment. Working with Data Analystsin promoting business logic into DBT data models, to support business reportsand dashboards. Maintaining ...

Principal Data Engineer

Hiring Organisation
Asset Resourcing
Location
Leicester, Leicestershire, East Midlands, United Kingdom
Employment Type
Permanent
Salary
£90,000
with both technical and non-technical audiences Nice to have: Production experience specifically in Microsoft Fabric Power BI, particularly Direct Lake mode Python/PySpark Data governance or security experience Experience enabling AI/ML workloads from a data platform, not just BI The details: Salary ...

Data Engineering Lead AWS & AI - Manchester

Hiring Organisation
Adria Solutions
Location
Manchester, North West, United Kingdom
Employment Type
Permanent
Salary
£95,000
accelerate development across code, infrastructure, testing and documentation while maintaining appropriate quality and security controls. Desirable experience Financial services or another regulated environment. PySpark for large-scale batch or streaming transformations. Migrating SQL Server and SSIS estates to lakehouse or metadata-driven architectures. Customer Data Platforms or event-driven ...

Data Engineering Lead – AWS & AI - Manchester

Location
Stretford, England, United Kingdom
accelerate development across code, infrastructure, testing and documentation while maintaining appropriate quality and security controls. Desirable experience Financial services or another regulated environment. PySpark for large-scale batch or streaming transformations. Migrating SQL Server and SSIS estates to lakehouse or metadata-driven architectures. Customer Data Platforms or event-driven ...

BI Engineer London ·

Location
Greater London, England, United Kingdom
data warehousing, dimensional modelling, Kimball principles and data architecture Advanced SQL/T-SQL skills, including query development, optimisation and troubleshooting Strong Python, PySpark or similar programming skills for data manipulation and automation Experience integrating data from APIs, databases, files and other sources Experience with data quality, pipeline monitoring ...

Azure Data Engineer (Fabric & Cloud Data Platform)

Location
Greater London, England, United Kingdom
/Azure Databricks for distributed compute, memory optimization, and Delta Lake formats. Data Engineering Languages: Advanced proficiency in SQL (T-SQL, SparkSQL) and Python (PySpark). Security & Compliance: Direct experience implementing security controls for sensitive or identifiable data, utilizing Azure Key Vault, Azure Monitor, Log Analytics, and Microsoft Purview. ...

Senior Data Engineer

Location
Greater London, England, United Kingdom
only on ETL. However, we will consider candidates who bring Cloud + CI/CD experience alongside technologies such as: Proficient SQL; familiarity with PySpark is beneficial dbt Microsoft Fabric SQLMesh 5. Core Engineering Skills Strong Python, with good documentation and unit testing practices Comfortable in an agile delivery ...

Data Engineer

Hiring Organisation
Harvey Nash
Location
Reading, Berkshire, South East, United Kingdom
Employment Type
Contract
Contract Rate
Up to £675 per day
quality practices - Promote and champion the exceptional work being accomplished. Essential Skills & Experience: Extensive experience in programming/query language skills including Python/PySpark and SQL. Data engineering experience - via data preparation, transformation & conversion to allow for rapid processing of system data across a number of different formats ...

Head of Data & AI

Hiring Organisation
Asset Resourcing
Location
Leicester, Leicestershire, East Midlands, United Kingdom
Employment Type
Permanent
with both technical and non-technical audiences Nice to have: Production experience specifically in Microsoft Fabric Power BI, particularly Direct Lake mode Python/PySpark Data governance or security experience Experience enabling AI/ML workloads from a data platform, not just BI The details: Salary ...

Lead Data & AI Engineer

Location
Borough of Rossendale, England, United Kingdom
data platform from scratch, with responsibility for architecture and delivery in a business with limited existing data capability Strong SQL and Python or PySpark skills, with practical experience of ELT pipelines, dimensional modelling, source control and CI/CD Experience putting data governance and self-service BI into practice ...

Cloud Solution Architect

Location
Manchester, England, United Kingdom
analytics strategy AI & Automation Agentic AI patterns and intelligent automation solutions Document intelligence and AI-driven business use cases SQL Python and/or PySpark Data pipelines and transformation frameworks CI/CD concepts and deployment automation Azure DevOps and/or GitHub Infrastructure as Code awareness Environment promotion ...

Finance Data Engineer (Senior Manager)

Location
Greater London, England, United Kingdom
platform such as Databricks, Snowflake or Fabric, and orchestration tooling, with practical experience of ETL/ELT, data testing, Git and CI/CD; PySpark or dbt experience is beneficial. Working knowledge of finance data structures, including chart of accounts, entity hierarchy, sub‐ledger to ledger relationships, intercompany ...

Junior Analytics Engineer

Location
Greater London, England, United Kingdom
should be able to reason about a model rather than only consume one. Python — working exposure to data manipulation (pandas, PySpark or similar). You will use it here from early on, so some practical experience is needed even if it is not your strongest language. Power BI — able ...

IT Senior Data Consultant 321659

Location
United Kingdom
Azure Synapse, Azure Data Factory, and Databricks. Knowledge of SSRS, SSAS, SSIS, DAX, or MDX. Experience with Azure DevOps and Git. Exposure to Databricks, PySpark, or advanced analytics technologies. Microsoft Data and AI certifications, particularly Microsoft Fabric certifications. What can we offer you? Healthcare cash plan. This will give ...