12 of 12 PySpark Jobs in Yorkshire

Principal Data Consultant / Architect (Associate Data Architect II)

Location
Leeds, England, United Kingdom
understanding of modern data architectures including Data Lakes, Data Warehousing, Lakehouse Architecture, and Medallion Design Patterns. Strong hands-on knowledge of Databricks, Spark/PySpark, SQL, and data engineering best practices. Expertise in data modelling techniques including dimensional modelling, Data Vault, and canonical data models. Strong understanding of data ...

Senior Data Engineer (ML)

Location
Leeds, England, United Kingdom
hand over to Evoke teams Collaborate daily with Evoke ML engineering, the CF team, and AWS ProServe counterparts Skills & experience Must-have Python/PySpark - Expert. Production data pipeline development, not analysis-only AWS data/ML stack - Advanced. S3, Glue and/or EMR, IAM basics ...

Data Platform Engineer (Lead II - Data Engineering)

Location
Leeds, England, United Kingdom
Ability to manage workload independently and drive initiatives proactively. Experience designing and supporting enterprise-scale cloud data platforms. Skills ETL, Power Automate, Power BI, PySpark #J-18808-Ljbffr ...

Tech Lead Data & AI London

Location
Leeds, England, United Kingdom
Generation), Serverless, DWH models, Data Mesh, Data Fabric, Medallion and Data Products. Hands on mindset : Fluent in the language of data, whether SQL, Python, PySpark, R or Scala. Open formats including Parquet, Iceberg and JSON. Agile Ways of Working Run and contribute to agile ceremonies, helping to shape ...

Lead Data Engineer

Location
Leeds, England, United Kingdom
Data Engineer Key skills: Python SQL Server/SQL Data Warehousing & Data Modelling Data Architecture Data Pipelines & Integration Solutions Microsoft Fabric Azure Cloud Technologies PySpark ETL/ELT Development Data Governance & Security Source Control (Git) Technical Leadership & Team Management You will be a Lead Data Engineer Developer with good ...

Lead Data Engineer

Hiring Organisation
ITSS Recruitment Ltd
Location
Leeds, West Yorkshire, Yorkshire, United Kingdom
Employment Type
Permanent
Salary
£85,000
Data Engineer Key skills: * Python * SQL Server/SQL * Data Warehousing & Data Modelling * Data Architecture * Data Pipelines & Integration Solutions * Microsoft Fabric * Azure Cloud Technologies * PySpark * ETL/ELT Development * Data Governance & Security * Source Control (Git) * Technical Leadership & Team Management You will be a Lead Data Engineer Developer with good ...

Business Intelligence Analyst

Hiring Organisation
United Gas & Power
Location
Guiseley, West Yorkshire, UK
qualification or experience in Data Analytics, Computer Science, Business Analytics, Information Technology or a related discipline. Desirable Knowledge and Experience · Knowledge of Microsoft Fabric, PySpark and modern data architecture. · Power BI certification would be advantageous. · Knowledge of Microsoft Fabric and modern data architecture would be advantageous. Join the Team ...

Data Engineer

Location
Leeds, England, United Kingdom
Building and maintaining scalable data pipelines, pulling data in from core business systems and third-party sources. Designing and developing data solutions with Python, PySpark, SQL, notebooks and dataflows across a modern medallion architecture (Bronze, Silver, Gold). Creating and optimising data models that power high-quality Power … future analytics, AI and machine learning capability. Candidate Essential Experience, Qualifications and Skills Commercial data engineering experience (4+ years) SQL (4+ years) Python and PySpark (3+ years) Microsoft Fabric or an equivalent Azure data platform (2+ years) Medallion/layered lakehouse architecture (2+ years) Dimensional data modelling for analytics ...

Data Engineer

Location
Sheffield, England, United Kingdom
contract. Contract Details: Inside IR35 Initial 6-month engagement Sheffield-based, 3 days per week on-site Key Requirements: Strong hands-on experience with PySpark and Databricks Deep understanding of Spark performance optimisation, including lazy evaluation, column pruning, groupBy operations, and window functions Proven ability to troubleshoot and resolve ...

Lead Data engineer (Lead II - Data Engineering)

Location
Leeds, England, United Kingdom
Role Description Location:West Yorkshire- multiple locations(Hybrid- 3 days working from onsite-Mandatory) Immediate start Permanent/Contract inside IR35/Fixed term contract We're looking for a Lead Data Engineer to join ...

Lead Data engineer

Hiring Organisation
UST Global
Location
Leeds, West Yorkshire, United Kingdom
Salary
£ 80 K
Location:West Yorkshire- multiple locations(Hybrid- 3 days working from onsite-Mandatory)Immediate startPermanent/Contract inside IR35/Fixed term contractWe’re looking for a Lead Data Engineer to join UST Data Team. As ...

Senior Data Engineer: PySpark, Databricks & Spark Ops

Location
Sheffield, England, United Kingdom
Sheffield-based with 3 days on-site per week. You will design, develop and support enterprise-scale data pipelines, optimise Spark performance using PySpark and Databricks, and resolve runtime issues in a complex, large-scale environment. Inside IR35, initial six-month engagement. #J-18808-Ljbffr ...