11 of 11 Remote/Hybrid Spark SQL Jobs in London

Data Architect (Azure Databricks, Specialty Insurance)

Location
Greater London, England, United Kingdom
claims, exposure, reinsurance and finance. Design gold‐layer (consumption) models and, where Power BI is the consumption layer, semantic models served from Databricks SQL and shaped for efficient reporting and self‐service analytics. Select and design for the right storage and exchange formats for each workload, including … Parquet, CSV, Excel, XML, JSON, Protobuf). Optimise platform performance and cost, including partitioning vs. liquid clustering, file sizing, Photon, and cluster and SQL warehouse sizing. Manage the model lifecycle: optimise and update models for new and existing client projects, reverse engineer physical models from existing databases ...

Senior Data Engineer, Fabric & Analytics (Remote)

Location
Greater London, England, United Kingdom
data-driven culturewithin the organisation, mentoring team members, and contributing to the continuous improvement of the Engineering Practice You Will Demonstrate: Proficiencyin SQL and Python:You are highly proficient in SQL and Python, enabling you to handle complex data problems with ease. Understanding of Data Lakehouse … Architecture:You have a strong grasp of the principles and implementation of Data Lakehouse architecture. Hands-On Experience with Spark-Based Solutions:Youpossessexperience with Spark-based platforms like Azure Synapse, Databricks, Microsoft Fabric, or evenon-premiseSpark clusters, usingPySparkor Spark SQL to manage ...

Senior Data Analyst

Location
Greater London, England, United Kingdom
quantify their impact on migration. Design repeatable comparisons and reconciliation checks to validate that migrated data is complete, consistent and faithful. Write reusable SQL and Python scripts for profiling, exception detection and validation, using Azure Databricks, Git and dbt where relevant. Communicate findings clearly to technical … approach to working with data. Experience profiling unfamiliar datasets and tracing data quality issues to their root cause in a migration context. Strong SQL skills for complex joins, window functions, anomaly detection and source-to-target reconciliation. Working knowledge of Python, Azure Databricks or Spark SQL ...

QA Engineer

Location
Greater London, England, United Kingdom
named, specified, and tracked — not just worked around QA coverage expands naturally with each deployment increment rather than lagging behind Technical Strong SQL skills — comfortable writing and reading complex analytical queries (window functions, CTEs, aggregations) to interrogate data and verify correctness Hands-on experience with Databricks — running queries … navigating Unity Catalog, reading Spark job outputs and understanding what they mean for data quality Working knowledge of PySpark or Spark SQL — enough to read pipeline code, understand transformations, and trace where data issues originate Understanding of Lakehouse/medallion architecture (bronze-silver-gold ...

Analytics Engineer

Hiring Organisation
Serco Group
Location
London, England, United Kingdom
Looking ForEssential Skills & ExperienceStrong experience developing dashboards, reports and analytics solutions using Power BI and the wider Microsoft BI stack, including SQL, and Excel.Proven experience building and managing semantic models, datasets and governed reporting environments.Solid understanding of:Dimensional modellingSemantic layer designMedallion architectureExperience working with Databricks, Spark SQL or cloud-based analytics platforms.Ability to work collaboratively with business stakeholders and technical teams to deliver data-driven solutions.Comfortable working in agile, matrixed delivery environments.QualificationsDegree in Computer Science, Information Systems, Data Analytics or a related discipline, or equivalent practical experience.Minimum 3 years' experience working within ...

Lead Product Incubation Specialist

Hiring Organisation
Celonis
Location
London, England, United Kingdom
Business Informatics, Mathematics, Software Engineering or a comparable degree program.Extensive architectural experience implementing complex data pipelines and enterprise software integrations.Strong proficiency with Python, SQL (including PySpark/Spark SQL) and MCP or REST APIs. You are comfortable setting up complex system integrations.A strong interest ...

Principal Data Engineer

Location
Greater London, England, United Kingdom
with Pythonic data processing tools such as Pyspark and SparkSQL. Strong understanding of data modelling concepts relational and non-relational databases. Proficiency in SQL and experience with data integration and ETL tools. Excellent knowledge of big data technologies and frameworks. Strong knowledge of data governance and data security ...

Software Developer - contract

Location
Hayes End, England, United Kingdom
meeting Nomura’s regulatory and internal liquidity reporting requirements. Architect, develop, and enhance a large-scale data processing platform using Scala and Apache Spark on AWS \ MinIO . Work closely with business users to analyse business requirements and deliver high-quality data for regulatory reporting, including liquidity … written & verbal communication skills Excellent teamwork skills, comfortable with working as part of a globally spread-out team Preferred: Scala Experience Experience with Apache Spark SQL/Dataframes Knowledge of Basel III and liquidity reporting Exposure and interest in using AI coding tools such as Claude ...

Senior Applied AI Scientist

Location
Greater London, England, United Kingdom
translate technical content in commercial terms for non-technical stakeholders, such as customers, sales and product teams Desirable B2B product experience Experience with Spark SQL, PySpark, databricks Experience with CausalAI modelling frameworks (e.g. dowhy, econml) Diversity & Inclusion Intent HQ is an equal opportunities employer with ...

Senior Data Scientist

Location
Greater London, England, United Kingdom
shape our core modeling practices. Your qualifications and experience ESSENTIAL Pro at using SQL for data manipulation (PostgreSQL, MSSQL, Google BigQuery, SparkSQL, etc.) Strong coding skills in Python, R, Scala, C, Java, or JS Proven track record of using data manipulation and machine learning libraries Practical modelling & statistical … apprenticeship/work experience in a subject such as Mathematics, Statistics, Computer Science, or Geography DESIRABLE Exposure to Big Data Analytics (BigQuery, Apache Spark), Parallel Computing (Kubernetes, Databricks), Cloud Engineering (AWS, GCP, Azure), Spatial Query Optimisation, Graph Computing, or Microservices Relevant industry sector knowledge across retail, property ...

Data Analyst

Location
Greater London, England, United Kingdom
paced trading environment where insight is key to strategy Skills and experience you need as Data Analyst: Proficient in SQL & Python. PySpark & SparkSQL a bonus. Strong data viz skills using tools for presenting results such as Tableau or Power BI. Ability to write efficient code is essential ...