6 of 6 Spark SQL Jobs in London

modernisation of existing data estates. 🔧 Key Responsibilities Design and build scalable data pipelines using Databricks Develop and optimise ETL/ELT workflows using Spark (PySpark/SQL) Support migration and modernisation of legacy data platforms into Databricks Improve performance, reliability and cost efficiency across data workloads … best practices across delivery ✅ What We’re Looking For Strong hands-on experience with Databricks in a Data Engineering capacity Solid experience with Spark (PySpark/Spark SQL) Proven track record building and optimising data pipelines (ETL/ELT) Experience working within cloud environments ...

need an AI Engineer with a strong data engineering core to build AI‐powered analytics for front‐office trading teams using Databricks, Spark, and modern LLM workflows. Key Responsibilities: Design and deliver AI‐driven analytics for traders, including seasonality, correlations, regression, forecasting, and scenario modelling. Build scalable, reusable … data pipelines in Databricks using PySpark, Spark SQL, Delta Lake, and Unity Catalog. Perform statistical and econometric analysis on large market and fundamentals time‐series datasets. Work directly with traders and analysts to turn ambiguous questions into production‐ready tools and clear insights. Implement ...

experience with Palantir Foundry and/or Foundry Data Platform (FDP) Strong proficiency in: Python SQL Spark (PySpark or SparkSQL) Experience building production data pipelines in cloud environments (AWS, Azure, or GCP) Understanding of data modeling, schema design, and metadata management Familiarity with CI/ ...

emerging technologies. \* Develop reference architectures, solution blueprints, and best-practice playbooks for Databricks implementations. \* Architect scalable ETL/ELT pipelines using PySpark, Spark SQL, Delta Live Tables, and Databricks Workflows. \* Implement performance optimization strategies for notebooks, clusters, job orchestration, and data storage. \* Guide teams in building ...

experience in a data science or statistical role. Expertise in advanced analytics techniques including machine learning, optimisation and segmentation. Strong proficiency in Python, SQL and Spark SQL. Experience working with large datasets and distributed computing tools such as Azure Synapse and Snowflake. Familiarity with data transformation ...

What You Bring as Head of Data Science Proven experience leading a data science or advanced analytics function. Deep technical expertise in Python, SQL and Spark SQL. Hands-on experience with machine learning frameworks including TensorFlow, PyTorch and scikit-learn. Experience with distributed computing and cloud ...