1 to 25 of 42 Permanent Databricks Jobs in Central London

into solution blueprints, proposals, and presentations. Enterprise Solution Design – Architect end-to-end data and cloud solutions across platforms such as Azure, AWS, GCP, Databricks, Snowflake, Synapse, or Azure Fabric. Cloud Strategy & Adoption – Define and lead cloud migration, modernisation, and optimisation strategies using tools such as Terraform, Azure DevOps ...

highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building … maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex ...

platform Support and mentor junior engineers What They’re Looking For Strong SQL (complex queries, optimisation) Experience with tools like DBT, Dataflow, ADF, Fivetran, Databricks Solid data warehousing and modelling experience Cloud experience (GCP) Experience with Git/version control Nice to have: Python API integrations BI tools (Power ...

Spark SQL. Experience working with large datasets and distributed computing tools such as Azure Synapse and Snowflake. Familiarity with data transformation tools (Databricks, Azure Data Factory) and ML platforms (Azure ML, TensorFlow). Experience with data visualisation tools such as Power BI. Strong commercial acumen with the ability to translate ...

manage vector databases (Pinecone, Weaviate, FAISS, Milvus) to enable enterprise knowledge solutions Data & Engineering Excellence Lead the evolution of modern, enterprise-scale data platforms (Databricks, Snowflake, Synapse, BigQuery) Ensure robust data engineering and governance practices across a distributed global data estate Drive scalable lakehouse architectures (Delta Lake, Iceberg, Hudi ...

data aggregation and analytics platforms i.e. Data Lakehouse and Data Warehouse, and this would ideally have involved the use of technologies like Azure/Databricks/ADF but other cloud and database technologies considered (e.g. AWS/GCP, Snowflake, Fabric). You must be confident engaging with technical ...

making • Working closely with data engineering and platform teams • Translating complex outputs into clear, actionable insight • Agile, cross-functional delivery Tech Python, SQL, R, Databricks, PySpark, GIS tools, optimisation frameworks, cloud platforms Requirements Degree or higher in Data Science, Mathematics, Operational Research, Engineering, Physics, Geography, or similar Experience working with ...

portfolio datasets Time series familiarity (trend/seasonality, cohorts over time, monitoring) Experience with data tools such as dbt, Airflow, Snowflake/BigQuery/Databricks (or similar) Experience creating automated data quality frameworks or reconciliation checks Benefits: £45,000 – £55,000 salary Hybrid working in London Strong benefits package (details ...

Experience in implementing data governance, including data cataloging, data lineage tracking, and metadata management to ensure data accuracy, accessibility, and compliance. Preferred: Experience with Databricks Understanding of how data platforms interact with marketing and customer engagement platforms. Knowledge of service-oriented architecture, including exposing and consuming data via APIs, streams ...

with regulatory reporting systems in banking Knowledge of data quality, security, and compliance requirements Desirable Skills Exposure to cloud platforms such as Azure or Databricks Familiarity with middleware technologies (e.g. Kafka, IIB, MQ) Experience with ECB/AQR reporting frameworks Key Competencies Strong analytical and problem-solving abilities Ability ...

robust outcomes. Experienced in securing work through RFI/RFPs, bids, and presentations across public and private sectors. Skilled in data science platforms (e.g. Databricks, AzureML) and cloud services (AWS, Azure, GCP), with knowledge of tools like Terraform. Experienced in deploying solutions using Docker, Kubernetes, CI/CD tools. ...

looking for: ✔ Experience in a data, operations, or analytics-focused role ✔ Familiarity with BI and reporting platforms such as Power BI, Datorama, Data Studio, Databricks, SQL ✔ Strong communication skills and a collaborative, solutions-focused mindset ✔ An organised, proactive approach—comfortable working across teams and timelines ✔ Excitement for new technology, data ...

standards Qualifications ✔ Experience in a data, operations, or analytics-focused role ✔ Familiarity with BI and reporting platforms such as Power BI, Datorama, Data Studio, Databricks, SQL ✔ Strong communication skills and a collaborative, solutions-focused mindset ✔ An organised, proactive approach—comfortable working across teams and timelines ✔ Excitement for new technology, data ...

scale; orchestration with Airflow, Prefect, or equivalent; reliability-first mindset including backfill, retry, and exactly-once semantics * Azure data platform - Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake Storage; infrastructure as code for data workloads (Terraform or Bicep) * Databricks - Delta Lake, Unity Catalog, job cluster vs interactive … Refinitiv), tick data, trade history, reference data, or instrument master management * Apache Spark or Flink for large-scale stream and batch processing beyond the Databricks ecosystem * dbt or equivalent SQL transformation layer; experience building and maintaining dbt projects in a production data warehouse * Event streaming with Kafka or Confluent Platform ...

data quality practices, as well as experience working within financial markets or a similar data-intensive environment. Exposure to modern data platforms (e.g. Databricks) is highly desirable. To secure the most relevant hire, my client is prepared to offer highly competitive compensation with market-leading bonuses, alongside excellent benefits ...

Hands‐on experience writing PySpark in a Lakehouse or big data environment Strong SQL skills for building and maintaining transformation logic Experience working with Databricks or similar modern data platforms An engineering mindset with attention to data quality, reliability and maintainability Comfortable working with both technical teams and business stakeholders ...

capability, including dimensional and semantic modelling Strong PySpark development experience within a Lakehouse environment Advanced SQL skills for complex transformations Hands-on experience with Databricks, including pipelines and governance tooling A strong engineering mindset, with a focus on reliability, testing and maintainability Proven ability to mentor others and provide technical ...

implementation of data architecture and data engineering frameworks across ingestion, data layers, semantic layers, and consumption. • Own policies and standards for data platforms, including Databricks, integration, data management, and access controls. • Ensure platforms are designed for performance, scalability, reliability, and security. Data Governance, Quality & Compliance • Implement frameworks for data quality ...

Kubernetes is a plus. Experience designing end to end ML data pipelines. Experience with database technologies such as PostgreSQL, MySQL, or MongoDB, Spark, Databricks and stream data processing such as Kafka, RedPanda is a plus. Direct experience in building and applying large-scale (100M+ users) machine learning solutions for personalizing ...

. Build and optimize batch and real-time data pipelines across underwriting, pricing, claims, reinsurance, and bordereaux data. Develop scalable solutions using Python, PySpark, Databricks, and/or Snowflake . Integrate data from policy administration systems, claims platforms, broker systems, third-party providers, and market feeds. Ensure strong data quality … Insurance , ideally within the London Market ecosystem. Deep knowledge of underwriting, claims, delegated authority, pricing, and reinsurance. Hands-on expertise in Python, PySpark, Databricks, Snowflake, SQL . Experience with Azure, AWS, or GCP . Strong understanding of batch/streaming pipelines and data modelling. Familiarity with DevOps practices, CI/ ...

data consumption and querying throughAPI logictoclient-facing UI(minimal handoffs, high autonomy). Self-source the data you needby navigating our data platform (e.g., Databricks/lakehouse patterns), writing SQL, and understanding upstream structures and quality. Build and operatescalable, secure pipelines and curated data layersthat power risk analytics and insurance ...

data platform that will underpin some of the organisation’s most critical functions. Responsibilities: Design, build and deploy scalable, secure data solutions using Azure Databricks, Data Factory and Data Lake Storage. Develop and optimise advanced data pipelines with Python, SQL, Spark/PySpark and Delta Lake. Champion strong data quality … Work closely with architecture, analytics and business teams to align engineering solutions with organisational needs. Minimum Criteria Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory. Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed ...

models and transformation layers that enable self service analytics and high quality reporting. In this role, you will design and optimise data workflows across Databricks and BigQuery, develop scalable datasets, and support BI tools such as Tableau and Looker Studio. You will collaborate closely with data engineering, analysts, and business ...

digital reporting over the next 6–9 months (major focus of the role) Extract and model digital data using SQL (GA4, BigQuery/Databricks) Build clear, reliable dashboards in Power BI or Tableau Support verification of Tag Manager setups and onboarding of new digital vendors (e.g., AppsFlyer, attribution tools) Help ...

Data Engineer with Insurance experience to play a key role in the creation of a brand-new data platform within the Azure ecosystem and Databricks . This is an exciting opportunity to be at the forefront of data innovation, working within a newly formed Data & Analytics team in a long … work closely with both technical and business stakeholders, leveraging your expertise to design, develop, and optimize a high-performance data platform built on Databricks . This platform will be built to scale, incorporating the latest advancements in data intelligence while supporting strategic business objectives. Key Responsibilities Build & Develop – Design ...