76 to 100 of 108 Databricks Jobs in the City of London

customer-focused dashboards that power decision-making across the organisation Driving the build-out of automated workflows and data pipelines using cloud tooling (e.g. Databricks, Airflow) and the Microsoft Power Platform Shaping the direction of analytics architecture and ensuring data products align with broader Group standards Empowering store teams with … Apps, Power Automate) Deep knowledge of data visualisation principles and storytelling best practice Confident SQL ability Experience working with cloud analytics platforms such as Databricks, Snowflake, or BigQuery Background delivering automated workflows or pipelines using tools like Airflow or Databricks Previous experience leading teams within agile frameworks, managing priorities ...

data transformation journey. 🎯 What We’re Looking For: Proven experience in data engineering and solution design Strong skills in Azure Data Factory, Databricks, Unity Catalogue, and SQL Server Practical knowledge of data modelling and ETL development Hands-on coding and development with a focus on quality Excellent communication and stakeholder … Develop and maintain applications and automation tools Champion best practices in data quality, lineage, and governance Act as SME in Azure Data Factory, Azure Databricks, Unity Catalogue, and SQL Server Support agile delivery, code control, and QA standards Monitor and improve existing data sets and processes Enable colleagues through testing ...

hiring for Senior Data Analyst - (SQL/Python/ADF/Databricks/insurance) Location: London, UK Hybrid - 2-3 weekly Job Description: Perform data profiling, mapping, and data quality analysis on complex insurance datasets across policy, claims, quotes, and pricing systems. Analyze source-to-target data flows and translate … quality dashboards and reconciliation reports. Participate in sprint planning, agile ceremonies, and timely delivery of data artefacts. Key Skills: SQL, Python, Azure Data Factory, Databricks, Data Profiling, Data Quality, Insurance Data, Agile, Data Mapping ...

Physical) to support business needs ensuring data integrity and efficiency. • Design and govern data architecture and integration standards across Azure Data Factory and Databricks to enable integrated analytics solutions. • Manage the Information Management framework, architecture, processes, and solutions • Be responsible for strategic roadmaps that describe the journey to target state … Architecture and Data modeling Property & Casualty domain experience is a MUST Proficiency with data modeling tools like Erwin Experience with Azure Data Factory and Databricks including orchestrating and designing data pipelines PROFILE • 10+ years of experience in hands-on design, engineering, administration, and implementation of comprehensive systems and architectures ...

implementing high-performance data solutions used directly by trading, risk, analytics and operational teams. Whilst the firm have agreed to do an Azure Databricks POC platform in Q1 2026, with so much of their data on-prem, they are still showcasing different Cloud-native platforms, and therefore are looking … where you’ll be working with a high skilled small team of engineers while designing and developing a next-generation lakehouse architecture . Azure Databricks & ClickHouse will form the backbone of examples of 2 systems, supporting ultra-fast analytics, market-data ingestion, tick-data storage, and real-time insights ...

Senior Data Engineer Databricks/Azure/SQL London 2-3 days on-site £65,000 - £72,000 + 20% Bonus + Excellent Benefits Our client is a leading global hospitality brand undergoing an exciting period of rapid growth and transformation. With significant investment in data and technology, they … supply chain and logistics to marketing, customer sales and in-store operations. We are seeking an experienced Senior Data Engineer with deep expertise in Databricks to design, build, and optimize the clients data platform. This role will be pivotal in developing scalable data pipelines, enabling advanced analytics, and driving data ...

experience managing a squad of 47 Data Engineers. Youll bring solid SQL skills, cloud expertise (preferably Azure), and familiarity with tools such as Snowflake, Databricks, ADF, Python, and GenAI. Youll manage a squad of engineers and play a key role in delivering scalable, modern data solutions as part … Services experience is a plus. Experience managing Data Engineering teams Strong SQL and cloud skills (Azure preferred) Familiar with modern data tools (e.g. Snowflake, Databricks, ADF, Python) Track record of building/maintaining robust data pipelines Agile experience Financial Services experience is a bonus If you are an experienced Data ...

business make confident, data-driven decisions. Why this role is exciting: • Work in a modern data environment with tools like dbt, Airflow, Python, AWS, Databricks and Looker/BI platforms • Build scalable data models, pipelines and self-serve analytics solutions • Automate processes and improve operational efficiency, including using modern … evolution of the analytics platform Requirements: • Proven experience building analytics data models and pipelines in a cloud environment • Strong SQL, Python, dbt, Databricks and BI platform experience • Solid understanding of data modelling, warehousing, governance and analytics best practice • Excellent communicator and collaborative mindset Location & Working Pattern: London – hybrid with ...

faster across cloud and distributed environments. Build and optimize data pipelines for large-scale, multimodal datasets. Design and operate distributed data processing across Spark, Databricks, and Kubernetes. Improve developer productivity through faster builds, better orchestration, and scalable infra. Productionize ML models (PyTorch), from prototype to deployment. We are seeking someone … with the following experience: Strong Python programming and solid data engineering fundamentals. Hands-on with Ray, Spark, Databricks, or similar distributed compute frameworks. Experience managing cloud infrastructure, Kubernetes, and CI/CD pipelines. Familiar with dataset versioning, orchestration, and experiment tracking (DVC, MLflow, Airflow). Ideally, we are looking ...

Senior Data Engineer - Azure Databricks Location: Hybrid (1-2 days a week in London) Initial 6 months contract Overview An established technology organisation that is now going through significant change and growth is looking for a Senior Data Engineer to help design, build, and secure a modern data platform that … help shape the future data architecture. Key Responsibilities Design and build end-to-end data pipelines, data lakes, and data warehouses using Azure Databricks Integrate ETL/ELT tools and cloud services for batch and real-time data processing Experience building data pipelines on-prem Define and implement standards ...

days per week onsite What you’ll be doing: Design, build, and optimise scalable data pipelines and architecture Work hands-on with SQL, PySpark, Databricks, Azure, and Data Lake to deliver high-performance solutions Translate business needs into technical requirements and data-driven solutions Ensure best practice in data governance … What you’ll need: Proven experience as a Data Engineer or Senior Data Engineer with some team leadership responsibilities Strong technical expertise with PySpark, Databricks, Azure, and Data Lake Deep understanding of data architecture and ETL processes in cloud environments The ability to balance coding and technical delivery with people ...

truth. Develop and optimise CI/CD pipelines in Azure DevOps to automate deployment of workspaces, Unity Catalog, networking, and security. Work with Databricks (Spark/Scala, PySpark) to support ingestion frameworks, data processing, and platform-level libraries. Implement secure connectivity (VNET injection, Private Link, firewall, DNS, RBAC). Monitor … Document infrastructure, processes, and standards for wider engineering adoption. Must Have: Proven expertise with Microsoft Azure (networking, security, storage, compute). Strong proficiency in Databricks with hands-on Scala (Spark) and PySpark . Deep experience with Terraform for Azure resource deployment and governance. Hands-on with Azure DevOps pipelines (YAML ...

using Microsoft Azure. Build and optimize data lakes and data warehouses (e.g., Snowflake). Implement and manage data and machine learning platforms such as Databricks, Azure ML, and Synapse ML. Support ML lifecycle management using tools like MLflow. Ensure data solutions are secure, scalable, and cost-efficient, aligned with compliance … experience in cloud-based data engineering. Strong proficiency in Microsoft Azure services. Experience with data lakes, data warehouses, and ETL pipelines. Familiarity with Snowflake, Databricks, and Azure ML. Understanding of ML lifecycle tools (e.g., MLflow) and Synapse ML. Solid knowledge of data security, governance, and performance optimization. Desirable Exposure ...

Data Engineering Manager – Azure & Databricks Location: Hybrid (London-based) Salary: Competitive + Benefits Type: Permanent (Open to contract) About the Company Our client is a fast-growing Microsoft Partner consultancy on a mission to help businesses unlock the full potential of their data. They are building out their Data Engineering … technical roles, working your way up from a data engineer. Strong hands-on expertise with Azure Data Services (Data Lake, Synapse, Data Factory) and Databricks - need to be comfortable getting into the weeds of the work and building stuff yourself as well. Solid understanding of data architecture concepts, ETL pipelines ...

This role is a hands-on senior Solution Architect acting as the technical and design authority for a modern cloud-based data platform, with Databricks at the core. The architect bridges investment business needs, data engineering, and platform architecture, setting standards others must follow. Key Responsibilities Architecture & Design Authority Define … regulatory expectations Required Domain Knowledge (Must-Have) Candidates must have experience in investment or financial services environments Technical Requirements Core Stack (Strong Preference) Databricks (Lakehouse architecture, design patterns) AWS (deep understanding of cloud-native architecture) Snowflake (integration patterns, data sharing) Engineering Background (Critical) Strong backend/platform engineering heritage Comfortable ...

Ideas People Trust We're BDO. An accountancy and business advisory firm, providing the advice and solutions businesses need to navigate today's changing world. Our clients are Britain's economic engine - ambitious, entrepreneurially-spirited ...

their customers, informing business strategy and decision making. Help and lead the development of automation solutions and workflow integrations, using platforms such as Databricks, Airflow, Power Apps, Power Automat. Help define the right data flow architecture that delivers tangible results quickly. Lead and develop a small team of Analysts. Develop … will be: Proven within Power BI, Power Apps, Power Automate. Well versed in data visualisation and BI best practice. Expert in SQL. Experience within Databricks, Snowflake, or Google BigQuery. Proven record of managing automation and workflow tools and embedding them in operational processes. Experience leading teams. Experience of developing internal ...

Build, operate, and optimise RAG and LLM-backed services, improving latency, reliability, and cost. Design and run cloud-native AI services across AWS and Databricks, including ingestion and embedding pipelines. Scale and operate vector search infrastructure (Weaviate, OpenSearch, Algolia, AWS Bedrock Knowledge Bases). Implement strong observability, CI/… Required Skills & Experience Strong experience designing and operating cloud-native platforms on AWS (Lambda, API Gateway, DynamoDB, S3, CloudWatch). Hands-on experience with Databricks and large-scale data or embedding pipelines. Proven experience building and operating production AI systems , including RAG pipelines, LLM-backed services, and vector search (Weaviate ...

Director - Head of eFX - C++, Java, Python, FX, eFX, Low-latency, Trading, Front Office, Linux, Unix, Multithreading, Agile, DevOps, Cloud, Databases, Databricks, Kafka I am working with a leading Investment Banks which is looking for a Head of eFX (Director level) to join their Information Systems Department who provide … speak with you. Director - Head of eFX - C++, Java, Python, FX, eFX, Low-latency, Trading, Front Office, Linux, Unix, Multithreading, Agile, DevOps, Cloud, Databases, Databricks, Kafka ...

having experience building websites from the ground up using React or Angular. ⚙️ You will contribute to the ongoing migration from C# to Python and Databricks, helping modernise the technology landscape. 🔌 You will integrate APIs, connect services, and ensure smooth end-to-end architecture across multiple platforms. 📊 You will support … modelling and engineering capability 🔧 Azure DevOps, Git, CI/CD 💬 Good PowerShell scripting 📚 Understanding of API integration & system architecture Desirable 🐍 Exposure to Python and Databricks 🔄 ETL workflows/SSIS 📜 Regulatory reporting knowledge — especially: EMIR MiFID REMIT Secondary: MASS , Canadian regulations 📈 Experience with business-rule-heavy platforms You don’t need ...

Engineering Manager, Machine Learning, Marketplace, Ecommerce, | 35 Million Users | UK Remote OR London, Hybrid, 1 Day PW, Up to £140,000 About the Company Our client is an extremely well know, digital marketplace focused on ...

Senior Data Scientist - Recommender Systems Experience Salaries in the region of £65,000 - £75,000 DoE Hybrid working - 2 days central London office Job Reference J13031 Full UK working rights required/no sponsorship available ...

Senior Data Engineer Location: Manchester Salary: Up to £100,000 and bonus We are seeking an experienced Data Engineer with expertise in Databricks to join a global consultancy on a major transformation project. This is a fantastic opportunity to work on cutting-edge data solutions in a collaborative, forward-thinking ...

month in the office Salary: Competitive Job Ref: J13048 An opportunity to lead a small Analytics Engineering team and shape modern data models in Databricks that support confident decision making. You will guide how data is organised and delivered, helping the business access clear, trusted information at pace. Responsibilities: Build … scalable data models in Databricks Lead and support Analytics Engineers Partner with Data Engineering and Governance teams Improve clarity, quality and structure of data Translate business needs into clear technical plans Experience required: Strong skills in data modelling SQL with either Python or PySpark Databricks or similar cloud data platform ...

Data Engineer - £75k-£85k + bonus – London (hybrid) Our client are a globally leading and PE-backed services company, building out a completely greenfield Databricks platform and looking for an experienced Engineer to play a key role in leading and owning this transformation. Joining a well-established team, you will … hands-on Data Engineer with a good few years of experience across Databricks, Azure and SQL. Synapse whilst not essential, would be helpful as they are moving away from this. This is a technical role, however someone who is keen to collaborate with different teams, help gather user requirements ...