1 to 25 of 40 Databricks Jobs in the City of London

Cost/capacity optimisation. Desirable Skills & Experience Experience across adjacent Microsoft services often paired with Fabric (e.g., Azure Synapse Analytics, Azure Data Factory, Azure Databricks, Azure Data Lake). Familiarity with Microsoft Purview and broader governance practices. Dynamics 365 CE and FO integration and analytics. Exposure to AI/ ...

Spark SQL. Experience working with large datasets and distributed computing tools such as Azure Synapse and Snowflake. Familiarity with data transformation tools (Databricks, Azure Data Factory) and ML platforms (Azure ML, TensorFlow). Experience with data visualisation tools such as Power BI. Strong commercial acumen with the ability to translate ...

delivering data governance and data cataloguing initiatives end-to-end • Hands-on experience with Microsoft Purview • Strong Azure Data Platform experience: ADLS Gen2, Azure Databricks, Data Factory • Hands-on data engineering experience (Spark/PySpark, Delta Lake) • Knowledge of security and compliance controls, GDPR, PII/DLP, RBAC/ABAC ...

Experience in implementing data governance, including data cataloging, data lineage tracking, and metadata management to ensure data accuracy, accessibility, and compliance. Preferred: Experience with Databricks Understanding of how data platforms interact with marketing and customer engagement platforms. Knowledge of service-oriented architecture, including exposing and consuming data via APIs, streams ...

translating requirements • Familiarity with Python, SQL, able to engage with data teams without coding • Cloud platforms (AWS, Azure, GCP) and modern data stacks (Databricks, Snowflake) • AI/ML-driven platforms, translating capability into business use cases Role Requirements • Background in Solutions Engineering, Technical Consulting, or Customer Success • Experience with data ...

robust outcomes. Experienced in securing work through RFI/RFPs, bids, and presentations across public and private sectors. Skilled in data science platforms (e.g. Databricks, AzureML) and cloud services (AWS, Azure, GCP), with knowledge of tools like Terraform. Experienced in deploying solutions using Docker, Kubernetes, CI/CD tools. ...

e.g., segmentation, attribution, propensity modelling) is beneficial but not required Familiarity with cloud platforms (e.g., AWS, Azure, Google Cloud) and data warehousing technologies (e.g., Databricks, BigQuery, Redshift) is a big plus Comfortable using Git for versioning and collaboration Our Commitment to You: Competitive salary 25 days holiday, plus an additional ...

looking for: ✔ Experience in a data, operations, or analytics-focused role ✔ Familiarity with BI and reporting platforms such as Power BI, Datorama, Data Studio, Databricks, SQL ✔ Strong communication skills and a collaborative, solutions-focused mindset ✔ An organised, proactive approach—comfortable working across teams and timelines ✔ Excitement for new technology, data ...

data quality practices, as well as experience working within financial markets or a similar data-intensive environment. Exposure to modern data platforms (e.g. Databricks) is highly desirable. To secure the most relevant hire, my client is prepared to offer highly competitive compensation with market-leading bonuses, alongside excellent benefits ...

capability, including dimensional and semantic modelling Strong PySpark development experience within a Lakehouse environment Advanced SQL skills for complex transformations Hands-on experience with Databricks, including pipelines and governance tooling A strong engineering mindset, with a focus on reliability, testing and maintainability Proven ability to mentor others and provide technical ...

implementation of data architecture and data engineering frameworks across ingestion, data layers, semantic layers, and consumption. • Own policies and standards for data platforms, including Databricks, integration, data management, and access controls. • Ensure platforms are designed for performance, scalability, reliability, and security. Data Governance, Quality & Compliance • Implement frameworks for data quality ...

Kubernetes is a plus. Experience designing end to end ML data pipelines. Experience with database technologies such as PostgreSQL, MySQL, or MongoDB, Spark, Databricks and stream data processing such as Kafka, RedPanda is a plus. Direct experience in building and applying large-scale (100M+ users) machine learning solutions for personalizing ...

. Build and optimize batch and real-time data pipelines across underwriting, pricing, claims, reinsurance, and bordereaux data. Develop scalable solutions using Python, PySpark, Databricks, and/or Snowflake . Integrate data from policy administration systems, claims platforms, broker systems, third-party providers, and market feeds. Ensure strong data quality … Insurance , ideally within the London Market ecosystem. Deep knowledge of underwriting, claims, delegated authority, pricing, and reinsurance. Hands-on expertise in Python, PySpark, Databricks, Snowflake, SQL . Experience with Azure, AWS, or GCP . Strong understanding of batch/streaming pipelines and data modelling. Familiarity with DevOps practices, CI/ ...

data product management, including work with data platforms, models, or analytics products Strong technical understanding of data systems, analytics, and data governance principles SQL, databricks, AI/ML product experience Ability to collaborate effectively with both technical and non-technical stakeholders Experience with agile methodologies, product lifecycle management, and roadmap ...

data consumption and querying throughAPI logictoclient-facing UI(minimal handoffs, high autonomy). Self-source the data you needby navigating our data platform (e.g., Databricks/lakehouse patterns), writing SQL, and understanding upstream structures and quality. Build and operatescalable, secure pipelines and curated data layersthat power risk analytics and insurance ...

data platform that will underpin some of the organisation’s most critical functions. Responsibilities: Design, build and deploy scalable, secure data solutions using Azure Databricks, Data Factory and Data Lake Storage. Develop and optimise advanced data pipelines with Python, SQL, Spark/PySpark and Delta Lake. Champion strong data quality … Work closely with architecture, analytics and business teams to align engineering solutions with organisational needs. Minimum Criteria Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory. Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed ...

Data Engineer – Azure - Databricks/Fabric - Remote – up to £65,000 I’m currently supporting one of the UK's fastest-growing Microsoft data consultancies as they continue to scale their team. If you're a Data Engineer who wants to work on modern Azure projects, next‐gen lakehouse architectures … role, you’ll be central to designing and delivering modern data solutions for a range of clients: Architect and deliver scalable data solutions using Databricks, Synapse, and Microsoft Fabric Build and optimise ETL/ELT pipelines and high-quality data models using SQL & Python Develop Power BI dashboards that support ...

advanced data platforms that support financial institutions in tackling fraud and financial crime. In this role, you will help design and evolve a modern Databricks + AWS lakehouse architecture , enabling analytics, machine learning, and investigative teams to generate actionable insights from large-scale datasets. This is a hands-on leadership … maintain secure AWS-based data infrastructure (S3, IAM, KMS, Glue, Lake Formation, Lambda, Step Functions, CloudWatch, etc.) Implement orchestration using tools such as Airflow, Databricks Workflows, and Step Functions Champion data quality, observability, and reliability (SLAs, monitoring, alerting, reconciliation) Drive CI/CD best practices for data platforms (infrastructure ...

capability. Powered by 600+ AI experts serving 50+ enterprise clients from 5 global locations, we work side-by-side with top partners - including Anthropic, Databricks, AWS, OpenAI, and Microsoft - to deliver modern AI with speed and measurable impact. The Opportunity We are seeking an experienced Client Director/Sales Director ...

best practices Optimise report performance through efficient queries and data modelling Integrate Power BI with cloud and on premise data platforms such as Azure Databricks Fabric Enable self service analytics through well structured datasets Provide guidance and mentoring to junior developers What We Are Looking For Strong hands-on experience … working with large datasets Experience with Power BI Gateways and deployment pipelines Knowledge of data security governance and RLS Exposure to Azure Databricks Microsoft Fabric or similar technologies Strong analytical thinking and stakeholder communication skills Nice to Have Experience in Finance Risk or Regulatory reporting environments Exposure to broader Power ...

Digital Data Senior Manager, Data Governance, Data Architecture, Data Engineering, Azure, Fabric, Databricks, London, Hybrid Digital Data Consultant required to work for a highly ambitious and fast-growing Consulting function, based in London on a hybrid basis. The expectation is to be in the office circa two days per week ...

improve efficiency and introduce AI-driven workflows Are highly proficient in PostgreSQL and at least one major data platform (e.g., Snowflake, BigQuery, Databricks, Firebolt) Experience with Node.js and TypeScript is a plus Thrive in fast-paced startup environments and feel energized by ambiguity Move quickly and constantly look for ways ...

Databricks Data Engineer – Hybrid (London) – Azure Data Services – Lloyd’s Market -Enterprise Data Platforms – up to £95,000 If you’re looking for a role where your work has impact, this is a great opportunity. You’ll be joining an organisation working with some of the most complex data challenges … help build large‐scale cloud data platforms, modernise critical data flows, and play a meaningful role in shaping long‐term Azure and Databricks strategy. The business invests heavily in wellbeing and development, offering mental‐health support and access to extensive training resources and certifications. If you enjoy solving real technical ...

between data engineering and security/IAM teams . What youll be doing Build and maintain ETL/ELT pipelines using Azure Data Factory, Databricks and SQL Server Develop and support data models, reporting layers and curated datasets for IAM/access related use cases Work with data linked … agile environment What we need Strong experience as a Data Engineer in Azure environments Strong hands-on experience with: Azure Data Factory Databricks/PySpark SQL Server/T-SQL Experience building production-grade data pipelines and data models Exposure to identity/access/security data Understanding of areas ...

lakehouse, models its core data, and shapes best practice for years to come. If you enjoy ownership, influence, and hands-on technical work across Databricks, data modelling, and pipeline development, this role offers genuine impact and long-term career growth. The Company They are investing heavily in their data capabilities … decision making across the business. The data team is still in its early stages, giving you the chance to help shape standards, strengthen their Databricks environment, and unlock more value from their growing data estate. Collaboration is central to how they work, with strong relationships across Technology, Finance, Operations ...