1 to 25 of 42 Databricks Jobs in the City of London

About the Job you are considering: We are looking for an experienced AWS Databricks Engineer with strong hands-on expertise in Databricks, AWS cloud services, PySpark, Spark SQL, Delta Lake, Python, SQL, and data engineering. The candidate will be responsible for designing, developing, optimizing, and supporting scalable data pipelines … noting that you will be unable to work at home 100% of the time. Your Role: Design, develop, and maintain scalable data pipelines using Databricks on AWS. Build and optimize data processing frameworks using PySpark, Spark SQL, Python, Delta Lake, and Databricks notebooks. Develop end-to-end ETL/ ...

Senior Data Engineer & Technical Delivery Lead (Python/Databricks) Location: London (Hybrid – 2-3 days onsite) Contract: Initial 6 months We're currently supporting a major Investment Bank that's expanding its Data Engineering function and is looking to hire multiple contractors across Senior Data Engineer and Technical Delivery Lead … speak with you. You'll be joining a large-scale cloud data transformation programme, helping design, build and optimise enterprise data platforms using Python, Databricks and Spark within a modern Lakehouse environment. Key Responsibilities Design, develop and maintain scalable data pipelines using Python and Databricks. Build, optimise and support enterprise ...

real-time data distribution (e.g., Kafka, Kinesis, DataFlow, Airflow), NoSQL (e.g., MongoDB, DynamoDB, HBase, CosmosDB), GraphQL and modern data warehouse tools including Snowflake and DataBricks Ability to think strategically and relate architectural decisions and recommendations to customer needs. Ability to assess traditional and modern data architectural components based on business ...

data solutions. Key Responsibilities Design and architect enterprise-scale cloud data platforms. Define data architecture strategies, standards and governance. Deliver modern data solutions using Databricks , Snowflake , AWS and GCP . Enable advanced analytics, AI and machine learning capabilities. Work closely with engineering, data and business teams to deliver ...

Engineer: Design, build and maintain scalable and secure data pipelines on the Azure platform. Develop and deploy data ingestion processes using Azure Data Factory, Databricks (PySpark), and Azure Synapse Analytics . Optimise ETL/ELT processes to improve performance, reliability and efficiency. Integrate multiple data sources including Azure Data Lake … . Required Skills & Experience - Azure Data Engineer: Proven commercial experience as a Data Engineer delivering enterprise-scale solutions in Azure Azure Data Factory Azure Databricks (PySpark) SQL & Python Understanding of CI/CD in a data environment , ideally with tools like Azure DevOps. Experience working within consultancy or client-facing ...

Python skills with the ability to work independently on complex analytical problems and large datasets in cloud data warehouses (e.g. AWS Redshift, Databricks etc.) Dashboarding & Reporting Strong experience building and maintaining dashboards in BI tools such as QuickSight, Looker, Tableau, or Power BI. Statistics & Experimentation Solid understanding of statistical concepts ...

comfort making progress where the target architecture or ownership model is still being shaped. What you might also have Experience with EY Fabric, Databricks, Azure DevOps, GitHub, Kubernetes, containerisation or equivalent enterprise DevOps platforms. Experience supporting AI, machine learning, data science, analytics or automation teams. Experience with LLM application architecture ...

Role: Contract Technical Lead Programme: Azure Databricks Platform Industry: Commodities/Energy Trading Location: London (Hybrid) Contract: Initial 6-month contract (long-term transformation programme) Rate: £900-1000/day (Inside IR35) X4 Technology are partnered with a leading global energy trading organisation delivering a major transformation, centred … their enterprise data landscape through Azure Databricks. As part of this multi-year programme, the business is migrating Oracle-based data platforms into Azure Databricks to create a scalable data platform supporting Endur, global reporting, analytics and risk, while reducing critical data latency from 10–15 minutes to near real ...

Role –Senior Databricks Architect Technology – Databricks (Spark, PySpark/SQL) and data lake architectures Location – London, UK Duration-Permanent Job Description We are looking for a Data Architect to design, build, and operate scalable data pipelines and data products, enabling a modern data mesh architecture. The role focuses on integrating … legacy systems with cloud-native platforms to support analytics, reporting, and domain-owned data products. Primary Skills • Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures. • Hands-on experience with streaming technologies, especially Kafka/Confluent Kafka. • Experience integrating legacy data sources such as DB2 (mainframe ...

Data Scientist: Experience with deep learning frameworks advanced modelling techniques Familiarity with MLOps concepts model monitoring deployment pipelines Exposure to tools such as Databricks MLflow feature stores Experience working in Agile product-led delivery environments Understanding of data governance ethics model explainability Relevant professional certifications relating to cloud data platforms ...

credentials. Domain Experience (Bonus): Prior experience in a regulated sector (Financial Services, Healthcare, Insurance). Cloud Platforms (Bonus): Familiarity with modern cloud ecosystems (Snowflake, Databricks, Azure, AWS). How to Apply Ready to shape the future of our data ecosystem? Apply directly or reach out to sajeel.sharief@randstaddigital.com to start ...

/GenAI Advanced programming skills in Python Experience with modern ML/NLP frameworks (e.g., PyTorch, Hugging Face, LangChain, LangGraph, Haystack) Experience working with Databricks or similar distributed data/ML platforms Strong understanding of experimentation design and statistical analysis Preferred qualifications Batchelor's, Masters, PhD in Computer Science, Data ...

Requirements (Must Have Skills) 6 to 8 years of experience in data software engineering with a strong focus on Azure technologies Expertise in Azure Databricks development , including efficient handling of large datasets Strong working knowledge of Azure Data Factory for building complex ETL workflows Experience with performance optimization of data ...

robust outcomes. Experienced in securing work through RFI/RFPs, bids, and presentations across public and private sectors. Skilled in data science platforms (e.g. Databricks, AzureML) and cloud services (AWS, Azure, GCP), with knowledge of tools like Terraform. Experienced in deploying solutions using Docker, Kubernetes, CI/CD tools. ...

robust outcomes. Experienced in securing work through RFI/RFPs, bids, and presentations across public and private sectors. Skilled in data science platforms (e.g. Databricks, AzureML) and cloud services (AWS, Azure, GCP), with knowledge of tools like Terraform. Experienced in deploying solutions using Docker, Kubernetes, CI/CD tools. ...

beneficial includes: Private equity-backed or venture-backed businesses. Multi-entity and multi-currency environments. Salesforce, Power BI or other business intelligence tools. SQL, Databricks or modern data platforms. An interest in leveraging AI tools to improve reporting and finance processes. Apply To apply for this Interim FP&A Manager ...

data into our lakehouse and other parallel data stores, introducing data retention policies, and helping migrate to modern SQL frameworks and languages. Tech stack: Databricks, DBT, Fivetran, Python, SQL, AWS, Terraform, Kafka, ECS, Kubernetes. Location: London HQ but mainly remote. ...

business! The following skills/experience are required: Business Analyst/Product Owner experience Strong experience with AI tools (either Microsoft Fabric, Databricks, or similar) Proven experience in Data Previous technical experience as a Developer or Engineer Financial product/traded product knowledge is desirable Any experience with Machine Learning ...

production. What you'll do Design, build, and operate cloud-native AI platform infrastructure across AWS (Lambda, API Gateway, DynamoDB, S3, CloudWatch) and Databricks Deploy and operate containerised services on Kubernetes using Terraform for infrastructure-as-code Own and scale vector search infrastructure (OpenSearch, Algolia, AWS Bedrock Knowledge Bases ...

Certification. Previous experience in leading client data engineering or integration projects is required for more senior engineers. Additional technical experience in Scala, Python and Databricks is also required. Must either hold or be eligible for SC clearance. No sponsorship is available for these roles. Modis International Ltd acts ...

Harrington Starr is seeking a Data Engineering Lead/Technical Delivery Lead for a London-based banking client. The role combines hands-on Python engineering with leadership and delivery ownership, guiding enterprise data initiatives and ...

with focus on data integration, data quality and governance. Good understanding of modern data platforms (at least one) such as Microsoft Fabric, Snowflake or Databricks with an exposure of their application in healthcare sector for analytics and AI. Good understanding of leading frontier AI models and their application in Healthcare ...

Data Software Engineer - Azure Databricks Location: London, UK Rate: £500 per day, inside IR35 Working Mode: 3 days a week on site Description We're looking for a Data Software Engineer - Azure Databricks to join our client (Financial Services) team in London, UK in an hybrid working mode. In this … role, you will design and build data engineering solutions leveraging Azure Databricks and related Azure services, enabling efficient processing and transformation of large-scale datasets. You will collaborate with cross-functional teams to ensure the delivery of optimized, reliable, and scalable data pipelines aligned with business requirements. Responsibilities Develop robust ...

including GA4 and/or Firebase (for app analytics), SQL (working with large-scale data environments), and large-scale data platforms (e.g. BigQuery, Teradata, Databricks); nice-to-have experience with customer segmentation and personalisation frameworks, Python or similar tools for advanced analysis or experimentation, and working in multi-market/ ...

trusted advisor Resolve critical delivery risks and escalations across workstreams Ensure integration across finance, data, and technology domains (e.g. SAC Planning, BDC, Datasphere/Databricks/Snowflake) Own and contribute to sales pipelines, leading pursuits and proposals for EPM Shape client propositions around FP&A Transformation Lead bid teams, including ...