1 to 25 of 46 Permanent Databricks Jobs in Central London

into solution blueprints, proposals, and presentations. Enterprise Solution Design – Architect end-to-end data and cloud solutions across platforms such as Azure, AWS, GCP, Databricks, Snowflake, Synapse, or Azure Fabric. Cloud Strategy & Adoption – Define and lead cloud migration, modernisation, and optimisation strategies using tools such as Terraform, Azure DevOps ...

highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building … maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex ...

About the Job you are considering: We are looking for an experienced AWS Databricks Engineer with strong hands-on expertise in Databricks, AWS cloud services, PySpark, Spark SQL, Delta Lake, Python, SQL, and data engineering. The candidate will be responsible for designing, developing, optimizing, and supporting scalable data pipelines … noting that you will be unable to work at home 100% of the time. Your Role: Design, develop, and maintain scalable data pipelines using Databricks on AWS. Build and optimize data processing frameworks using PySpark, Spark SQL, Python, Delta Lake, and Databricks notebooks. Develop end-to-end ETL/ ...

/ML data pipelines in a clinical context. Familiarity with HL7 FHIR R4/R5 and modern SMART on FHIR architectures. Experience with Snowflake, Databricks, or Spark at scale. Why Work for Proximie? You will be encouraged to grow in your role, take ownership and gain responsibilities. Generous annual leave. ...

real-time data distribution (e.g., Kafka, Kinesis, DataFlow, Airflow), NoSQL (e.g., MongoDB, DynamoDB, HBase, CosmosDB), GraphQL and modern data warehouse tools including Snowflake and DataBricks Ability to think strategically and relate architectural decisions and recommendations to customer needs. Ability to assess traditional and modern data architectural components based on business ...

data solutions. Key Responsibilities Design and architect enterprise-scale cloud data platforms. Define data architecture strategies, standards and governance. Deliver modern data solutions using Databricks , Snowflake , AWS and GCP . Enable advanced analytics, AI and machine learning capabilities. Work closely with engineering, data and business teams to deliver ...

Engineer: Design, build and maintain scalable and secure data pipelines on the Azure platform. Develop and deploy data ingestion processes using Azure Data Factory, Databricks (PySpark), and Azure Synapse Analytics . Optimise ETL/ELT processes to improve performance, reliability and efficiency. Integrate multiple data sources including Azure Data Lake … . Required Skills & Experience - Azure Data Engineer: Proven commercial experience as a Data Engineer delivering enterprise-scale solutions in Azure Azure Data Factory Azure Databricks (PySpark) SQL & Python Understanding of CI/CD in a data environment , ideally with tools like Azure DevOps. Experience working within consultancy or client-facing ...

Python skills with the ability to work independently on complex analytical problems and large datasets in cloud data warehouses (e.g. AWS Redshift, Databricks etc.) Dashboarding & Reporting Strong experience building and maintaining dashboards in BI tools such as QuickSight, Looker, Tableau, or Power BI. Statistics & Experimentation Solid understanding of statistical concepts ...

comfort making progress where the target architecture or ownership model is still being shaped. What you might also have Experience with EY Fabric, Databricks, Azure DevOps, GitHub, Kubernetes, containerisation or equivalent enterprise DevOps platforms. Experience supporting AI, machine learning, data science, analytics or automation teams. Experience with LLM application architecture ...

Role: Contract Technical Lead Programme: Azure Databricks Platform Industry: Commodities/Energy Trading Location: London (Hybrid) Contract: Initial 6-month contract (long-term transformation programme) Rate: £900-1000/day (Inside IR35) X4 Technology are partnered with a leading global energy trading organisation delivering a major transformation, centred … their enterprise data landscape through Azure Databricks. As part of this multi-year programme, the business is migrating Oracle-based data platforms into Azure Databricks to create a scalable data platform supporting Endur, global reporting, analytics and risk, while reducing critical data latency from 10–15 minutes to near real ...

Role –Senior Databricks Architect Technology – Databricks (Spark, PySpark/SQL) and data lake architectures Location – London, UK Duration-Permanent Job Description We are looking for a Data Architect to design, build, and operate scalable data pipelines and data products, enabling a modern data mesh architecture. The role focuses on integrating … legacy systems with cloud-native platforms to support analytics, reporting, and domain-owned data products. Primary Skills • Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures. • Hands-on experience with streaming technologies, especially Kafka/Confluent Kafka. • Experience integrating legacy data sources such as DB2 (mainframe ...

Data Scientist: Experience with deep learning frameworks advanced modelling techniques Familiarity with MLOps concepts model monitoring deployment pipelines Exposure to tools such as Databricks MLflow feature stores Experience working in Agile product-led delivery environments Understanding of data governance ethics model explainability Relevant professional certifications relating to cloud data platforms ...

credentials. Domain Experience (Bonus): Prior experience in a regulated sector (Financial Services, Healthcare, Insurance). Cloud Platforms (Bonus): Familiarity with modern cloud ecosystems (Snowflake, Databricks, Azure, AWS). How to Apply Ready to shape the future of our data ecosystem? Apply directly or reach out to sajeel.sharief@randstaddigital.com to start ...

/GenAI Advanced programming skills in Python Experience with modern ML/NLP frameworks (e.g., PyTorch, Hugging Face, LangChain, LangGraph, Haystack) Experience working with Databricks or similar distributed data/ML platforms Strong understanding of experimentation design and statistical analysis Preferred qualifications Batchelor's, Masters, PhD in Computer Science, Data ...

Requirements (Must Have Skills) 6 to 8 years of experience in data software engineering with a strong focus on Azure technologies Expertise in Azure Databricks development , including efficient handling of large datasets Strong working knowledge of Azure Data Factory for building complex ETL workflows Experience with performance optimization of data ...

robust outcomes. Experienced in securing work through RFI/RFPs, bids, and presentations across public and private sectors. Skilled in data science platforms (e.g. Databricks, AzureML) and cloud services (AWS, Azure, GCP), with knowledge of tools like Terraform. Experienced in deploying solutions using Docker, Kubernetes, CI/CD tools. ...

robust outcomes. Experienced in securing work through RFI/RFPs, bids, and presentations across public and private sectors. Skilled in data science platforms (e.g. Databricks, AzureML) and cloud services (AWS, Azure, GCP), with knowledge of tools like Terraform. Experienced in deploying solutions using Docker, Kubernetes, CI/CD tools. ...

business! The following skills/experience are required: Business Analyst/Product Owner experience Strong experience with AI tools (either Microsoft Fabric, Databricks, or similar) Proven experience in Data Previous technical experience as a Developer or Engineer Financial product/traded product knowledge is desirable Any experience with Machine Learning ...

production. What you'll do Design, build, and operate cloud-native AI platform infrastructure across AWS (Lambda, API Gateway, DynamoDB, S3, CloudWatch) and Databricks Deploy and operate containerised services on Kubernetes using Terraform for infrastructure-as-code Own and scale vector search infrastructure (OpenSearch, Algolia, AWS Bedrock Knowledge Bases ...

Certification. Previous experience in leading client data engineering or integration projects is required for more senior engineers. Additional technical experience in Scala, Python and Databricks is also required. Must either hold or be eligible for SC clearance. No sponsorship is available for these roles. Modis International Ltd acts ...

constructive mindset. Nice to have Startup or scale-up experience Energy, utilities, trading, sustainability, or fintech experience Data visualisation experience Experience working with Databricks or similar data platforms Experience using AI-assisted development tools Previous involvement in shaping engineering teams, standards, or architecture Why join A salary ...

Harrington Starr is seeking a Data Engineering Lead/Technical Delivery Lead for a London-based banking client. The role combines hands-on Python engineering with leadership and delivery ownership, guiding enterprise data initiatives and ...

with focus on data integration, data quality and governance. Good understanding of modern data platforms (at least one) such as Microsoft Fabric, Snowflake or Databricks with an exposure of their application in healthcare sector for analytics and AI. Good understanding of leading frontier AI models and their application in Healthcare ...

Data Engineer with Insurance experience to play a key role in the creation of a brand-new data platform within the Azure ecosystem and Databricks . This is an exciting opportunity to be at the forefront of data innovation, working within a newly formed Data & Analytics team in a long … work closely with both technical and business stakeholders, leveraging your expertise to design, develop, and optimize a high-performance data platform built on Databricks . This platform will be built to scale, incorporating the latest advancements in data intelligence while supporting strategic business objectives. Key Responsibilities Build & Develop – Design ...

Data Software Engineer - Azure Databricks Location: London, UK Rate: £500 per day, inside IR35 Working Mode: 3 days a week on site Description We're looking for a Data Software Engineer - Azure Databricks to join our client (Financial Services) team in London, UK in an hybrid working mode. In this … role, you will design and build data engineering solutions leveraging Azure Databricks and related Azure services, enabling efficient processing and transformation of large-scale datasets. You will collaborate with cross-functional teams to ensure the delivery of optimized, reliable, and scalable data pipelines aligned with business requirements. Responsibilities Develop robust ...