1 to 25 of 45 Databricks Jobs in the City of London

Data Engineer or within a similar role. Strong experience with Python or PySpark . Experience with cloud data platforms such as Microsoft Fabric, Databricks or Snowflake . Knowledge of SQL and data transformation techniques. Experience building and maintaining data pipelines. Previous experience working within the construction industry . Excellent analytical ...

About the Job you are considering: We are looking for an experienced AWS Databricks Engineer with strong hands-on expertise in Databricks, AWS cloud services, PySpark, Spark SQL, Delta Lake, Python, SQL, and data engineering. The candidate will be responsible for designing, developing, optimizing, and supporting scalable data pipelines … noting that you will be unable to work at home 100% of the time. Your Role: Design, develop, and maintain scalable data pipelines using Databricks on AWS. Build and optimize data processing frameworks using PySpark, Spark SQL, Python, Delta Lake, and Databricks notebooks. Develop end-to-end ETL/ ...

Senior Data Engineer & Technical Delivery Lead (Python/Databricks) Location: London (Hybrid – 2-3 days onsite) Contract: Initial 6 months We're currently supporting a major Investment Bank that's expanding its Data Engineering function and is looking to hire multiple contractors across Senior Data Engineer and Technical Delivery Lead … speak with you. You'll be joining a large-scale cloud data transformation programme, helping design, build and optimise enterprise data platforms using Python, Databricks and Spark within a modern Lakehouse environment. Key Responsibilities Design, develop and maintain scalable data pipelines using Python and Databricks. Build, optimise and support enterprise ...

real-time data distribution (e.g., Kafka, Kinesis, DataFlow, Airflow), NoSQL (e.g., MongoDB, DynamoDB, HBase, CosmosDB), GraphQL and modern data warehouse tools including Snowflake and DataBricks Ability to think strategically and relate architectural decisions and recommendations to customer needs. Ability to assess traditional and modern data architectural components based on business ...

audit requirements. Extensive experience designing and implementing resilient data ingestion, orchestration, and provisioning capabilities for enterprise-scale workloads. Strong hands-on experience with Databricks (AWS and/or Azure), including Lakehouse architecture, distributed processing, and production operations. Strong hands-on experience with Apache Kafka and event-driven integration architectures. Proven … engineering solutions. Desirable: Experience in financial services, with exposure to ETD and OTC derivative markets highly desirable. Hands-on experience with: Azure Data Factory, Databricks Asset Bundles, Power BI, Dbt, NodeJS, Amazon API Gateway Experience working with Kafka or similar Experience with Azure DevOps (ADO), Bitbucket, and Git-based workflows. ...

data solutions. Key Responsibilities Design and architect enterprise-scale cloud data platforms. Define data architecture strategies, standards and governance. Deliver modern data solutions using Databricks , Snowflake , AWS and GCP . Enable advanced analytics, AI and machine learning capabilities. Work closely with engineering, data and business teams to deliver ...

across comparable technologies. Examples of technologies in scope include: Data processing and logic: ANSI SQL, Apache Spark, Kafka Platforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQ Engineering and deployment: CI/CD tooling, containerised or Kubernetes‐based deployment approaches where relevant You'll also work with ...

comfort making progress where the target architecture or ownership model is still being shaped. What you might also have Experience with EY Fabric, Databricks, Azure DevOps, GitHub, Kubernetes, containerisation or equivalent enterprise DevOps platforms. Experience supporting AI, machine learning, data science, analytics or automation teams. Experience with LLM application architecture ...

Role: Contract Technical Lead Programme: Azure Databricks Platform Industry: Commodities/Energy Trading Location: London (Hybrid) Contract: Initial 6-month contract (long-term transformation programme) Rate: £900-1000/day (Inside IR35) X4 Technology are partnered with a leading global energy trading organisation delivering a major transformation, centred … their enterprise data landscape through Azure Databricks. As part of this multi-year programme, the business is migrating Oracle-based data platforms into Azure Databricks to create a scalable data platform supporting Endur, global reporting, analytics and risk, while reducing critical data latency from 10–15 minutes to near real ...

Databricks Delivery Manager | London (Hybrid - 2 days per week) | Up to £100,000 + Bonus We're partnering with a leading technology consultancy looking to hire an experienced Databricks Delivery Manager to lead the successful delivery of enterprise-scale data transformation programmes. You'll work with major clients, managing cross … functional delivery teams across Azure and Databricks projects, ensuring high-quality outcomes from inception through to go-live. We're looking for: Proven consulting experience (essential) Hands-on delivery of enterprise Databricks projects (essential) Strong programme/project delivery and stakeholder management experience Pre-sales experience is highly desirable Experience ...

credentials. Domain Experience (Bonus): Prior experience in a regulated sector (Financial Services, Healthcare, Insurance). Cloud Platforms (Bonus): Familiarity with modern cloud ecosystems (Snowflake, Databricks, Azure, AWS). How to Apply Ready to shape the future of our data ecosystem? Apply directly or reach out to sajeel.sharief@randstaddigital.com to start ...

/GenAI Advanced programming skills in Python Experience with modern ML/NLP frameworks (e.g., PyTorch, Hugging Face, LangChain, LangGraph, Haystack) Experience working with Databricks or similar distributed data/ML platforms Strong understanding of experimentation design and statistical analysis Preferred qualifications Batchelor's, Masters, PhD in Computer Science, Data ...

Requirements (Must Have Skills) 6 to 8 years of experience in data software engineering with a strong focus on Azure technologies Expertise in Azure Databricks development , including efficient handling of large datasets Strong working knowledge of Azure Data Factory for building complex ETL workflows Experience with performance optimization of data ...

robust outcomes. Experienced in securing work through RFI/RFPs, bids, and presentations across public and private sectors. Skilled in data science platforms (e.g. Databricks, AzureML) and cloud services (AWS, Azure, GCP), with knowledge of tools like Terraform. Experienced in deploying solutions using Docker, Kubernetes, CI/CD tools. ...

robust outcomes. Experienced in securing work through RFI/RFPs, bids, and presentations across public and private sectors. Skilled in data science platforms (e.g. Databricks, AzureML) and cloud services (AWS, Azure, GCP), with knowledge of tools like Terraform. Experienced in deploying solutions using Docker, Kubernetes, CI/CD tools. ...

business! The following skills/experience are required: Business Analyst/Product Owner experience Strong experience with AI tools (either Microsoft Fabric, Databricks, or similar) Proven experience in Data Previous technical experience as a Developer or Engineer Financial product/traded product knowledge is desirable Any experience with Machine Learning ...

production. What you'll do Design, build, and operate cloud-native AI platform infrastructure across AWS (Lambda, API Gateway, DynamoDB, S3, CloudWatch) and Databricks Deploy and operate containerised services on Kubernetes using Terraform for infrastructure-as-code Own and scale vector search infrastructure (OpenSearch, Algolia, AWS Bedrock Knowledge Bases ...

Certification. Previous experience in leading client data engineering or integration projects is required for more senior engineers. Additional technical experience in Scala, Python and Databricks is also required. Must either hold or be eligible for SC clearance. No sponsorship is available for these roles. Modis International Ltd acts ...

Harrington Starr is seeking a Data Engineering Lead/Technical Delivery Lead for a London-based banking client. The role combines hands-on Python engineering with leadership and delivery ownership, guiding enterprise data initiatives and ...

Data Architect (Databricks) | UK Remote/Hybrid | £100,000 - £120,000 Peaple Talent have partnered with a leading data consultancy that's continuing to invest heavily in its Data & AI practice and is looking to hire an experienced Data Architect with strong Databricks expertise. This is a fantastic opportunity … designing modern Lakehouse architectures that enable advanced analytics, AI and data-driven decision making. What you'll be doing: Designing and delivering enterprise-scale Databricks Lakehouse solutions. Leading architecture engagements and shaping client data strategies. Working closely with senior stakeholders to define scalable, secure and high-performing data platforms. Driving ...

Senior Databricks Technical Engineer Up to £111,500 + 10% Bonus | UK Wide Hybrid | SC Clearance Ready to build data platforms that actually make an impact? We're looking for an experienced Senior Databricks Technical Engineer to join a growing enterprise data team where you'll play a key role … designing, building and evolving modern data platforms. This isn't a role for someone looking to learn Databricks-you'll be the technical expert from day one, helping shape the platform while mentoring other engineers. What you'll be doing Building enterprise-scale data platforms from the ground up Designing ...

building predictive models and deploying data-driven solutions Strong understanding of experimentation, statistics, and machine learning Excellent stakeholder management and communication skills Experience with Databricks and ML lifecycle tools is beneficial ...

with focus on data integration, data quality and governance. Good understanding of modern data platforms (at least one) such as Microsoft Fabric, Snowflake or Databricks with an exposure of their application in healthcare sector for analytics and AI. Good understanding of leading frontier AI models and their application in Healthcare ...

Principal or Senior Architect designing large-scale, high-throughput, and mission-critical enterprise distributed systems. Deep Technical Breadth & Depth: Advanced data architecture experience using Databricks, Microsoft Fabric, and large-scale data processing (Data Mesh/Lakehouse patterns). Strong background in data integration and relational platforms Proven experience designing highly … will be architecting solutions within a broadly evolving and heterogeneous technology landscape, notably encompassing: Compute & Services: Java, .NET, Python, Cloud-native microservices; Data & Analytics: Databricks, Microsoft Fabric, AWS Glue, Athena, Event Streaming (e.g., Kafka); AI & ML: Azure OpenAI, LLM Integration patterns, Vector Databases; Integration & Storage: Azure Data Factory ...

Data Software Engineer - Azure Databricks Location: London, UK Rate: £500 per day, inside IR35 Working Mode: 3 days a week on site Description We're looking for a Data Software Engineer - Azure Databricks to join our client (Financial Services) team in London, UK in an hybrid working mode. In this … role, you will design and build data engineering solutions leveraging Azure Databricks and related Azure services, enabling efficient processing and transformation of large-scale datasets. You will collaborate with cross-functional teams to ensure the delivery of optimized, reliable, and scalable data pipelines aligned with business requirements. Responsibilities Develop robust ...