76 to 100 of 137 Databricks Jobs in London

will be working as part of a Data Technology Team responsible for a brand-new cutting-edge data platform based upon Microsoft Azure and Databricks Lakehouse technologies. They will assist in the creation of data products with a commercial and editorial focus - that have a direct impact on the performance … effectively. Applicants must be experienced in implementing data solutions based on DataBricks. Main Responsibilities Plan, build and implement data solutions based on Azure/DataBricks Management of data processing, data cleansing and ETLs Management of data mart for defined data driven use cases Provide deep analysis on all the New … identify opportunities for improvement. Build processes supporting data transformation, data structures, metadata, dependency and workload management. Person Specification Required Demonstrable experience of working with Databricks Demonstrable experience with and knowledge of Azure components - Azure Data Factory, Azure Data Lake, Azure SQL DW, Azure Synapse etc. Demonstrable experience in Azure Devops more »

Senior Data Engineer Salary Negotiable to £70,000 DoE Hybrid working with 2 days in London Job Reference J12785 Work with an award-winning independent protection adviser. Develop the data engineering capabilities. Data is a key enabler for the business more »

an organization who are committed to utilizing the latest Microsoft technologies! Requirements: Hands-on experience with Azure Data Factory Hands-on experience with Azure Databricks Excellent SQL and T-SQL skills Visualisation experience using Power BI and use of DAX Experience of working in Agile teams Excellent communication and stakeholder more »

Senior Data Engineer (Databricks) – Remote - 6 Months Contract (Initial) – Outside IR35 VIQU are seeking 4 Senior Data engineers (Databricks) on a contract basis to assist our client as they migrate over from legacy to AWS. The main focus will be to centralise the organisations data warehouses and consolidating/centralising … a number of BI tools. Senior Data Engineers should have extensive experience working with Databricks on recent projects and be exposed to the latest features and toolsets of Databricks Role Responsibilities: Design and develop scalable data pipelines using Databricks. Implement data processing workflows in Python and SQL. Manage and optimise … storage solutions on AWS. Ensure data quality and integrity across all stages of data processing. Develop and maintain documentation for data engineering processes. Utilise Databricks features, including Delta Live Tables (DLT) to simplify streaming and ensure data quality. Work with asset bundles in Databricks for streamlined data operations. Key Skills more »

A brand new and exciting opportunity has recently arisen for a Lead Data Engineer with an excellent knowledge in ETL, Azure Data Factory, Azure Databricks and CRM Implementations to join one of the UK's Largest Charity based in London. As the Lead Data Engineer you will be implementing a more »

love to see: Strong proficiency with Python and SQL Extensive Machine Learning experience: recommendation, forecasting, predictive performance analysis & optimisation Experience with Snowflake, DataIQ or Databricks AWS experience – Redshift & Fast API NLP & Computer Vision experience Previous experience working with Marketing Ecosystems Hybrid working with offices in Central London - 3x a week more »

from proof-of-concept to deployment, working alongside the Energy Solutions team. Design data pipelines for smarter energy: Craft and manage data pipelines using Databricks, integrating best-in-class demand forecasts to optimize energy use. Enhance user applications for real-world impact: Contribute to the development of our user applications more »

Experience working in a distributed team. Background in software development or in a hands-on technical role Desirable: Spark data processing Cloud technologies – Azure, DataBricks, Kubernetes Software Architectural skills DevOps Agile/Scrum certified. At Kantar we have an integrated way of rewarding our people based around a simple, clear more »

and coordinating release schedules Preferred Qualifications Experience owning/driving roadmap strategy and definition Understanding of data warehouses or Lakehouses, such as on BigQuery, Databricks or Snowflake Experience designing or architecting (design patterns, reliability and scaling) of new and existing systems WHO WE ARE: Do Your Best Work The opportunity more »

solutions using Azure services such as Data Factory, Event Hubs, Data Lake, Synapse, and Azure SQL Server. Create and optimize data processing workflows in Databricks using PySpark and Spark SQL. Ensure ETL coding standards are met, including self-documenting code and reliable testing. Apply best practice data encryption techniques and … warehouse design. Extensive experience with Azure data products including Data Factory, Event Hubs, Data Lake, Synapse, and Azure SQL Server. Proficient in developing with Databricks, PySpark, and Spark SQL. Strong understanding of ETL coding standards, including standardized, self-documenting code and reliable testing. Knowledge of data encryption techniques and standards. more »

solutions using Azure services such as Data Factory, Event Hubs, Data Lake, Synapse, and Azure SQL Server. Create and optimize data processing workflows in Databricks using PySpark and Spark SQL. Ensure ETL coding standards are met, including self-documenting code and reliable testing. Apply best practice data encryption techniques and … warehouse design. Extensive experience with Azure data products including Data Factory, Event Hubs, Data Lake, Synapse, and Azure SQL Server. Proficient in developing with Databricks, PySpark, and Spark SQL. Strong understanding of ETL coding standards, including standardized, self-documenting code and reliable testing. Knowledge of data encryption techniques and standards. more »

unstructured datasets, and different types of data pertaining to a number of departments across Brompton (Finance, Planning, Commercial). Experience of working with Azure Databricks, B2B/B2C/D2C business models and FiveTran will stand you in good stead. Our team work in 2-week sprints, so experience of … data models that enhance data accessibility and facilitate deeper analysis. Implement and manage Unity Catalog for centralized data governance and unified access controls across Databricks Maintain technical documentation for the entirety of code base. End to end ownership of the Data Engineering Lifecycle. Implement and manage Fivetran for efficient and … equivalent experience. Extensive experience as a Senior Data Engineer/Cloud Data Architect, or similar role. Deep knowledge of Azure Cloud architecture and Azure Databricks, DevOps and CI/CD Extensive experience migrating on-premises data warehouses to the cloud. Proficiency with Spark, SQL, Python, R, and other data engineering more »

on a long term contract, inside IR35 on a remote basis. The key skills required for this Python Developer role are: Python ETL Azure Databricks Pyspark If you do have the required skills for this remote Python Developer contract, please do apply. more »

CX with potential extension Requirements: 5+ Years as an Azure Data Architect Must have Active SC Clearance Background in financial services Experience working with Databricks Extensive data modelling knowledge Will have designed data lakes more »

have experience working on ML infrastructure using Docker and Kubernetes Minimum of 3 to 5 years experience Extensive experience with Python Familiarly with Terraform, Databricks and Azure Ability to implement machine learning and software best practices Ideally exposure to deep learning approaches and frameworks Unfortunately sponsorship is not provided for more »

the achievement of prioritised Use Cases and Business Objectives. Technical and Business Metadata Management: Develop a strategy for technical and business metadata capture on Databricks Unity Catalog and Purview, ensuring seamless integration between the two. Define the technical and business metadata required at different layers (Bronze, Silver, Gold). Implement more »

competitive day rate of £250-£400, falling inside IR35 regulations. Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes using AWS, Databricks, Python, Spark, and SQL. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions. Optimize and troubleshoot … Engineer or in a similar role. Strong proficiency in AWS services related to data engineering (e.g., S3, Redshift, Glue). Hands-on experience with Databricks for data processing and analytics. Proficient in Python programming for data manipulation and automation. Solid understanding of Apache Spark for big data processing. Strong SQL more »

to you. DATA ARCHITECT 3-Month contract Fully remote Outside IR35 RESPONSIBILITIES/SKILLS REQUIRED Implementation experience and hands-on experience in Azure and Databricks Expert in architecting data solutions across hybrid cloud on premise data platforms In-depth knowledge on key technologies like Big Query/Redshift/Synapse more »

designing architectures and leading technical delivery for Data focused AWS projects Knowledge of other Cloud Platforms and SaaS offerings such as Azure, GCP, Snowflake & Databricks Relevant industry recognised certifications, such as TOGAF, AWS Solution Architect etc Experience of delivering projects using relevant Data Architectural paradigms such as Kimball, Data Vault more »

in size but the company are also investing in the technology that they use with an emphasis on Microsoft tech such as Azure Synapse, Databricks and Data Factory. As part of this role, you will be responsible for some of the following areas. Develop and maintain the organisation Azure data … alongside other benefits. To be successful in this role you will have. Previous experience working in a Data Engineering role. Excellent understanding of Azure Databricks Experience creating data pipelines using Azure Data Factory Experience working with Azure Data Lake storage. Good working knowledge of other Azure cloud services and technologies more »

their growing London based data team. This organisation have recently implemented a brand new data platform encompassing the full Microsoft Azure Stack including leveraging Databricks in order to deliver on its goal of becoming truly data driven. In this role you will be responsible for the BI and data engineering … successful in this role you will have. Strong experience creating data pipelines using Azure Data Factory Experience working with the Microsoft Azure stack including databricks for data transformation Experience using Power BI to create custom visualisations Strong SQL skills This is just a brief overview of the role. For the more »

Senior Data Engineer £65,000 - £75,000 + 10% Bonus London based - Hybrid working A consultancy at the heart of ground-breaking innovation and transformative solutions where expertise meets ambition. With a focus on collaborative brilliance shaping industries and propelling more »

Principal Data Engineer £80,000 - £103,000 + 15% Bonus London based - Hybrid working A consultancy at the heart of ground-breaking innovation and transformative solutions where expertise meets ambition. With a focus on collaborative brilliance shaping industries and propelling more »

Version 1 has celebrated over 26 years in the Technology industry and continues to be trusted by global brands to deliver IT solutions that drive customer success. Version 1 has several strategic technology partners including Microsoft, AWS, Oracle, Red Hat more »

Inmon, and hybrid data warehouse design principles. Utilize cloud data products such as Data Factory, Event Hubs, Data Lake, Synapse, and Azure SQL Server. Databricks and PySpark Development Develop in Databricks with experience coding in PySpark and Spark SQL. Ensure ETL code is standardized, self-documenting, and can be reliably … warehouse design. Proficient in using cloud data products like Data Factory, Event Hubs, Data Lake, Synapse, and Azure SQL Server. Experienced in developing with Databricks and coding in PySpark and Spark SQL. Thorough understanding of coding standards for ETL processes. Knowledgeable about best practice data encryption techniques and standards. Familiar more »