1 to 25 of 134 Databricks Jobs in London

infrastructure, including S3, Redshift, Lambda, Step Functions, DynamoDB, AWS Glue, RDS, Athena, Kinesis, Quicksight. We also widely use other tech such as Snowflake, DBT, Databricks, Informatica, Matillion, Airflow, Tableau, Power BI etc. The Lead Data Architect will liaise with clients to define requirements, refine solutions and ultimately hand over to more »

with A/B testing platforms Essential: Knowledge of querying and transforming data using SQL Preferred : Familiarity with cloud based analytical platforms such as Databricks Familiarity with SaaS ecommerce platforms You might not tick all the boxes, and thats okay, we still encourage you to apply. Here at Brompton we more »

storage Highly Preferred Technical Skills: Experience with Kubernetes for container orchestration and data platform scalability Expertise in database tuning for performance optimization Familiarity with Databricks for large-scale data processing If interested, please apply or message me directly at more »

solutions using Azure services such as Data Factory, Event Hubs, Data Lake, Synapse, and Azure SQL Server. Create and optimize data processing workflows in Databricks using PySpark and Spark SQL. Ensure ETL coding standards are met, including self-documenting code and reliable testing. Apply best practice data encryption techniques and … warehouse design. Extensive experience with Azure data products including Data Factory, Event Hubs, Data Lake, Synapse, and Azure SQL Server. Proficient in developing with Databricks, PySpark, and Spark SQL. Strong understanding of ETL coding standards, including standardized, self-documenting code and reliable testing. Knowledge of data encryption techniques and standards. more »

Kimball & inmon, and hybrid data warehouse design. Cloud data products such as: Data factory Events Hubs Data Lake Synapse Azure SQL Server Experience developing Databricks and coding with PySpark and Spark SQL. Proficient in ETL coding standards Data encryption techniques and standards Knowledge of relevant legislation such as: Data Protection more »

experience working as a Data Engineer, preferably on the Azure platform. Strong knowledge of Azure data services, such as Azure Data Lake Storage, Azure Databricks, and Azure SQL Database. Proficiency in SQL and programming languages like Python or Scala. Experience with data modeling and ETL/ELT concepts. Strong problem more »

in the Banking and Financial Services sector is advantageous. • Deep knowledge or experience with using as much of the following: • Azure Cloud Data Components | Databricks | Python | PySpark | Terraform | APIs | Lakehouse | Data Mesh | Nosql DBs | GitHub Person Specification • Self motivator with a desire to learn new skills and embrace new technologies more »

a brand new Snowflake Data Warehouse . They are looking for a candidate that has experience in… Azure Data Platform Strong knowledge of ADF, Databricks, ADL & Synapse along side Data Modelling, Experience performing data warehouse architecture development and management Working knowledge of SAS and R code used in data processing more »

work in London 3 days a week, have a valid visa as we Are not able to sponsor Technical Stack:- Python, Postgres SQL, Azure Databricks, AWS(S3), Git, Azure DevOps CICD, Apache Airflow Skills years of experience in python scripting. in developing applications in Python language. to python-oriented Algorithm more »

working as a Machine Learning Engineer. Strong proficiency in Python programming language. Hands-on experience with Azure cloud services, including Azure Machine Learning, Azure Databricks, and Azure Synapse Analytics. Knowledge of machine learning frameworks such as TensorFlow, PyTorch, or scikit-learn. Experience with version control systems such as Git. Excellent more »

and the business stakeholders Investigate and provide solutions for issues (bugs, data errors) Key skills PowerBI– DAX, Power Query (M) Power apps – Advantageous Azure, Databricks Stakeholder management What’s on Offer Up to £90k Salary Bonus package Hybrid working in either Leeds, Manchester or London + flexible hours More exciting more »

pipeline and ETL processes using Azure data Factory, Azure Data Lake and Azure Databricks. Exceptional experience developing codes, testing for quality assurance, administering Azure Databricks platform and exposure to Unity Catalog. Exposure of Performance Tuning, Optimization, Governance and Security of Databricks platform. Experience in designing scalable solutions using Azure Data more »

Lead Azure Data Engineer | PySpark (Python) & Synapse | Tech for Good/Charity Essential skills required: Azure – solid experience required of the Azure Data ecosystem Python - ESSENTIAL as PySpark is used heavily. You will be tested on PySpark Azure Synapse - ESSENTIAL more »

the ground to $500 million acquisition previously - Company founders are Ex-VP’s for market leading companies - Investor Leadership team invested in likes of Databricks, AppDynamics, Coinbase etc.. - All executive team are ‘Start-up guru’s’ with multiple use cases of exit’s between them - VP Sales has previously scaled more »

Eames Consulting are delighted to be supporting an established Investment management company that are looking for a Data engineer. Responsibilities: Develop and maintain complex SQL queries, customize reports, and optimize data usage. Create tools to address business challenges and empower more »

Data Engineer - Azure Databricks CONTRACT - London (Hybrid) Data warehousing - Trading - Credit/Market Risk Harrington Starr is working with a leading Energy trading firm in London on an initial 6-month contract for a market-leading project. The project is signed off and they are looking to start interviewing ASAP. … Responsibilities: Azure Cloud Data Engineering using Azure Databricks Data Warehousing Data Engineering Very strong with the Microsoft Stack ESSENTIAL knowledge of PySpark clusters Python & C# Scripting experience Experience of message queues (Kafka) Experience of containerization (Docker) FINANCIAL SERVICES EXPERIENCE (Energy/commodities trading) If you have the above, please do more »

them on delivering and implementing new data pipelines. You will need prior financial services experience as well as having strong Azure Data Factory and Databricks experience. Work Involved: Implementing and delivering data pipelines Providing mentorship to junior members of the team Working with the Platform team defining capabilities for the … lake framework Developing business conceptual data models Producing new frameworks using design patterns and data ingestion Requirements: Strong Data Pipeline experience Databricks Azure Data Factory Spark Azure cloud Financial Services If you're interested get in touch ASAP more »

S3, Redshift, Lambda, Step Functions, DynamoDB, AWS Glue, RDS, Athena, Kinesis, Quicksight. Hands on experience on design solutions using Snowflake and DBT. Familiarity with Databricks or Informatica. Hands on experience in designing data models aligned to functional and non-functional requirements, and business objectives. Expert in data modelling and latest more »

unstructured datasets, and different types of data pertaining to a number of departments across Brompton (Finance, Planning, Commercial). Experience of working with Azure Databricks, B2B/B2C/D2C business models and FiveTran will stand you in good stead. Our team work in 2-week sprints, so experience of … data models that enhance data accessibility and facilitate deeper analysis. Implement and manage Unity Catalog for centralized data governance and unified access controls across Databricks Maintain technical documentation for the entirety of code base. End to end ownership of the Data Engineering Lifecycle. Implement and manage Fivetran for efficient and … equivalent experience. Extensive experience as a Senior Data Engineer/Cloud Data Architect, or similar role. Deep knowledge of Azure Cloud architecture and Azure Databricks, DevOps and CI/CD Extensive experience migrating on-premises data warehouses to the cloud. Proficiency with Spark, SQL, Python, R, and other data engineering more »

Lead Data Engineer - Python/SQL/Azure My client, a London Market Specialty Insurance company are currently recruiting for a Lead Data Engineer to join their team on a Permanent basis. This is a great opportunity for an experienced more »

create effective data models supporting business processes, including knowledge of dimensional modeling and normalization. Familiarity with big data technologies on Azure, such as Azure Databricks and Azure Stream Analytics. Knowledge of data security practices, cloud architecture principles, scripting languages for automation, data visualization tools, DevOps practices, machine learning frameworks, performance more »

and unstructured data, including cloud data products such as Data Factory, Event Hubs, Data Lake, Synapse, and Azure SQL Server. * Proficiency in developing with Databricks and coding with PySpark and Spark SQL. * Experience in delivery of data and analytics solutions/applications to automate business processes and meet user function more »

an organization who are committed to utilizing the latest Microsoft technologies! Requirements: Hands-on experience with Azure Data Factory Hands-on experience with Azure Databricks Excellent SQL and T-SQL skills Visualisation experience using Power BI and use of DAX Experience of working in Agile teams Excellent communication and stakeholder more »

Data Mart. Utilize Vector Databases, Cosmos DB, Redis, and Elasticsearch for efficient data storage and retrieval. Demonstrate proficiency in programming languages including Python, Spark, Databricks, Pyspark, SQL, and ML Algorithms. Implement Machine Learning models and algorithms using Pyspark, Scikit Learn, and other relevant tools. Manage Azure DevOps, CI/CD … pipelines, GitHub, and Kubernetes (AKS) for efficient software development and deployment. Implement ML/OPS solutions using Azure ML, Databricks MLFlow, and LLMOps for streamlined Machine Learning operations. Ensure data governance and data cataloging standards are maintained, utilizing tools such as Collibra and Talend Data Catalogue. Collaborate with stakeholders to … Cloud environments, Azure Data Lake, Azure Data Factory, Microservices architecture. Experience with Vector Databases, Cosmos DB, Redis, Elasticsearch. Strong programming skills in Python, Spark, Databricks, Pyspark, SQL, ML Algorithms, Gen AI. Knowledge of Azure DevOps, CI/CD pipelines, GitHub, Kubernetes (AKS). Experience with ML/OPS tools such more »

in PowerBI, DAX, Power Query, and SQL Strong understanding of data modelling and database concepts Familiarity with data visualisation techniques Experience with Azure and Databricks is a plus Prior experience in financial services or commodities is a must If interested please come back with an updated CV and contact number more »