pipelines for large scale organisations. We are seeking someone with deep technical skills in a variety of technologies, specifically SPARK performance\tuning\optimisation and Databricks, to play an important role in developing and delivering early proofs of concept and production implementation. You will ideally have experience in building solutions using … high quality work to tight deadlines. Your main responsibilities will be: Designing and implementing highly performant data ingestion & transformation pipelines from multiple sources using Databricks and Spark Streaming and Batch processes in Databricks SPARK performance\tuning\optimisation Providing technical guidance for complex geospatial problems and spark dataframes Developing scalable and … methodology to deliver proof of concept and production implementation in iterative sprints. Qualifications Direct experience of building data piplines using Azure Data Factory and Databricks Spark. Building data integration with Python Hands on experience designing and delivering solutions using the Azure Data Analytics platform. Experience building data warehouse solutions using more »
an organization who are committed to utilizing the latest Microsoft technologies! Requirements: Hands-on experience with Azure Data Factory Hands-on experience with Azure Databricks Excellent SQL and T-SQL skills Visualisation experience using Power BI and use of DAX Experience of working in Agile teams Excellent communication and stakeholder more »
We are seeking a dynamic and experienced Databricks professional to join our client, a Boutique Data & AI consultancy, as a Databricks Practice Lead in London. As Databricks Practice Lead, you will play a pivotal role in driving the success of our client's Databricks practice through your expertise in presales … strong technical acumen, consulting skills, and effective team management. Key Responsibilities: Presales Expertise: Leverage your in-depth understanding of Databricks to engage with clients in presales activities, providing comprehensive insights and solutions tailored to their unique needs. Collaborate with the sales team to create compelling proposals, presentations, and demonstrations that … showcase the value of Databricks solutions. Technical Mastery: Possess a robust technical background in Databricks, enabling you to guide clients through complex technical challenges and articulate the benefits of adopting Databricks technologies. Stay current with industry trends and emerging technologies related to Databricks, ensuring our client's offerings remain innovative more »
education in STEM subjects. Strong experience in data pipelines and deploying ML models Preference for experience in retail/marketing Tech across: Python, AWS, Databricks, PySpark, AB Testing, MLFlow, APIs Experience in feature engineering and third-party data Apply below more »
will be comfortable working with non technical colleagues to build a platform that benefits the entire business Desired Skills ⚙️ Python (SQL Server, Azure SQL) Databricks Ariflow, Kafka Azure Benefits 🏖 Modern office in the heart of London with work from home options Opportunity to work in small, diverse and skilled cross more »
from the data.Unlock the potential of metadata within the data, exploring innovative methods to extract valuable insights.Experience Required:Proficient data engineering experienceExperience with Azure Databricks and building ETL pipelinesPackage:Up to £120,000Competitive BonusMarket leading benefitsHybrid workingHow to Apply:If you’re interested, submit your CV and Daniel Akanni will more »
Greater London, England, United Kingdom Hybrid / WFH Options
Source Technology
Unlock the potential of metadata within the data, exploring innovative methods to extract valuable insights. Experience Required: Proficient data engineering experience Experience with Azure Databricks and building ETL pipelines Package: Up to £120,000 Competitive Bonus Market leading benefits Hybrid working How to Apply: If you’re interested, submit your more »
Greater London, England, United Kingdom Hybrid / WFH Options
Agora Talent
B2B SaaS experience involving client-facing projects • Experience in front-end development and competency in JavaScript • Knowledge of API development • Familiarity with Airflow, DBT, Databricks • Experience working with Enterprise Resource Planning (e.g. Oracle, SAP) and CRM systems. If this role sounds of interest, please apply using the link and we more »
engineers onshore to create exceptional product experiences. You do not need to have fintech experience for this role knowledge would be beneficial Experience in Databricks or Kafka is advantageous. Equal Opportunities: We are committed to promoting equality of opportunity for all employees and job applicants. In line with the Equality more »
Privacy technologies such as homomorphic encryption, SMPC, Federated Learning, TEE. Any prior experience with Data management or tooling hugely beneficia (Data Lakes, Snowflake or Databricks). Experience working closely with engineering teams (particularly those working on Machine Learning and Cryptography products). Ability to deliver product presentations, and showcase software more »
with the vision to convert data requirements into logical models and physical solutions. with data warehousing solutions (e.g. Snowflake) and data lake architecture, Azure Databricks/Pyspark & ADF. retail data model standards - ADRM. communication skills, organisational and time management skills. to innovate, support change and problem solve. attitude, with the more »
I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices near Victoria station … on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and utilising Databricks to support the ongoing development of the cutting-edge Data Platform. You'll seek opportunities for improvement where possible, and will collaborate with both business … including SQL Data Warehousing, ETL and Data Integration solutions Strong experience designing and developing data pipelines using Azure Data Factory Strong experience with Azure Databricks Some knowledge of the Azure tech stack would be beneficial but not essential: Databricks, Azure Data Lake, Azure Data Factory, Azure Synapse Analytics Benefits: Salary more »
I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices near Victoria station … on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and utilising Databricks to support the ongoing development of the cutting-edge Data Platform. You'll seek opportunities for improvement where possible, and will collaborate with both business … including SQL Data Warehousing, ETL and Data Integration solutions Strong experience designing and developing data pipelines using Azure Data Factory Strong experience with Azure Databricks Some knowledge of the Azure tech stack would be beneficial but not essential: Databricks, Azure Data Lake, Azure Data Factory, Azure Synapse Analytics Benefits: Salary more »
A brand new and exciting opportunity has recently arisen for a Lead Data Engineer with an excellent knowledge in ETL, Azure Data Factory, Azure Databricks and CRM Implementations to join one of the UK's Largest Charity based in London. As the Lead Data Engineer you will be implementing a more »
London, England, United Kingdom Hybrid / WFH Options
Understanding Recruitment
love to see: Strong proficiency with Python and SQL Extensive Machine Learning experience: recommendation, forecasting, predictive performance analysis & optimisation Experience with Snowflake, DataIQ or Databricks AWS experience – Redshift & Fast API NLP & Computer Vision experience Previous experience working with Marketing Ecosystems Hybrid working with offices in Central London - 3x a week more »
from proof-of-concept to deployment, working alongside the Energy Solutions team. Design data pipelines for smarter energy: Craft and manage data pipelines using Databricks, integrating best-in-class demand forecasts to optimize energy use. Enhance user applications for real-world impact: Contribute to the development of our user applications more »
Lead Data Engineer - Azure/Spark/Databricks Role: Lead Data Engineer Location: London (3 days a week) Salary: £85k - £90k A leading technology firm, renowned for connecting people globally, is looking for a skilled Lead Data Engineer to join their expanding team. In this role, you will lead a more »
Experience working in a distributed team. Background in software development or in a hands-on technical role Desirable: Spark data processing Cloud technologies – Azure, DataBricks, Kubernetes Software Architectural skills DevOps Agile/Scrum certified. At Kantar we have an integrated way of rewarding our people based around a simple, clear more »
City of London, London, United Kingdom Hybrid / WFH Options
Nigel Frank International
Data Engineer (FTC) - Databricks - London - Up to £70k My client is an organisation with a global presence. They have a presence all over Europe, Americas, Asia & the Middle east so the work that they do impacts hundreds of thousands of lives across the globe. They specialise in providing training and … the wider business to build DWH solutions but also bring out the best of their data using new and emerging tech such as Azure Databricks, Azure Data stack and plenty more! This is a salaried position paying up to £70k. Whilst this is a FT contract that will be until … days in office, 2 days WFH set up. Required skills: Experience in ADF/Azure Data Factory is essential Strong SQL Experience of Databricks Data warehousing This is a great opportunity to join outstanding organisation who pride themselves on being one of the best companies to work for across the more »
City of London, London, United Kingdom Hybrid / WFH Options
TECHNOLOGY RECWORKS LIMITED
new technology to solve business problems. Responsibilities Designing cloud-based data platforms and data solutions using a wide range of Azure Services including Azure Databricks, Azure SQL Database, Azure Data Lake Storage, Azure Synapse, Azure Cosmos DB, Azure Data Factory and Azure Blob storage Building conceptual, logical and physical data … Master and Reference Data Management, Metadata Management, Security and Compliance Strong experience in Data Warehouse methodologies Experience working across Azure Data Services including Azure Databricks, Azure SQL Database, Azure Data Lake Storage, Azure Cosmos DB, Azure Data Factory, Azure Blob storage and Power BI Strong experience in SQL Good understanding more »
an Insurance client of mine based in London. The ideal candidate will have 4+ years of Data Engineering experience and will have experience with DataBricks, SQL and Python. This is a 6-month contract that requires 2 days per week in London. The role falls Inside IR35 and the client more »
Solid experience as Python Data API Developer Experience developing Python APIs and documentation Experience with automated diagram generation Experience with data pipelines tooling e.g. Databricks Attention to detail with a proven focus on quality BSc in Computer Science, Engineering or relevant field This role will be Inside IR35 This is more »
Data Architect - Azure/Spark/Databricks Role: Data Architect Location: London (3 days a week) Salary: £100k - £110k A leading technology firm, renowned for connecting people globally, is looking for a skilled Data Architect to join their expanding team. You will be spearheading Azure-based data solutions and helping more »
Data Engineer - Databricks - £70-75,000 - London/Hybrid Scalexperts are partnered with an education business who after making a few recent senior leadership hires in Data & Technology are now scaling their Data Engineering function. They are looking for a Data Engineer to join them to work on building a … into a senior position, as that is the longer term plan for this role. Key Experience Required: In-depth knowledge of and experience with Databricks 3+ years experience in Data Engineering Azure experience ideally worked with tools such as Synapse, Azure Data Factory, Data Lake etc Experience with SQL is more »
strategic development projects. Successful candidates will be top class computer scientists with excellent interpersonal skills. Key Skills Broad and deep Python knowledge Experience with Databricks and Data Science skills Computer Science masters or PhD This is a hybrid position requiring 3 days in their London (Moorgate) office. more »