1 to 25 of 37 Databricks Jobs in the North East

to collaborate with cross-functional teams effectively. Inquisitive with an eagerness to learn. Preferred Qualifications Experience with additional Azure services like Azure Data Lake , Azure SQL Database , or Azure Databricks . Familiarity with Infrastructure-as-Code (IaC) practices. Strong knowledge of data governance and security best practices in the cloud. Previous experience in a DevOps environment with CI/CD More ❯

sector, shaping data pipelines and platforms that power smarter decisions, better pricing, and sharper customer insights. The Data Engineer will design, build, and optimise scalable data pipelines within Azure Databricks, ensuring high-quality, reliable data is available to support pricing, underwriting, claims, and operational decision-making. This role is critical in modernising SBG’s cloud-based data infrastructure, ensuring compliance … regulations, and enabling AI-driven analytics and automation. By leveraging Azure-native services, such as Azure Data Factory (ADF) for orchestration, Delta Lake for ACID-compliant data storage, and Databricks Structured Streaming for real-time data processing, the Data Engineer will help unlock insights, enhance pricing accuracy, and drive innovation. The role also includes optimising Databricks query performance, implementing robust … security controls (RBAC, Unity Catalog), and ensuring enterprise-wide data reliability. Working closely with Data Architects, Pricing Teams, Data Analysts, and IT, this role will ensure our Azure Databricks data ecosystem is scalable, efficient, and aligned with business objectives. Additionally, the Data Engineer will contribute to cost optimisation, governance, and automation within Azure’s modern data platform. Key Responsibilities Data More ❯

design. Experience architecting and building data applications using Azure, specifically a Data Warehouse and/or Data Lake. Technologies : Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, Azure Databricks and Power BI. Experience with creating low-level designs for data platform implementations. ETL pipeline development for the integration with data sources and data transformations including the creation of supplementary … with APIs and integrating them into data pipelines. Strong programming skills in Python. Experience of data wrangling such as cleansing, quality enforcement and curation e.g. using Azure Synapse notebooks, Databricks, etc. Experience of data modelling to describe the data landscape, entities and relationships. Experience with data migration from legacy systems to the cloud. Experience with Infrastructure as Code (IaC) particularly More ❯

design. Experience architecting and building data applications using Azure, specifically a Data Warehouse and/or Data Lake. Technologies : Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, Azure Databricks and Power BI. Experience with creating low-level designs for data platform implementations. ETL pipeline development for the integration with data sources and data transformations including the creation of supplementary … with APIs and integrating them into data pipelines. Strong programming skills in Python. Experience of data wrangling such as cleansing, quality enforcement and curation e.g. using Azure Synapse notebooks, Databricks, etc. Experience of data modelling to describe the data landscape, entities and relationships. Experience with data migration from legacy systems to the cloud. Experience with Infrastructure as Code (IaC) particularly More ❯

design. Experience architecting and building data applications using Azure, specifically a Data Warehouse and/or Data Lake. Technologies : Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, Azure Databricks and Power BI. Experience with creating low-level designs for data platform implementations. ETL pipeline development for the integration with data sources and data transformations including the creation of supplementary … with APIs and integrating them into data pipelines. Strong programming skills in Python. Experience of data wrangling such as cleansing, quality enforcement and curation e.g. using Azure Synapse notebooks, Databricks, etc. Experience of data modelling to describe the data landscape, entities and relationships. Experience with data migration from legacy systems to the cloud. Experience with Infrastructure as Code (IaC) particularly More ❯

integrating Oracle data sources within Azure environments. Excellent problem-solving and communication skills. Preferred Qualifications Experience with additional Azure services like Azure Data Lake , Azure SQL Database , or Azure Databricks . Familiarity with Infrastructure-as-Code (IaC) practices. Strong knowledge of data governance and security best practices in the cloud. Previous experience in a DevOps environment with CI/CD More ❯

integrating Oracle data sources within Azure environments. Excellent problem-solving and communication skills. Preferred Qualifications Experience with additional Azure services like Azure Data Lake , Azure SQL Database , or Azure Databricks . Familiarity with Infrastructure-as-Code (IaC) practices. Strong knowledge of data governance and security best practices in the cloud. Previous experience in a DevOps environment with CI/CD More ❯

schema design. Experience architecting and building data applications using Azure, specifically Data Warehouse and/or Data Lake. Technologies: Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, Azure Databricks, and Power BI. Experience creating low-level designs for data platform implementations. ETL pipeline development for data source integration and transformations, including documentation. Proficiency working with APIs and integrating them … into data pipelines. Strong programming skills in Python. Experience with data wrangling such as cleansing, quality enforcement, and curation (e.g., Azure Synapse notebooks, Databricks). Data modeling experience to describe data landscape, entities, and relationships. Experience migrating data from legacy systems to the cloud. Experience with Infrastructure as Code (IaC), particularly Terraform. Proficiency in developing Power BI dashboards. Strong focus More ❯

design. Experience architecting and building data applications using Azure, specifically a Data Warehouse and/or Data Lake. Technologies : Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, Azure Databricks and Power BI. Experience with creating low-level designs for data platform implementations. ETL pipeline development for the integration with data sources and data transformations including the creation of supplementary … with APIs and integrating them into data pipelines. Strong programming skills in Python. Experience of data wrangling such as cleansing, quality enforcement and curation e.g. using Azure Synapse notebooks, Databricks, etc. Experience of data modelling to describe the data landscape, entities and relationships. Experience with data migration from legacy systems to the cloud. Experience with Infrastructure as Code (IaC) particularly More ❯

design. Experience architecting and building data applications using Azure, specifically a Data Warehouse and/or Data Lake. Technologies : Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, Azure Databricks and Power BI. Experience with creating low-level designs for data platform implementations. ETL pipeline development for the integration with data sources and data transformations including the creation of supplementary … with APIs and integrating them into data pipelines. Strong programming skills in Python. Experience of data wrangling such as cleansing, quality enforcement and curation e.g. using Azure Synapse notebooks, Databricks, etc. Experience of data modelling to describe the data landscape, entities and relationships. Experience with data migration from legacy systems to the cloud. Experience with Infrastructure as Code (IaC) particularly More ❯

Data Engineer - FinTech Company - Newcastle (Tech Stack: Data Engineer, Databricks, Python, Azure, Power BI, AWS QuickSight, AWS, TSQL, ETL, Agile Methodologies) I'm working with a leading Software House in the FinTech industry, based in Newcastle, who are looking to hire a talented Data Engineer .This is a fantastic opportunity to join a forward-thinking company where you'll play … working with data and delivering value to stakeholders. Strong proficiency in SQL, Python, and Apache Spark , with hands-on experience using these technologies in a production environment. Experience with Databricks and Microsoft Azure is highly desirable. Financial Services experience is a plus but not essential. Excellent communication skills, with the ability to explain complex data concepts in a clear and More ❯

drive technical innovation across client projects Document processes and contribute to internal knowledge repositories and best practice libraries Key Skills & Experience Strong hands-on experience with Azure tooling, including: Databricks, Data Factory, Data Lake, and Synapse (or similar data warehouse tools) Azure Analysis Services or comparable BI tooling Solid programming capability in: SQL, Python, Spark, and ideally DAX Familiarity with More ❯

data ingestion into our Azure Data Lake, designing and developing sophisticated data models for analytics, to deploying Azure Logic Apps and Function Apps for process automation. With tools like Databricks, Data Factory, Azure SQL Server, and Python you will help formulate a data driven platform and develop data pipelines that convert raw data into actionable insights in line with our … supporting a collaborative and productive work environment. Develop and implement data ingestion solutions on the Azure platform, ensuring scalability, reliability, and performance. Leveraging technologies such as Azure Data Factory, Databricks, Delta Lake, and Python. Design and maintain robust ETL/ELT processes to integrate data from various sources into Azure data services. Help to implement DataOps practices to streamline and … drive continuous improvement within the team. About you You will fit right into this role if you: Can demonstrate advanced knowledge of cloud services, preferably the broader Fabric or Databricks suite of products; or Azure Data Lake, Azure Data Factory, Azure Logic Apps, Azure Function Apps, alongside a skillset incorporating data modelling techniques and business data requirement comprehension, documentation and More ❯

drive technical innovation across client projects Document processes and contribute to internal knowledge repositories and best practice libraries Key Skills & Experience Strong hands-on experience with Azure tooling, including: Databricks, Data Factory, Data Lake, and Synapse (or similar data warehouse tools) Azure Analysis Services or comparable BI tooling Solid programming capability in: SQL, Python, Spark, and ideally DAX Familiarity with More ❯

drive technical innovation across client projects Document processes and contribute to internal knowledge repositories and best practice libraries Key Skills & Experience Strong hands-on experience with Azure tooling, including: Databricks, Data Factory, Data Lake, and Synapse (or similar data warehouse tools) Azure Analysis Services or comparable BI tooling Solid programming capability in: SQL, Python, Spark, and ideally DAX Familiarity with More ❯

mitigating bias in AI/ML models, especially in consumer-facing applications Proficiency in Python and familiarity with AI/ML tools and platforms such as Azure, AWS, GCP, Databricks, MLFlow, Airflow, Plotly Dash and Streamlit Experience with advertising platforms (e.g., Facebook Ads, Google Ads) and programmatic ad-buying strategies is a plus Knowledge of marketing metrics, customer lifetime value More ❯

EDW), and enabling advanced analytics, governance, and data protection by design. The role will focus on ensuring data integrity, scalability, security, and performance within the Microsoft Azure ecosystem, leveraging Databricks as the core platform for advanced analytics, data engineering, and machine learning. The Data Architect will collaborate closely with stakeholders across the business and in particular with data engineering, data … scalable solutions that support AI-driven insights and pricing optimisation. What You'll Be Responsible For Design and implement robust, scalable, and secure data architectures within Microsoft Azure, with Databricks as the core platform for data engineering and analytics. Develop and optimise data models, ETL/ELT pipelines, and data processing frameworks using Databricks, Delta Lake, and other Azure data … compliance. Define and maintain data architecture standards, policies, and guidelines, ensuring scalability and long-term sustainability. Optimise and modernise data pipelines for efficiency, cost-effectiveness, and high performance, leveraging Databricks’ capabilities for big data processing and machine learning. Collaborate closely with data engineering, data science, and pricing teams to enable real-time analytics, AI-driven insights, and predictive modelling. Drive More ❯

informed on industry trends, competitor positioning, and emerging technologies, supporting the sales approach accordingly. Partner & Ecosystem Collaboration Work alongside partners, including cloud providers (Azure, AWS) and data platform vendors (Databricks, Snowflake, Oracle), to enhance solution offerings. Support engagement with Version 1’s delivery and engineering teams to ensure sales commitments align with execution capabilities. Identify co-sell opportunities and collaborate … of Data & Analytics). Data & Technology Knowledge Understanding of data platforms, data engineering, AI/ML, analytics, and cloud ecosystems. Familiarity with technologies such as Azure Data Services, AWS, Databricks, Snowflake, Oracle, and Power BI. Ability to articulate the business impact of data-driven decision-making and AI solutions. Stakeholder Engagement & Communication Strong communication skills, able to simplify complex technical More ❯

engineering or a related field, with a focus on building scalable data systems and platforms. Strong expertise in modern data tools and frameworks such as Spark, dbt, Airflow, Kafka, Databricks, and cloud-native services (AWS, GCP, or Azure) Deep understanding of data modeling, distributed systems, ETL/ELT pipelines, and streaming architectures Proficiency in SQL and at least one programming More ❯

data management best practices including demonstrated experience with data profiling, sourcing, and cleansing routines utilizing typical data quality functions involving standardization, transformation, rationalization, linking and matching, Good knowledge of Databricks, Snowflake, Azure/AxoWS/Oracle cloud, R, Python. Additional Information At Version 1, we believe in providing our employees with a comprehensive benefits package that prioritises their well-being More ❯

. Strong background in data architecture , including data modeling, warehousing, real-time and batch processing, and big data frameworks. Proficiency with modern data tools and technologies such as Spark, Databricks, Kafka, or Snowflake (bonus). Knowledge of cloud security, networking, and cost optimization as it relates to data platforms. Experience in total cost of ownership estimation and managing its impact More ❯

external vendors to enhance data management capabilities. Provide expert-level troubleshooting, root cause analysis, and performance optimisation for data platforms, such as Azure SQL databases, Fabric Warehouse and Onelake, Databricks, and Azure Data Factory. Document technical solutions, best practices, and knowledge base articles to facilitate effective knowledge transfer and continuous improvement. Diagnose and resolve data-related incidents and problems escalated More ❯

working with data and delivering value to stakeholders. Strong proficiency in SQL, Python, and Apache Spark , with hands-on experience using these technologies in a production environment. Experience with Databricks and Microsoft Azure is highly desirable. Financial Services experience is a plus but not essential. Excellent communication skills, with the ability to explain complex data concepts in a clear and More ❯

Proven ability to interpret complex business requirements and translate them into scalable technical solutions Solid hands-on experience working with Python for data handling, transformation, or orchestration Familiarity with Databricks, preferably in an Azure environment Excellent communication and collaboration skills-you're approachable, professional, and confident engaging with both technical and non-technical stakeholders Strong self-management-able to juggle More ❯

reference architectures, and best practices are followed in strategic partner-aligned projects. Job qualifications Technical Skills Deep expertise in one or more cloud/partner architectures: AWS, Azure, GCP, Databricks, and/or NVIDIA. Experience designing large-scale distributed systems, with a specialization aligned with one or more of our core offerings: AI-driven UX, Product Innovation, Data Modernization, AI More ❯