24 of 24 Databricks Jobs in Newcastle upon Tyne

sector, shaping data pipelines and platforms that power smarter decisions, better pricing, and sharper customer insights. The Data Engineer will design, build, and optimise scalable data pipelines within Azure Databricks, ensuring high-quality, reliable data is available to support pricing, underwriting, claims, and operational decision-making. This role is critical in modernising SBG’s cloud-based data infrastructure, ensuring compliance … regulations, and enabling AI-driven analytics and automation. By leveraging Azure-native services, such as Azure Data Factory (ADF) for orchestration, Delta Lake for ACID-compliant data storage, and Databricks Structured Streaming for real-time data processing, the Data Engineer will help unlock insights, enhance pricing accuracy, and drive innovation. The role also includes optimising Databricks query performance, implementing robust … security controls (RBAC, Unity Catalog), and ensuring enterprise-wide data reliability. Working closely with Data Architects, Pricing Teams, Data Analysts, and IT, this role will ensure our Azure Databricks data ecosystem is scalable, efficient, and aligned with business objectives. Additionally, the Data Engineer will contribute to cost optimisation, governance, and automation within Azure’s modern data platform. Key Responsibilities Data More ❯

design. Experience architecting and building data applications using Azure, specifically a Data Warehouse and/or Data Lake. Technologies : Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, Azure Databricks and Power BI. Experience with creating low-level designs for data platform implementations. ETL pipeline development for the integration with data sources and data transformations including the creation of supplementary … with APIs and integrating them into data pipelines. Strong programming skills in Python. Experience of data wrangling such as cleansing, quality enforcement and curation e.g. using Azure Synapse notebooks, Databricks, etc. Experience of data modelling to describe the data landscape, entities and relationships. Experience with data migration from legacy systems to the cloud. Experience with Infrastructure as Code (IaC) particularly More ❯

design. Experience architecting and building data applications using Azure, specifically a Data Warehouse and/or Data Lake. Technologies : Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, Azure Databricks and Power BI. Experience with creating low-level designs for data platform implementations. ETL pipeline development for the integration with data sources and data transformations including the creation of supplementary … with APIs and integrating them into data pipelines. Strong programming skills in Python. Experience of data wrangling such as cleansing, quality enforcement and curation e.g. using Azure Synapse notebooks, Databricks, etc. Experience of data modelling to describe the data landscape, entities and relationships. Experience with data migration from legacy systems to the cloud. Experience with Infrastructure as Code (IaC) particularly More ❯

integrating Oracle data sources within Azure environments. Excellent problem-solving and communication skills. Preferred Qualifications Experience with additional Azure services like Azure Data Lake , Azure SQL Database , or Azure Databricks . Familiarity with Infrastructure-as-Code (IaC) practices. Strong knowledge of data governance and security best practices in the cloud. Previous experience in a DevOps environment with CI/CD More ❯

Data Engineer - FinTech Company - Newcastle (Tech Stack: Data Engineer, Databricks, Python, Azure, Power BI, AWS QuickSight, AWS, TSQL, ETL, Agile Methodologies) I'm working with a leading Software House in the FinTech industry, based in Newcastle, who are looking to hire a talented Data Engineer .This is a fantastic opportunity to join a forward-thinking company where you'll play … working with data and delivering value to stakeholders. Strong proficiency in SQL, Python, and Apache Spark , with hands-on experience using these technologies in a production environment. Experience with Databricks and Microsoft Azure is highly desirable. Financial Services experience is a plus but not essential. Excellent communication skills, with the ability to explain complex data concepts in a clear and More ❯

drive technical innovation across client projects Document processes and contribute to internal knowledge repositories and best practice libraries Key Skills & Experience Strong hands-on experience with Azure tooling, including: Databricks, Data Factory, Data Lake, and Synapse (or similar data warehouse tools) Azure Analysis Services or comparable BI tooling Solid programming capability in: SQL, Python, Spark, and ideally DAX Familiarity with More ❯

data ingestion into our Azure Data Lake, designing and developing sophisticated data models for analytics, to deploying Azure Logic Apps and Function Apps for process automation. With tools like Databricks, Data Factory, Azure SQL Server, and Python you will help formulate a data driven platform and develop data pipelines that convert raw data into actionable insights in line with our … supporting a collaborative and productive work environment. Develop and implement data ingestion solutions on the Azure platform, ensuring scalability, reliability, and performance. Leveraging technologies such as Azure Data Factory, Databricks, Delta Lake, and Python. Design and maintain robust ETL/ELT processes to integrate data from various sources into Azure data services. Help to implement DataOps practices to streamline and … drive continuous improvement within the team. About you You will fit right into this role if you: Can demonstrate advanced knowledge of cloud services, preferably the broader Fabric or Databricks suite of products; or Azure Data Lake, Azure Data Factory, Azure Logic Apps, Azure Function Apps, alongside a skillset incorporating data modelling techniques and business data requirement comprehension, documentation and More ❯

drive technical innovation across client projects Document processes and contribute to internal knowledge repositories and best practice libraries Key Skills & Experience Strong hands-on experience with Azure tooling, including: Databricks, Data Factory, Data Lake, and Synapse (or similar data warehouse tools) Azure Analysis Services or comparable BI tooling Solid programming capability in: SQL, Python, Spark, and ideally DAX Familiarity with More ❯

mitigating bias in AI/ML models, especially in consumer-facing applications Proficiency in Python and familiarity with AI/ML tools and platforms such as Azure, AWS, GCP, Databricks, MLFlow, Airflow, Plotly Dash and Streamlit Experience with advertising platforms (e.g., Facebook Ads, Google Ads) and programmatic ad-buying strategies is a plus Knowledge of marketing metrics, customer lifetime value More ❯

EDW), and enabling advanced analytics, governance, and data protection by design. The role will focus on ensuring data integrity, scalability, security, and performance within the Microsoft Azure ecosystem, leveraging Databricks as the core platform for advanced analytics, data engineering, and machine learning. The Data Architect will collaborate closely with stakeholders across the business and in particular with data engineering, data … scalable solutions that support AI-driven insights and pricing optimisation. What You'll Be Responsible For Design and implement robust, scalable, and secure data architectures within Microsoft Azure, with Databricks as the core platform for data engineering and analytics. Develop and optimise data models, ETL/ELT pipelines, and data processing frameworks using Databricks, Delta Lake, and other Azure data … compliance. Define and maintain data architecture standards, policies, and guidelines, ensuring scalability and long-term sustainability. Optimise and modernise data pipelines for efficiency, cost-effectiveness, and high performance, leveraging Databricks’ capabilities for big data processing and machine learning. Collaborate closely with data engineering, data science, and pricing teams to enable real-time analytics, AI-driven insights, and predictive modelling. Drive More ❯

informed on industry trends, competitor positioning, and emerging technologies, supporting the sales approach accordingly. Partner & Ecosystem Collaboration Work alongside partners, including cloud providers (Azure, AWS) and data platform vendors (Databricks, Snowflake, Oracle), to enhance solution offerings. Support engagement with Version 1’s delivery and engineering teams to ensure sales commitments align with execution capabilities. Identify co-sell opportunities and collaborate … of Data & Analytics). Data & Technology Knowledge Understanding of data platforms, data engineering, AI/ML, analytics, and cloud ecosystems. Familiarity with technologies such as Azure Data Services, AWS, Databricks, Snowflake, Oracle, and Power BI. Ability to articulate the business impact of data-driven decision-making and AI solutions. Stakeholder Engagement & Communication Strong communication skills, able to simplify complex technical More ❯

data management best practices including demonstrated experience with data profiling, sourcing, and cleansing routines utilizing typical data quality functions involving standardization, transformation, rationalization, linking and matching, Good knowledge of Databricks, Snowflake, Azure/AxoWS/Oracle cloud, R, Python. Additional Information At Version 1, we believe in providing our employees with a comprehensive benefits package that prioritises their well-being More ❯

. Strong background in data architecture , including data modeling, warehousing, real-time and batch processing, and big data frameworks. Proficiency with modern data tools and technologies such as Spark, Databricks, Kafka, or Snowflake (bonus). Knowledge of cloud security, networking, and cost optimization as it relates to data platforms. Experience in total cost of ownership estimation and managing its impact More ❯

external vendors to enhance data management capabilities. Provide expert-level troubleshooting, root cause analysis, and performance optimisation for data platforms, such as Azure SQL databases, Fabric Warehouse and Onelake, Databricks, and Azure Data Factory. Document technical solutions, best practices, and knowledge base articles to facilitate effective knowledge transfer and continuous improvement. Diagnose and resolve data-related incidents and problems escalated More ❯

working with data and delivering value to stakeholders. Strong proficiency in SQL, Python, and Apache Spark , with hands-on experience using these technologies in a production environment. Experience with Databricks and Microsoft Azure is highly desirable. Financial Services experience is a plus but not essential. Excellent communication skills, with the ability to explain complex data concepts in a clear and More ❯

Proven ability to interpret complex business requirements and translate them into scalable technical solutions Solid hands-on experience working with Python for data handling, transformation, or orchestration Familiarity with Databricks, preferably in an Azure environment Excellent communication and collaboration skills-you're approachable, professional, and confident engaging with both technical and non-technical stakeholders Strong self-management-able to juggle More ❯

reference architectures, and best practices are followed in strategic partner-aligned projects. Job qualifications Technical Skills Deep expertise in one or more cloud/partner architectures: AWS, Azure, GCP, Databricks, and/or NVIDIA. Experience designing large-scale distributed systems, with a specialization aligned with one or more of our core offerings: AI-driven UX, Product Innovation, Data Modernization, AI More ❯

empowers advanced analytics, supports regulatory reporting, and drives long-term business value. You will lead the design of a high-performance data estate, built primarily on Microsoft Azure and Databricks Key Responsibilities: Design and implement scalable, secure cloud-based data architecture (Azure & Databricks) Develop optimised data models and pipelines using Delta Lake and Azure services Define data standards, policies, and … data engineering and architecture Collaborate with internal stakeholders and third-party vendors Key Skills & Experience: Proven background designing and delivering enterprise-scale data platforms Strong knowledge of Microsoft Azure, Databricks, Delta Lake, and data warehousing Advanced data modelling and ETL/ELT optimisation experience Familiarity with regulatory frameworks such as IFRS 17 , BCBS 239 , and UK Data Protection Excellent stakeholder … cross-functional collaboration skills Prior experience in a regulated industry (e.g. insurance, financial services, healthcare) is desirable Microsoft Certified: Azure Solutions Architect Expert Microsoft Certified: Azure Data Engineer Associate Databricks Certified Data Engineer or Machine Learning Associate Benefits for the Enterprise Data Architect Discretionary annual bonus Hybrid working (2 days office/3 days home) 25 days annual leave + More ❯

solutions within their data infrastructure. They work on an AWS tech stack, but are open to seeing candidates from Azure backgrounds too, as long as you have experience leveraging Databricks as this is a core part of their tech stack. This is a brilliant opportunity for a Data Scientist to make a tangible impact on a business that is investing … its data capabilities! Requirements Experience developing and deploying machine learning models Skills in Python, SQL, and ML frameworks such as TensorFlow, PyTorch, or scikit-learn Hands-on experience with Databricks (either on AWS or Azure) Understanding of ML Ops principles is beneficial Confident working independently with a can-do attitude Benefits Salary up to £60,000 depending on experience More ❯

06.06.2025 Expiry Date: 21.07.2025 Job Description: You will provide expert-level troubleshooting, root cause analysis, and performance optimisation for data platforms such as Azure SQL databases, Fabric Warehouse, Onelake, Databricks, and Azure Data Factory. Purview or another MDM tool is highly desirable. Skills/experience Bachelor’s degree in Information Technology, Computer Science, Data Management, or a related field. 4+ … and external vendors to enhance data management capabilities. Provide expert-level troubleshooting, root cause analysis, and performance optimisation for data platforms, such as Azure SQL databases, Fabric Warehouse, Onelake, Databricks, and Azure Data Factory. Document technical solutions, best practices, and knowledge base articles to facilitate effective knowledge transfer and continuous improvement. Diagnose and resolve data-related incidents and problems escalated More ❯

and experience will you need? Experience line managing a data engineering team, mentoring and leading the team through best practice and career development. Experience and deep understanding of AWS, Databricks, Power BI or other similar tooling. Experience advising on technology and standards, setting direction, building and maintaining networks and collaborating across teams with a diverse range of stakeholders. You and … make this transition a success. Once up and running, you will steer the strategic development of event and common data platforms, strategic architecture, data models, and data quality using Databricks, Power BI, and AWS tooling. Details. Wages. Perks. Location: You'll join us in one of our brilliant digital hubs in Birmingham, Blackpool, Leeds, Manchester, Newcastle, or Sheffield, whichever is More ❯

Graduate Data Engineer (Python Spark SQL) *Newcastle Onsite* to £33k Do you have a first class education combined with Data Engineering skills? You could be progressing your career at a start-up Investment Management firm that have secure backing, an More ❯

Social network you want to login/join with: Principal Data and AI Engineer, newcastle-upon-tyne, tyne and wear col-narrow-left Client: Location: newcastle-upon-tyne, tyne and wear, United Kingdom Job Category: Other - EU work permit required More ❯

stakeholders and business users. Key Skills: Proven background in platform selection, configuration, and onboarding (ideally across AWS, cloud, or on-prem solutions). Hands-on familiarity with tools like Databricks, Python, and SaaS analytics environments. Experience working within a CTO or principal engineering team to translate complex technical concepts into language understood by functional users. Strong stakeholder management - able to More ❯