20 of 20 Permanent Databricks Jobs in Yorkshire

with structured/unstructured data. • Comfortable working in an environment where the data platform is being built from scratch. Desirable • Experience with Azure Synapse, Databricks, or other cloud data technologies. • Exposure to Python or notebooks for data wrangling. • Understanding of Continuous Integration/Continuous Deployment, DevOps, or version control ...

pipelines. Proficiency in SQL and strong understanding of database principles. Ability to design scalable data architectures aligned to business needs. Desirable: Previously worked with Databricks, Azure Synapse, Azure Data Lake, or equivalent cloud platforms. Knowledge of data governance and security frameworks. Exposure to DevOps/DataOps practices (e.g., CI/ ...

Strong Python and SQL skills AWS or GCP Orchestration, ideally with Airflow or Dagsta but open to others Data warehousing - Snowflake, Redshift, BigQuery (NOT Databricks) Terraform or Palumi BENEFITS The successful Lead Data Engineer will receive the following benefits: Salary between £100,000 - £120,000 - depending on experience ...

travel between Trust sites Desirable: Knowledge of data governance and data quality frameworks Familiarity with modern data platforms (e.g., Microsoft Fabric, Data Factory, Databricks) Experience supporting digital transformation initiatives Experience with Python or R for data analysis or transformation Experience building deployment pipelines in Microsoft 365 environment We recognise ...

travel between Trust sites Desirable: Knowledge of data governance and data quality frameworks Familiarity with modern data platforms (e.g., Microsoft Fabric, Data Factory, Databricks) Experience supporting digital transformation initiatives Experience with Python or R for data analysis or transformation Experience building deployment pipelines in Microsoft 365 environment We recognise ...

with the freedom to shape how GenAI and ML are used across the platform. Tech stack: Python PyTorch or TensorFlow scikit-learn Spark Kafka Databricks LangChain and RAG-based GenAI systems Cloud-native Azure environment Important Details: Fully remote across ...

Working with Fabric pipelines, notebooks and Dataflows Understanding of data governance and security Able to work independently and lead delivery Bonus Points Experience with Databricks or Azure Synapse Power BI modelling and DAX Experience building platforms from scratch Experience working in organisations with limited existing data structure Microsoft Fabric Architect ...

Engineering will have the following skills and experience: Confidence operating across ML delivery, GenAI and distributed data. Cloud experience - ideally AWS. Understanding of Spark, Databricks or similar data technologies Knowledge of modern web (TypeScript or React) and .NET Strong grounding in CI/CD, containerisation and monitoring. BENEFITS The successful ...

hands-on experience with Starburst Enterprise or Denodo Tool Advanced SQL skills, including query optimization and performance tuning. Experience with cloud data platforms (Snowflake, Databricks) Proficiency in any Scripting language (e.g. Python/Scala) Proficiency in data analytics and data engineeringDesirable skills/knowledge/experience: (As applicable) Handson experience ...

with this role: Core Skills & Key Responsibilities Bring 5+ years of enterprise sales experience in data management and analytics, ideally with vendors such as Databricks, Snowflake, Denodo, Informatica, Teradata, ScaleAI or similar. Develop and execute account strategies aligned to customer data, analytics, and AI transformation initiatives that are focused ...

data upload and extraction Creating and executing a scale and rollout plan across the organisation Key Requirements: Senior stakeholder management Azure-based architecture and Databricks AI/Large Language Model concepts (particularly data mapping ...

data engineering capability within the business. Responsibilities Lead the design and development of end-to-end data pipelines using Azure Synapse, Data Factory, Databricks or Microsoft Fabric Architect, implement and oversee high-performing data lakes, data warehouses and ETL/ELT processes Develop scalable, robust data models for enterprise-level … architectural decisions and data engineering standards across projects Skills and Experience Extensive hands-on experience with Azure data services such as Synapse, Data Factory, Databricks or Fabric Strong SQL skills with experience building optimised, complex queries Proficiency in Python and/or PySpark for data transformation and automation Strong experience ...

Role: Lead Data Engineer - Azure/Databricks Location: Sheffield Working Model: Hybrid - 2 days per week in person Salary: Up to £85k depending on experience Own the data platform. Shape the future architecture. This role is for a hands-on data engineering leader who wants to build something properly … others while staying deeply technical, this role is built for you. What youll be working on Architecting and rebuilding the data transformation layer in Databricks Designing robust data flows that support both real-time operational views and deep historical analysis Moving pipelines from ad-hoc scripts to software-engineering standards ...

clients and is looking to provide further expertise by improving its data capabilities. THE ROLE As a Lead Data Engineer you will build a Databricks platform with ownership, shaping how data is engineered, deployed, automated, and governed in Azure. Specifically, you can expect to be involved in the following: Designing … developing end-to-end data platform solutions in Azure using Databricks Building and maintaining automation for cluster management, monitoring, tagging, and platform optimisation. Implementing CI/CD and DevOps best practices across data pipelines and platform components. Taking ownership of design decisions and long-term architectural direction. SKILLS AND EXPERIENCE ...

Databricks Architect Role Overview We are seeking a S enior Databricks Architect to lead the design and delivery of scalable, high-performance data platforms built on Databricks. This is a strategic role requiring strong architectural experience, hands-on design capability, and a deep understanding of modern data ecosystems. The ideal … migrating data platforms into Databricks. Candidates with strong architecture backgrounds on comparable platforms (such as Snowflake) will also be considered, provided they hold relevant Databricks certifications. Key Responsibilities Design end-to-end data architectures using Databricks for analytics, data engineering, and data science use cases. Lead and support data platform ...

Analyst , you'll play a vital role in delivering Evri's Fair Pay commitments. In this highly analytical role, you will use advanced SQL, Databricks and data modelling to ensure pay is accurate, compliant and fair! Acting as a senior escalation point and subject matter expert , you will support complex … tools to analyse large datasets, resolve complex pay issues and provide clear insight to the business Building and maintaining logic models, reporting solutions and Databricks datasets that support operational reporting and payment accuracy Proactively identifying opportunities to improve pay processes, systems and ways of working Providing expert analytical input ...

Azure which is enabling the business to do Machine Learning and Analytics. Mentor and upskill junior engineers, promoting engineering standards. Work with Terraform and Databricks to deliver scalable, governed data solutions. Support the development of data pipelines. SKILLS AND EXPERIENCE The successful Principal Data Engineer will have the following skills … experience: Strong commercial experience working with Azure. Proficient in Databricks and Terraform. Confident mentoring and guiding engineers across teams. Exposure to containers and Kubernetes is advantageous. Awareness of ML Ops principles is beneficial. BENEFITS The successful Principal Data Engineer will receive the following: Salary up to £80,000 - depending ...

building and maintaining the infrastructure to support the full data science lifecycle from data ingestion to model deployment, monitoring, and upgrades within Azure and Databricks environments. The engineer will work closely with data scientists in a collaborative, cross-functional setting, helping transition models from research into production. Key Responsibilities … smooth productionisation of models. Write clean, production-ready Python code. Apply software engineering best practices, CI/CD, TDD. Required Skills: Proficiency in Python, Databricks, and Azure. Experience with deployment tools (e.g., AKS, managed endpoints). Strong software engineering background (CI/CD, VCS, TDD). Ability to integrate ...

autonomy and hands-off management. Specifically, you can expect to be involved in the following: Data ingestion using Fivetran and Python Batch Scripts Using Databricks to store and process large volumes of data within an AWS environment Building data transformations with DBT Building visualisations using Power BI Nice to Haves … Terraform Docker AWS Certification SKILLS AND EXPERIENCE The successful Senior Data Engineer will have the following skills and experience: Strong Python skills and R Databricks on AWS Experience with strong governance Previous work with health providers good but not essential History with startups good but not essential BENEFITS The successful ...

We are looking to recruit an experienced Data Engineer who has experience working on the implementation and development of Microsoft Fabric. In addition you will need a wealth of SQL Experience including in a Cloud ...