1 to 25 of 28 Databricks Jobs in West Yorkshire

to architectural decisions, and support the migration of reporting services to Azure. Key Responsibilities: Design, build, and maintain ETL pipelines using Azure Data Factory , Azure Data Lake , Synapse , and Databricks . Design and build a greenfield Azure data platform to support business-critical data needs. Collaborate with stakeholders across the organization to gather and define data requirements. Assist in the More ❯

the ability to influence at both technical and senior stakeholder levels. Desirable Skills: Familiarity with data visualisation tools (e.g., Power BI, Tableau). Exposure to platforms such as Quantexa, Databricks, or Palantir. Experience building machine learning pipelines or working on data science applications. Knowledge of test automation and CI/CD for data workflows. This is a unique opportunity to More ❯

techniques-including conceptual, logical, and physical modelling Strong expertise in Kimball methodology and dimensional modelling (e.g. star schema design) Experience with modern cloud data platforms, ideally including Microsoft Azure, Databricks, and associated tools (e.g., Azure Data Factory, Azure SQL, Synapse) Familiarity with modern data engineering practices including the use of automated data pipelines, ETL/ELT processes, and DevOps for More ❯

large-scale platforms and diverse stakeholder groups Strong data modelling skills across OLTP and OLAP systems, with experience building datamarts and warehouses Proficiency with cloud-native tools (e.g. Snowflake, Databricks, Azure Data Services, etc.) High-level SQL skills and experience with tools like SSMS, SSIS, or SSRS Strong understanding of data governance, RBAC, and information security practices Able to evaluate More ❯

managing complex financial datasets Python experience, particularly for data processing and ETL workflows Hands-on experience with cloud platforms- Azure Experience designing and maintaining data pipelines using tools like Databricks and PySpark Knowledge of data warehousing solutions - Snowflake experience would be brilliant Understanding of CI/CD processes for deploying data solutions Some exposure to big data technologies and distributed More ❯

need: Significant experience of working with complex data sets and using data analysis models Have a working knowledge of SQL data analysis , or willing to learn, (MS-SQL/Databricks - T-SQL, View and table design) Significant experience of using IT systems including Excel, Power BI and Python Strong technical analytical skills as a Data Analyst Managing and manipulating data More ❯

level Power BI knowledge, with proven experience developing and implementing organisation-wide data visualisation strategies. Familiarity with Microsoft Fabric concepts is advantageous. Hands-on experience with cloud platforms, particularly Databricks and Microsoft Azure, to support scalable, enterprise-grade analytics solutions. Strong data modelling expertise within Power BI, capable of building robust semantic models and optimising for performance and clarity. Experienced More ❯

Data Engineer (Databricks) - Leeds (Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI/CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Data Engineer) Our client is a global innovator and world leader with one of the most recognisable names within technology. They are looking for Data … Engineers with significant Databricks experience to join an exceptional Agile engineering team. We are seeking a Data Engineer with strong Python, PySpark and SQL experience, possess a clear understanding of databricks, as well as a passion for Data Science (R, Machine Learning and AI). Database experience with SQL and No-SQL - Aurora, MS SQL Server, MySQL is expected, as … Salary: £40k - £50k + Pension + Benefits To apply for this position please send your CV to Nathan Warner at Noir Consulting. (Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI/CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Data Engineer) NOIRUKTECHREC NOIRUKREC More ❯

Lead Data Engineer (Databricks) - Leeds (Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI/CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer) Our client … is a global innovator and world leader with one of the most recognisable names within technology. They are looking for a Lead Data Engineer with significant Databricks experience as well as leadership responsibility to run an exceptional Agile engineering team and provide technical leadership through coaching and mentorship. We are seeking a Lead Data Engineer capable of leading client delivery … data solutions and developing complex enterprise data ETL and ML pipelines and projections. The successful candidate will have strong Python, PySpark and SQL experience, possess a clear understanding of databricks, as well as a passion for Data Science (R, Machine Learning and AI). Database experience with SQL and No-SQL - Aurora, MS SQL Server, MySQL is expected, as well More ❯

ll also play a key part in mentoring junior engineers and shaping the long-term DevOps roadmap. Architect and build scalable Azure infrastructure and deployment pipelines Lead integration of Databricks, Azure services, and CI/CD workflows Automate infrastructure using Terraform (IaC) Mentor junior DevOps engineer Establish and govern DevOps best practices, automation, and security standards Guide adoption of Microsoft More ❯

architecture in a complex organisation Expertise in Kimball and Data Vault 2.0 methodologies Strong grasp of data modelling, metadata, and governance knowledge Hands-on experience with modern data platforms (Databricks, Delta Lake, Unity Catalog, Azure) Ability to define and drive architecture principles, patterns, and best practices Excellent communication and stakeholder management skills Retail industry experience is a bonus but not More ❯

based team, working mostly remotely with one day on-site per week. In this role, you will manage the design and delivery of scalable, cloud-based data solutions using Databricks, Python, and SQL. You will lead and mentor a team of data engineers, drive engineering best practices, and own the data architecture strategy in an agile environment. Key Responsibilities Manage … the development of data pipelines and solutions using Databricks, Python, and SQL Oversee the design and maintenance of data models that support analytics and business intelligence needs Ensure efficient ELT/ETL processes on AWS or Azure cloud platforms Collaborate with analysts, architects, and stakeholders to deliver high-quality data products Promote best practices in testing, CI/CD, version … support the data engineering team, taking accountability for technical delivery and decision-making Drive continuous improvements in platform performance, cost-efficiency, and reliability Key Requirements Hands-on experience with Databricks or similar data engineering platforms Strong Python and SQL skills in data engineering contexts Expertise in data modelling and building analytics-ready datasets Experience with AWS or Azure cloud data More ❯

Vault 2.0 methodologies Experience designing models across raw, business, and consumption layers Solid understanding of metadata, cataloguing, and data governance practices Working knowledge of modern data platforms such as Databricks, Azure, Delta Lake, etc. Excellent communication and stakeholder engagement skills Data Architect - Benefits: Competitive base salary with regular reviews Car allowance - circa £5k per annum Discretionary company bonus Enhanced pension More ❯

reporting and learner support. You’ll play a key role within our global L&D team, helping us deliver high-impact learning journeys across the Salesforce, AWS, Microsoft, and Databricks ecosystems. What You’ll Do 🧠 Course & Content Development Support the design and creation of course content, trainer notes, and engaging learning materials (presentations, videos, case studies, mock exams) Ensure content More ❯

team based in Leeds, working mostly remotely with just one day on-site per week. You’ll lead the design and delivery of scalable, cloud-based data solutions using Databricks, Python, and SQL, while mentoring a team and driving engineering best practices. About You You might currently be a Senior Data Engineer ready to grow your leadership skills. You’re … passionate about building robust, efficient data pipelines and shaping cloud data architecture in an agile environment. Key Responsibilities Lead development of data pipelines and solutions using Databricks, Python, and SQL Design and maintain data models supporting analytics and business intelligence Build and optimise ELT/ETL processes on AWS or Azure Collaborate closely with analysts, architects, and stakeholders to deliver … as code Mentor and support your team, taking ownership of technical delivery and decisions Drive continuous improvements in platform performance, cost, and reliability Key Requirements Hands-on experience with Databricks or similar data engineering platforms Strong Python and SQL skills in data engineering contexts Expertise in data modelling and building analytics-ready datasets Experience with AWS or Azure cloud data More ❯

decision making for Cox Automotive. You'll collaborate with a talented team, using open-source tools such as R, Python, and Spark, data visualisation tools like Power BI, and Databricks data platform. Key Responsibilities: Develop and implement analytics strategies that provide actionable insights for our business and clients. Apply the scientific method to create robust, reproducible solutions Collaborate with stakeholders … seamlessly with team members and external clients. Proficiency in R or Python. Solid understanding of SQL; experience working with Spark (Java, Python, or Scala variants) and cloud platforms like Databricks is a plus. Strong statistical knowledge, including hypothesis testing, confidence intervals, and A/B testing. Ability to understand and communicate the commercial impact of data activities. Why Join Us More ❯

Data Engineer (Databricks) - Leeds Our client is a global innovator and world leader with a highly recognizable name within technology. They are looking for Data Engineers with significant Databricks experience to join an exceptional Agile engineering team. We are seeking a Data Engineer with strong Python, PySpark, and SQL experience, a clear understanding of Databricks, and a passion for Data More ❯

Engineering, Data Science, Analytics, and DevOps teams to align operational strategies with technical and business requirements. Optimize operational performance and cost management for services including Azure Data Factory, Azure Databricks, Delta Lake, and Azure Data Lake Storage. Serve as the domain expert in DataOps by providing strategic guidance, mentoring colleagues, and driving continuous process improvements. What you will need Demonstrable … with agile teams and driving automation of data workflows within the Microsoft Azure ecosystem. Hands-on expertise with Azure Data Platform with components such as Azure Data Factory, Azure Databricks, Azure Data Lake Storage, Delta Lake, Azure SQL, Purview and APIM. Proficiency in developing CI/CD data pipelines and strong programming skills in Python, SQL, Bash, and PySpark for More ❯

Senior Databricks Data Engineer (Mid Level roles also available), £ 50000 - 65000 + benefits. SQL Performance Tuning, Databricks. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks is required for this role. Expanding SaaS product company are looking for a number of Data Engineer as they continue to grow. In these hands-on … Data Engineers and BA's to understand the data needs of the business. Skills Required Include - Previous experience as Data Engineer in a delivery focused environment. Excellent knowledge of Databricks Experience analysing complex business problems and designing workable technical solutions. Excellent knowledge of the SDLC, including testing and delivery in an agile environment. Excellent knowledge of SQL (SQL Performance Tuning … expand its data team. In these roles you will use your technical skills and soft skills/people skills allowing the data team to further develop. Strong, hands-on databricks skills are mandatory for this role. This role is home based with one day a month at their office in Nottingham. Salary is in the range £ 50000 - 65000 + benefits More ❯

native data solutions? We're recruiting on behalf of a dynamic organisation in Leeds that's investing in its data platform - and they're looking for someone with strong Databricks expertise to join their team. About the role: Designing and developing robust data pipelines using Azure Data Factory, Databricks, and Synapse Analytics. Working with Delta Lake and Azure Data Lake … Azure-based architecture Ensuring best practices in data governance, security, and performance tuning Requirements: Proven experience with Azure Data Services (ADF, Synapse, Data Lake) Strong hands-on experience with Databricks (including PySpark or SQL) Solid SQL skills and understanding of data modelling and ETL/ELT processes Familiarity with Delta Lake and lakehouse architecture A proactive, collaborative approach to problem … innovation Benefits: Competitive salary up to £65,000 Flexible hybrid working (2 days in the Leeds office) Generous holiday allowance and pension scheme Ongoing training and certification support (Azure, Databricks, etc.) A supportive, inclusive team culture with real opportunities for growth Please Note: This is a permanent role for UK residents only. This role does not offer Sponsorship. You must More ❯

customer-facing reports. You will optimise the transformation pipeline from start to finish, guaranteeing that datasets are robust, tested, secure, and business-ready. Our data platform is built using Databricks, with data pipelines written in PySpark and orchestrated using Airflow. You will be expected to challenge and improve current transformations, ensuring they meet our performance, scalability, and data governance needs. … end-to-end data quality, from raw ingested data to business-ready datasets Optimise PySpark-based data transformation logic for performance and reliability Build scalable and maintainable pipelines in Databricks and Airflow Implement and uphold GDPR-compliant processes around PII data Collaborate with stakeholders to define what "business-ready" means, and confidently sign off datasets as fit for consumption Put … Help shape our approach to reliable data delivery for internal and external customers Skills & Experience Required Extensive hands-on experience with PySpark, including performance optimisation Deep working knowledge of Databricks (development, architecture, and operations) Proven experience working with Airflow for orchestration Proven track record in managing and securing PII data, with GDPR compliance in mind Experience in data governance processes More ❯

technical background but has recently worked in a managerial role focused on mentoring, coaching, reviewing code, and standard setting. The role will focus on the development of the clients Databricks platform (AWS is preferred but open to Azure.GCP experience also), utilising Python and SQL, contribute to CI/CD pipelines, strategy development, cost optimisation and data governance frameworks. Job duties … engineers, helping to mentor and coach the team. Manage the adoption of automated CI/CD pipelines. Implement a new delivery roadmap. Contribute to the development of a new Databricks system in AWS (AWS experience is preferred but they are open to managers with Azure experience). Cost optimisation. Establish data governance frameworks for secure handling of delivery information. Requirements … Manager: 6+ years experience in a hands on data engineer role, with over a years recent experience in a managerial role, coaching similar sized teams. Deep knowledge of the Databricks platform. Hands on Python development experience. SQL optimisation. Experience with large scale data pipeline optimisation. Experience with Streaming and Batch Spark workloads. Strong people management skills. Role: Data Engineering Manager More ❯

and managing modern data pipelines and cloud-based data solutions. What you'll be doing: Designing and maintaining scalable data pipelines Building and optimising data warehousing solutions Working with Databricks and modern cloud platforms (Azure or AWS) Collaborating with cross-functional teams to deliver high-impact data products Leading best practices in data engineering and pipeline architecture What we're … looking for: Proven experience in data engineering at a senior level Strong hands-on knowledge of Databricks Experience with Azure or AWS cloud platforms Expertise in data warehousing and ETL processes Ability to work both independently and as part of a collaborative team Why join us? £60,000 salary Flexible hybrid working (2 days a week in our Leeds office More ❯

you'll work closely with DevOps, Product, and business partners to unlock the value of data through modern, secure and governed pipelines. Lead hands-on development work using Azure, Databricks, and Terraform (IaC) Support the migration from legacy platforms to a more modern cloud stack Act as a mentor and technical guide to the wider engineering team Implement data governance … close to the ML lifecycle YOUR SKILLS AND EXPERIENCE: A successful Principal Data Engineer will have the following skills and experience: Strong hands-on experience with Azure Proficient in Databricks Skilled in Terraform and Infrastructure as Code practices Exposure to containers/Kubernetes Awareness of ML Ops concepts THE BENEFITS: You will receive a salary, dependent on experience. Salary is More ❯

to shape the future of logistics. You must have management/leadership experience to be considered for this role. What You'll Do: Lead the technical direction of our Databricks Common Data Platform Drive hands-on development with high-quality Python and SQL code Mentor and coach a distributed team of data engineers Champion CI/CD and automated testing … Work closely with the Head of Data Engineering to align with strategic goals Must-Have Experience: 8+ years in data engineering, including leadership experience Expert-level knowledge of the Databricks platform Advanced Python development for logistics and delivery optimisation Mastery of SQL for large-scale, nationwide operations Strong understanding of data modelling for parcel tracking systems Experience with both streaming More ❯