1 to 25 of 29 Permanent Databricks Jobs in the North of England

based data solutions (preferably in Azure). Expert-level SQL and database design (normalisation, indexing, query optimisation). Strong experience with ETL/ELT tools. E.g. Azure Data Factory, Databricks, Synapse Pipelines, SSIS, etc. Experience with Python, PySpark, or Scala for data processing. Familiarity with CI/CD practices. Experience with Data lake, Data warehouse and Medallion architectures. Understanding of More ❯

Experience Educational Background: • Bachelor’s degree in computer science, Engineering, Information Technology, or a related field • Relevant certifications in data engineering or cloud platforms (e.g., AWS, Azure, Google Cloud, Databricks) are a strong plus Technical Skills: • Proficiency in SQL and experience with relational databases (e.g., MySQL, PostgreSQL) • Familiarity with data pipeline and workflow management tools (e.g., Apache Airflow) • Experience with More ❯

example - Computer Science, Mathematics, Engineering or other STEM A strong team player with empathy, humility and dedication to joint success and shared development. Desirable Experience and Qualifications: Experience with Databricks or Delta Lake architecture. Experience building architecture and Data Warehousing within the Microsoft Stack Experience in development Source control (e.g. Bit Bucket, Github) Experience in Low Code Analytical Tools (e.g. More ❯

learning and Data science applications Ability to use wide variety of open-source technologies Knowledge and experience using at least one Data Platform Technology such as Quantexa, Palantir and DataBricks Knowledge of test automation frameworks and ability to automate testing within the pipeline This is an opportunity for significant growth, but with a start-up feel and mentality. In this More ❯

learning and Data science applications Ability to use wide variety of open-source technologies Knowledge and experience using at least one Data Platform Technology such as Quantexa, Palantir and DataBricks Knowledge of test automation frameworks and ability to automate testing within the pipeline This is an opportunity for significant growth, but with a start-up feel and mentality. In this More ❯

Required Skills & Qualifications: Demonstrable experience in building data pipelines using Spark or Pandas. Experience with major cloud providers (AWS, Azure, or Google). Familiarity with big data platforms (EMR, Databricks, or DataProc). Knowledge of data platforms such as Data Lakes, Data Warehouses, or Data Meshes. Drive for self-improvement and eagerness to learn new programming languages. Ability to solve More ❯

We’re Looking For Experience building data pipelines using Spark or Pandas . Familiarity with major cloud platforms (AWS, Azure, or GCP). Understanding of big data tools (EMR, Databricks, DataProc). Knowledge of data architectures (Data Lakes, Warehouses, Mesh). A proactive mindset with a passion for learning new technologies. Nice-to-Have Skills Automated data quality checks and More ❯

specialist areas such as data architecture, data science or data governance Experience of using common platforms and/or visualisation tools such as Tableau, PowerBI, Google Data Studio, Snowflake, Databricks and data governance tools such as Collibra, Alation etc. Why join AND Digital? We have three core values: wonder, share, and delight. These values inform how we work with clients More ❯

Head of Data Engineering - Azure & Databricks - Remote - Up to £100,000 A forward-thinking and nationally recognised organisation, known for its commitment to innovation and data-driven decision-making, is seeking a Head of Data Engineering to lead its growing data function. With a strong culture of collaboration, investment in cutting-edge technology, and a clear roadmap for digital transformation More ❯

Head of Data Engineering - Azure & Databricks - Remote - Up to £100,000 A forward-thinking and nationally recognised organisation, known for its commitment to innovation and data-driven decision-making, is seeking a Head of Data Engineering to lead its growing data function. With a strong culture of collaboration, investment in cutting-edge technology, and a clear roadmap for digital transformation More ❯

Head of Data Engineering - Azure & Databricks - Remote - Up to £100,000 A forward-thinking and nationally recognised organisation, known for its commitment to innovation and data-driven decision-making, is seeking a Head of Data Engineering to lead its growing data function. With a strong culture of collaboration, investment in cutting-edge technology, and a clear roadmap for digital transformation More ❯

Data Factory, Azure SQL and more. Exposure to IAC (Terraform, Bicep) would be advantageous. Exposure to Azure's development and data services; Azure DevOps, Azure APIM, Azure Fabric, Azure Databricks, etc. Expert understanding of Active Directory & Windows Server. Strong understanding of core cybersecurity principles including least privilege access, zero-trust networking and defence in depth. Solid understanding of virtual desktop More ❯

be recognised as the winner of the 2024 Microsoft Community Response Partner of the Year award, reflecting our dedication to using technology for positive change. We are also a Databricks partner, and an IBM Gold Partner, specialising in Cognos Analytics and Planning Analytics. With offices in York and Sheffield, and a team based throughout the UK – we champion creativity, innovation More ❯

reliable data movement and transformation. • Data Modelling using Kimball, 3NF or Dimensional methodologies • Utilize SQL and Python languages to extract, transform, and load data from various sources into Azure Databricks and Azure SQL/SQL Server. • Design and implement metadata driven pipelines to automate data processing tasks. • Collaborate with cross-functional teams to understand data requirements and implement appropriate solutions. … are some obvious required Skills and Experience we are going to be seeking out. For this role we'd be expecting to see: • Solid experience in Azure, specifically Azure Databricks and Azure SQL/SQL Server. • Proficiency in SQL and Python languages. • Hands-on experience in designing and building data pipelines using Azure Data Factory (ADF). • Familiarity with building More ❯

Role: Data & ML Engineer Location: Newcastle Upon Tyne Levels: Senior Analyst, Specialist Please Note: Due to the nature of client work you will be undertaking, you will need to be willing to go through a Security Clearance (Including BPSS) process More ❯

with engineers, data scientists, and architects to solve real world challenges. Youll bring deep expertise in building clean, reliable data systems, strong leadership, and a collaborative mindset. Experience with Databricks and performant SQL is essential, and knowledge of the utilities sector is a bonus. If you're passionate about mentoring others, driving technical excellence, and making a real impact, wed … standards. Work with technology partners to enhance services, manage risk, and ensure value for money. What skills & qualifications you will need: Proven experience delivering complex data pipelines using Azure Databricks, Azure Data Factory, and other cloud platforms. Strong programming skills in Python, SQL, and cloud-native tools like APIM, Azure Functions, and Synapse. Hands-on experience with DBT for modular … testable SQL in a Lakehouse architecture. Proficient in Power BI for building interactive dashboards and visualising insights. Skilled in Databricks for collaborative data engineering, machine learning, and analytics. Familiarity with the Medallion data design pattern. Solid understanding of data modelling and experience leading delivery strategies. Strong troubleshooting skills with a focus on data and code quality assurance. Although we operate More ❯

DOING? In this role, you'll be building and maintaining the data systems that power our reporting and analytics across the business. You'll develop reliable data pipelines in Databricks, bringing together real-time and batch data from multiple sources on AWS. Working closely with teams across Finance, Marketing, and Compliance, you'll make sure our data is accurate, accessible … Annual Bonus Life Insurance Training & Development Opportunities Enhanced Maternity & Paternity Charity Volunteer Days Cycle to work scheme And More.. DATA ENGINEER - ESSTENTIAL SKILLS Proven experience building data pipelines using Databricks . Strong understanding of Apache Spark (PySpark or Scala) and Structured Streaming . Experience working with Kafka (MSK) and handling real-time data . Good knowledge of Delta Lake/… services such as S3, Glue, Lambda, Batch, and IAM. Strong skills in Python for data engineering, automation, and testing. Confident using SQL for data analysis and building queries in Databricks SQL. Experience implementing CI/CD pipelines (e.g. GitHub Actions, Azure DevOps, or Jenkins). Familiarity with Git and version control best practices. TO BE CONSIDERED Please either apply by More ❯

experience in data engineering within Azure environments, with a strong track record in modernisation and large-scale migration projects. You'll be confident designing metadata-driven frameworks and managing Databricks environments, with hands-on expertise in Python, T-SQL, and PySpark. Your leadership and mentoring skills will be key, alongside your ability to collaborate across teams and drive strategic decisions. … Essential Skills Include: Proven leadership and mentoring experience in senior data engineering roles Expertise in Azure Data Factory, Azure Databricks, and lakehouse architecture Strong programming skills (Python, T-SQL, PySpark) and test-driven development Deep understanding of data security, compliance, and tools like Microsoft Purview Excellent communication and stakeholder management skills Experience with containerisation and orchestration (e.g., Kubernetes, Azure Container More ❯

security and privacy regulations. Contribute to Communities of Practice and support their cloud-first strategy. What you'll need to succeed Extensive experience in cloud-based data engineering (preferably Databricks), with a strong background in modernisation and large-scale migration. Expertise in Azure services (API Manager, App Service), Databricks, Spark, Python, SQL, and AI/ML frameworks. Proven track record … . Ability to translate strategic goals into technical delivery plans and roadmaps. Desirable Criteria Experience designing and implementing AI/ML-driven solutions within data platforms. Relevant certifications (e.g. Databricks Engineer Professional, Azure Data Engineer Associate, Azure Solutions Architect). Advanced academic qualifications or industry recognition in data engineering and cloud technologies. Experience in DevOps practices using GitHub Actions and More ❯

and recommend new tools, technologies, and processes to improve performance, scalability, and efficiency. Contribute to migrations and modernisation projects across cloud and data platforms (e.g. AWS, Azure, GCP, Snowflake, Databricks). Create and maintain documentation aligned with internal processes and change management controls. Experience & Technical Skills Proven hands-on experience as a Data Engineer or in a similar data-centric … ETL/ELT pipelines, data modelling, and data warehousing principles. Experience working with cloud platforms such as AWS, Azure, or GCP. Exposure to modern data tools such as Snowflake, Databricks, or BigQuery. Familiarity with streaming technologies (e.g., Kafka, Spark Streaming, Flink) is an advantage. Experience with orchestration and infrastructure tools such as Airflow, dbt, Prefect, CI/CD pipelines, and More ❯

Lead Software Engineer - .NET/AWS/Databricks .NET, C#, Python, SQL, Databricks, AWS, Azure, Microservices, APIs, Cloud Security Salary up to £85k Hybrid - Greater Manchester Excellent progression and leadership opportunities Who We Are We're an established technology-driven organisation focused on building secure, scalable, and high-performing digital platforms. Our engineering culture promotes innovation, collaboration, and continuous improvement. … fostering a high-performance culture within the engineering team. What You'll Be Doing Lead the design, development, and implementation of .NET back-end systems and data workflows using Databricks . Oversee the build and optimisation of data pipelines within AWS . Drive engineering excellence , establishing and maintaining standards, metrics, and best practices. Mentor and develop engineering teams, encouraging innovation … AWS data services and cloud-native architectures. Proficiency in Python and SQL Excellent stakeholder management skills, able to bridge technical and business perspectives. Knowledge of Azure and experience with Databricks or similar data platforms. Benefits Salary up to £85,000 25 days holiday + bank holidays + birthday off Hybrid working Collaborative, forward-thinking engineering culture Real influence over technical More ❯

On A mix of traditional DS and cutting-edge AI/LLM work, including: Building models and analytics to support commercial teams Developing Q&A-style LLM tools inside Databricks Exploring customer satisfaction and review data (e.g., identifying drivers behind quality scores) NLP on large volumes of free-text data Regression and hypothesis testing across product and operational data Theme … extraction from defect reports and customer feedback Helping challenge assumptions with data-driven evidence Tech Environment Python & SQL Machine Learning, statistical modelling, data manipulation Cloud-first setup (Azure preferred; Databricks is widely used) Exposure to LLMs or AI agents is extremely valuable More ❯

integration ETL processes and designing efficient data structures Strong programming skills in Python, Java, or Scala Data warehousing concepts and dimensional modelling experience Any data engineering skills in Azure Databricks and Microsoft Fabric would be a bonus This new role involves leading a data team, fostering a culture of technical excellence and continuous improvement. Collaboration with cross-functional teams is … + Flexible working (2 - 3 days per week in the office). To apply, press apply now or send your CV to Keywords: Lead Data Engineer/Azure Databricks/AWS/ETL/Python/data modelling Flexible working - Preston - Blackpool - Manchester - Warrington - Liverpool - Bolton - Blackburn Circle Recruitment is acting as an Employment Agency in relation to this vacancy. More ❯

be recognised as the winner of the 2024 Microsoft Community Response Partner of the Year award, reflecting our dedication to using technology for positive change. We are also a Databricks partner, and an IBM Gold Partner, specialising in Cognos Analytics and Planning Analytics. With offices in York and Sheffield, and a team based throughout the UK – we champion creativity, innovation … performance efficiency. Support cloud migration projects, including planning, execution, and post-migration support. Implement and manage a range of Azure services such as Azure Virtual Machines, Azure Storage, Azure Databricks, Microsoft Sentinel and more. Automate deployment and management processes using Azure Bicep (infrastructure as code) and by utilising tools such as Azure CLI and Azure DevOps. Monitor and troubleshoot cloud More ❯

that you are reliable. As our Business Intelligence Analyst , you will be responsible for transforming organisational data into meaningful insight. This role will focus on understanding data structures within Databricks, preparing data for analysis, and building impactful Power BI dashboards and automated reports. It is ideal for someone who is technically capable, data-driven and passionate about enabling the business … structures, data flows and how data is built within Databricks. Explore and test existing data pipelines to ensure data completeness and readiness for reporting. Transform and model data from Databricks to support scalable, high-quality analytics. Skills & Experience required to do this role as Business Intelligence Analyst... Experience as a BI Analyst, Data Analyst or similar role. Strong Power BI … skills, including data modelling and DAX. Experience working with Databricks, SQL or similar data platforms. Strong understanding of data preparation, data structures and analytics workflows. Ability to communicate findings clearly and effectively. Experience using Alteryx would be beneficial but not essential Curious, analytical and eager to explore how data works. Excellent attention to detail. Strong communication and stakeholder-management skills. More ❯