real-time streaming architectures, to support advanced analytics, AI, and business intelligence use cases. Proven experience in designing architectures for structured, semi-structured, and unstructured data , leveraging technologies like Databricks, Snowflake, Apache Kafka , and Delta Lake to enable seamless data processing and analytics. Hands-on experience in data integration , including designing and optimising data pipelines (batch and streaming) and integrating … in data and AI, such as data fabric, automated machine learning (AutoML) , and low-code/no-code analytics platforms , with familiarity in vendor ecosystems (e.g., Microsoft, AWS, Google, Databricks ). Exceptional stakeholder management and presentation skills , with the ability to translate complex data and AI concepts into actionable insights for non-technical audiences, including C-suite executives. Experience leading … AI projects, ensuring timely and budget-conscious execution, while mentoring junior team members. Relevant certifications , such as AWS Certified Solutions Architect, Azure Data Engineer Associate, Google Professional Data Engineer, Databricks Certified Data Engineer , or TOGAF , with additional certifications in AI or MLOps being a plus. Your Responsibilities Your responsibilities and achievements will evolve as you grow with us. Initially, you More ❯
Manchester, Lancashire, United Kingdom Hybrid/Remote Options
CHEP UK Ltd
s or PhD level degree 5+ years of work experience in a data science role Proficient with cloud computing environments, Kubernetes, etc. Familiarity with Data Science software & platforms (e.g. Databricks) Software development experience Research and new algorithm development experience# Remote Type Hybrid Remote Skills to succeed in the role Active Learning, Adaptability, Bitbucket, Cloud Infrastructure (Aws), Code Reviews, Cross-Functional … Work, Curiosity, Databricks Platform, Data Science, Data Storytelling, Digital Literacy, Emotional Intelligence, Empathy, Git, Initiative, Machine Learning, Problem Solving, Python (Programming More ❯
City of London, London, United Kingdom Hybrid/Remote Options
Billigence
years of experience across data engineering, cloud computing, or data warehousing Minimum 2 years in hands-on development capacity Expertise in one or more modern cloud data platforms: Snowflake, Databricks, AWS Redshift, Microsoft Fabric, or similar Understanding of data modelling principles, dimensional modelling, and database design Proficiency in SQL and query optimization Comprehensive knowledge of ETL/ELT processes and … experience Hands-on experience with modern data tools such as dbt, Fivetran, Matillion, or similar data integration platforms Programming skills in Python, Java, or Scala Relevant cloud certifications (SnowPro, Databricks Certified, AWS/Azure/GCP Data Engineering certifications) Experience with DataOps, CI/CD practices, and infrastructure-as-code Knowledge of data governance, data quality frameworks, and metadata management More ❯
years of experience across data engineering, cloud computing, or data warehousing Minimum 2 years in hands-on development capacity Expertise in one or more modern cloud data platforms: Snowflake, Databricks, AWS Redshift, Microsoft Fabric, or similar Understanding of data modelling principles, dimensional modelling, and database design Proficiency in SQL and query optimization Comprehensive knowledge of ETL/ELT processes and … experience Hands-on experience with modern data tools such as dbt, Fivetran, Matillion, or similar data integration platforms Programming skills in Python, Java, or Scala Relevant cloud certifications (SnowPro, Databricks Certified, AWS/Azure/GCP Data Engineering certifications) Experience with DataOps, CI/CD practices, and infrastructure-as-code Knowledge of data governance, data quality frameworks, and metadata management More ❯
Role Title: Senior Databricks Engineer Duration: contract to run until 31/12/2026 Location: Glasgow, hybrid 2/3 days per week onsite Rate: up to £414 p/d Umbrella inside IR35 Role purpose/summary We are currently migrating our data pipelines from AWS to Databricks, and are seeking a Senior Databricks Engineer to lead and … contribute to this transformation. This is a hands-on engineering role focused on designing, building, and optimizing scalable data solutions using the Databricks platform. Key Skills/requirements Lead the migration of existing AWS-based data pipelines to Databricks. Design and implement scalable data engineering solutions using Apache Spark on Databricks. Collaborate with cross-functional teams to understand data requirements … and translate them into efficient pipelines. Optimize performance and cost-efficiency of Databricks workloads. Develop and maintain CI/CD workflows for Databricks using GitLab or similar tools. Ensure data quality and reliability through robust unit testing and validation frameworks. Implement best practices for data governance, security, and access control within Databricks. Provide technical mentorship and guidance to junior engineers. More ❯
JOB TITLE: Hybrid Advisor Cloud Engineer (Databricks) JOB LOCATION: Onsite 2 days a week in Dublin OH WAGE RANGE : $65HR TO $68HR JOB NUMBER: 25-03732 REQUIRED EXPERIENCE: What we're looking for Analytical and data analysis skills using Microsoft SQL. Excellent team, verbal and written communication skills Experienced SQL Server/MS-SQL scripting and Databricks expertise. Experience with … within healthcare for functional, business leaders, and team members. Under general direction, the Advisor Cloud Engineer will be responsible for designing and/or creating, maintaining, deploying, and managing Databricks and SQL applications for internal business teams and our customers. Candidates will work collaboratively with IT staff, and business stakeholders to create, maintain, and support ETL packages in a compliant … understand the business requirements and present detailed systems design documentation for reports, data interface files, data conversion and any other method of data exchange. Develop, test, manage and implement Databricks/SQL Packages from development server to production server using package configuration. Work on maintenance and Administration of Databricks by creating Jobs, Alerts, SQL Mail Agent, and schedules. Develop with More ❯
Solutions Architect - Databricks Join to apply for the Solutions Architect - Databricks role at Lumenalta . We partner with global enterprises to launch digital products that interact with millions of users and massive data volumes. Our work requires scalable architecture, creative problem solving, and seamless platform integration. What You'll Do Design scalable, secure, and high performance data architectures Translate business … requirements into robust technical solutions Guide teams on best practices for building with PySpark, AWS, and Databricks Collaborate with cross functional teams to align architecture with product goals Own architectural decisions across cloud infrastructure and data pipelines What We're Looking For 8+ years of experience in data engineering, architecture, or related roles Deep expertise with AWS, Databricks, and PySpark More ❯
West Midlands, United Kingdom Hybrid/Remote Options
IO Associates
Title: Senior Data Engineer (Databricks) Salary: Up to £60,000 Location: Birmingham (Hybrid) Are you a Data Engineer looking to work on large-scale, global data solutions that actually make an impact? This is a fantastic opportunity to join a market-leading automotive technology company that's shaping the future of connected data and intelligent platforms worldwide. You'll be … thousands of dealerships across the globe. What you'll be doing: Building and maintaining a unified data platform for global data processing. Developing reusable and scalable data solutions using Databricks, Python/PySpark, and Azure. Working closely with the data visualisation team to align back-end and front-end needs. Designing secure data access models and integrating external data sources … keep things running smoothly. What we're looking for: Strong understanding of data engineering principles, Lakehouse architecture, ETL/ELT, warehousing, and stream processing. Hands-on experience with Azure Databricks, Python/PySpark, SQL Server, and Azure Blob Storage. A track record of building secure, scalable data pipelines and solving complex problems. Great communication and documentation skills with a proactive More ❯
Job Title: Senior Data Engineer (Azure/Databricks) Location : UK (Flexible Hybrid) Salary: Up to £75,000 + Benefits Are you an engineer who loves working with Databricks? Do you get excited by writing production-grade code to build, scale, and solve complex data platform challenges? I'm hiring for a global leader in the digital communications space. Their high … insights. What You'll Actually Do: Design & Build Data Pipelines: Take full ownership of designing, building, and managing the full lifecycle of complex data pipelines using Azure Data Factory, Databricks (Python/PySpark), and advanced SQL. Productionise Databricks: Lead the development of robust, scalable solutions on Databricks. This is role focused on production code, Delta Lake, Structured Streaming, and Spark … support analytical workloads, ensuring data is optimised for BI and reporting. Manage Data Infrastructure: Configure and optimize the underlying data infrastructure from a data engineering lens. This includes managing Databricks clusters, Spark configurations, and ADLS Gen2 storage to ensure high performance and cost-efficiency. Partner Across the Business: Partner with Data Analysts, Product Managers, and business leaders to translate requirements More ❯
of a new General Ledger system to Finance functions across their EMEA entities. The main focus will be in Finance Data & Processing Architecture including the roll out of Azure Databricks Lake House and Oracle Cloud platforms supplemented with process orchestration, workflow and microservices. This is a newly created highly visible role, on a greenfield programme. A brilliant opportunity! The following More ❯
City of London, London, United Kingdom Hybrid/Remote Options
Hunter Bond
of a new General Ledger system to Finance functions across their EMEA entities. The main focus will be in Finance Data & Processing Architecture including the roll out of Azure Databricks Lake House and Oracle Cloud platforms supplemented with process orchestration, workflow and microservices. This is a newly created highly visible role, on a greenfield programme. A brilliant opportunity! The following More ❯
the delivery of strategic IT solutions to Finance functions across their EMEA entities. The main focus will be in Finance Data & Processing Architecture including the roll out of Azure Databricks Lake House and Oracle Cloud platforms supplemented with process orchestration, workflow and microservices. This is a newly created highly visible role. A brilliant opportunity! The following skills/experience is More ❯
London, South East, England, United Kingdom Hybrid/Remote Options
Huxley
as ongoing troubleshooting issues Technically the focus is SQL Server, TSQL, SSIS SSAS And for the Future, they are creating a new roadmap with new technologies including python and databricks in 2027 This is a new opportunity and will be shortlisting over the next week For more information and the chance to be considered, please do send through a CV More ❯
City of London, London, United Kingdom Hybrid/Remote Options
Huxley Associates
as ongoing troubleshooting issues Technically the focus is SQL Server, TSQL, SSIS SSAS And for the Future, they are creating a new roadmap with new technologies including python and databricks in 2027 This is a new opportunity and will be shortlisting over the next week For more information and the chance to be considered, please do send through a CV More ❯
flows, lifecycle, and integration across platforms Experience Required Proven experience in designing modern data platforms Strong understanding of data governance, cataloguing, and data lifecycle Experience with cloud data platforms (Databricks or Snowflake) Familiarity with AI/ML driven data processing would be highly beneficial. This is a primarily remote role, requiring very infrequent travel across Europe to the client's More ❯
prioritise and deliver value What We're Looking For 10+ years of Agile/Scrum delivery experience in banking or financial services Strong understanding of data platforms, ideally with Databricks, Data Lakehouse, or Medallion Architecture Experience working with Finance data/reporting in a corporate or investment banking context Excellent stakeholder management and communication skills Confident using JIRA and leading More ❯
London, South East, England, United Kingdom Hybrid/Remote Options
Huxley
prioritise and deliver value What We're Looking For 10+ years of Agile/Scrum delivery experience in banking or financial services Strong understanding of data platforms, ideally with Databricks, Data Lakehouse, or Medallion Architecture Experience working with Finance data/reporting in a corporate or investment banking context Excellent stakeholder management and communication skills Confident using JIRA and leading More ❯
City of London, London, United Kingdom Hybrid/Remote Options
Huxley Associates
prioritise and deliver value What We're Looking For 10+ years of Agile/Scrum delivery experience in banking or financial services Strong understanding of data platforms, ideally with Databricks, Data Lakehouse, or Medallion Architecture Experience working with Finance data/reporting in a corporate or investment banking context Excellent stakeholder management and communication skills Confident using JIRA and leading More ❯
Chesterfield, Derbyshire, East Midlands, United Kingdom Hybrid/Remote Options
Brightwell
Oversee the delivery of business-as-usual (BAU) reporting, ensuring accuracy, timeliness, and stakeholder satisfaction. Drive efficiency through automation and process improvement using tools such as SQL, Python, and Databricks, with a focus on building scalable, future-proof systems. Collaborate with stakeholders to understand challenges and identify opportunities where data can deliver value. Design and implement data-driven solutions and More ❯
hiring for Technical Data Architect location: Central London Type : Permanent Hybrid role (2-3 days from client location) We are seeking a highly skilled TechnicalData Architect- with expertise in Databricks, PySpark, and modern data engineering practices. The ideal candidate will lead the design, development, and optimization of scalable data pipelines, while ensuring data accuracy, consistency, and performance across the enterprise … consistency, row counts, and KPIs during migration and transformation. Collaborate with Data engineer , BI Engineers, and Security teams to define data standards, governance, and compliance. Optimize Spark jobs and Databricks clusters for performance and cost efficiency. Support real-time and batch data processing for downstream systems (e.g., BI tools, APIs, reporting consumers). Mentor junior engineers, conduct code reviews, and … engineering, cloud platforms, and analytics. ________________________________________ Required Skills & Qualifications 10-12 years of experience in data engineering, with at least 3+ years in a technical lead role. Strong expertise in Databricks , PySpark , and Delta Lake . DBT Advanced proficiency in SQL, ETL/ELT pipelines, and data modelling. Experience with Azure Data Services (ADLS, ADF, Synapse) or other major cloud platforms More ❯
London, South East, England, United Kingdom Hybrid/Remote Options
Involved Solutions
data-driven decision-making. Responsibilities for the Senior Data Engineer: Design, build, and maintain scalable data pipelines and architectures, ensuring reliability, performance, and best-in-class engineering standards Leverage Databricks, Spark, and modern cloud platforms (Azure/AWS) to deliver clean, high-quality data for analytics and operational insights Lead by example on engineering excellence, mentoring junior engineers and driving … protection of customer data Continuously improve existing systems, introducing new technologies and methodologies that enhance efficiency, scalability, and cost optimisation Essential Skills for the Senior Data Engineer: Proficient with Databricks and Apache Spark, including performance tuning and advanced concepts such as Delta Lake and streaming Strong programming skills in Python with experience in software engineering principles, version control, unit testing … Understanding of machine learning model enablement and operationalisation within data architectures Experience working within Agile delivery environments If you are an experienced Senior Data Engineer with strong expertise in Databricks , Azure , and data architecture design , looking for a hands-on role where you can influence technical direction and drive meaningful change, please apply in the immediate instance. Data Engineer, Senior More ❯
Kent, England, United Kingdom Hybrid/Remote Options
Harnham
delivery best practices. Designing, developing, and optimising data pipelines, integration frameworks, and ETL processes in Azure. Building and maintaining scalable solutions using Azure Data Lake, Synapse, Data Factory, and Databricks . Establishing robust data governance, quality, and lineage frameworks across all environments. Collaborating closely with data architecture, analytics, and IT to ensure a seamless transition and platform stability. Managing delivery … we’re looking for: Proven track record leading data engineering teams through large-scale transformations. Strong, hands-on understanding of Azure data services — e.g. Synapse, Data Factory, Data Lake, Databricks, Purview . Direct experience migrating from on-premise environments to Azure , ideally within a regulated or financial services context. Deep technical knowledge of data architecture, ETL/ELT, and data More ❯
Kent, England, United Kingdom Hybrid/Remote Options
Harnham - Data & Analytics Recruitment
delivery best practices. Designing, developing, and optimising data pipelines, integration frameworks, and ETL processes in Azure. Building and maintaining scalable solutions using Azure Data Lake, Synapse, Data Factory, and Databricks . Establishing robust data governance, quality, and lineage frameworks across all environments. Collaborating closely with data architecture, analytics, and IT to ensure a seamless transition and platform stability. Managing delivery … we're looking for: Proven track record leading data engineering teams through large-scale transformations. Strong, hands-on understanding of Azure data services - e.g. Synapse, Data Factory, Data Lake, Databricks, Purview . Direct experience migrating from on-premise environments to Azure , ideally within a regulated or financial services context. Deep technical knowledge of data architecture, ETL/ELT, and data More ❯
Senior Data Engineer in Databricks - Lead the Future of Data in Financial Services Location: Hybrid 2-3 days/week on site Offices: South East and North West Salary: Up to 80,000 + Car Allowance + Bonus + Benefits Note: Visa sponsorship is not available for this role. Be the Technical Leader in a Bold Data Transformation Our client … agile environments and wants to make a real impact. Key Responsibilities Lead and mentor two Data Engineers, providing technical guidance and coaching. Design and deploy modern data pipelines using Databricks and Azure. Transform unstructured external data into clean, business-ready models. Build semantic layers and embed Unity Catalog for robust data governance. Guide the team in taking Databricks from development … production. Support Terraform adoption and infrastructure-as-code practices. Why This Role Stands Out Leadership and impact: Influence technical direction, team culture, and delivery standards. Modern tech stack: Azure, Databricks, Unity Catalog, SQL, Python, Terraform. Attractive package: Up to 80k base + car allowance + bonus + benefits. Hybrid working: Offices across the South East and North West, with More ❯
South East, England, United Kingdom Hybrid/Remote Options
Akkodis
Senior Data Engineer in Databricks - Lead the Future of Data in Financial Services Location: Hybrid | 2-3 days/week on site Offices: South East and North West Salary: Up to £80,000 + Car Allowance + Bonus + Benefits Note: Visa sponsorship is not available for this role. Be the Technical Leader in a Bold Data Transformation Our client … agile environments and wants to make a real impact. Key Responsibilities Lead and mentor two Data Engineers, providing technical guidance and coaching. Design and deploy modern data pipelines using Databricks and Azure. Transform unstructured external data into clean, business-ready models. Build semantic layers and embed Unity Catalog for robust data governance. Guide the team in taking Databricks from development … production. Support Terraform adoption and infrastructure-as-code practices. Why This Role Stands Out Leadership and impact: Influence technical direction, team culture, and delivery standards. Modern tech stack: Azure, Databricks, Unity Catalog, SQL, Python, Terraform. Attractive package: Up to £80k base + car allowance + bonus + benefits. Hybrid working: Offices across the South East and North West, with More ❯