4 of 4 Data Pipeline Jobs in Lanarkshire

The Infrastructure Engineer will join our ICT team, who are responsible for the delivery of key technology services across the organisation. This includes our cloud infrastructure, networking, security, data platforms, and end-user services. The role requires both strong technical expertise and business understanding. Are you passionate about building secure, scalable, and connected cloud environments Join us as … Infrastructure Engineer to help strengthen our Azure platforms and ensure our organisation is powered by modern, resilient, and secure technology. You'll work across Azure infrastructure, networking, and data services to design and deliver solutions that connect our systems, protect our data, and enable digital transformation. From securing internal integrations to optimising data pipelines … in Azure Data Factory and Azure SQL, you'll play a critical role in shaping how we use cloud technology to support our mission. This is a hands-on role where your problem-solving skills, technical expertise, and security-first mindset will make a real impact. About You What We're Looking For A hands-on technologist with More ❯

Engineer (AWS) Location: Glasgow Duration: 31/12/2026 Days on site: 2-3 Rate: £402/day on Umbrella Role Description: We are currently migrating our data pipelines from AWS to Databricks, and are seeking a Senior Databricks Engineer to lead and contribute to this transformation. This is a hands-on engineering role focused on designing … building, and optimizing scalable data solutions using the Databricks platform. Key Responsibilities: Lead the migration of existing AWS-based data pipelines to Databricks. Design and implement scalable data engineering solutions using Apache Spark on Databricks. Collaborate with cross-functional teams to understand data requirements and translate them into efficient pipelines. Optimize performance … and cost-efficiency of Databricks workloads. Develop and maintain CI/CD workflows for Databricks using GitLab or similar tools. Ensure data quality and reliability through robust unit testing and validation frameworks. Implement best practices for data governance, security, and access control within Databricks. Provide technical mentorship and guidance to junior engineers. Must-Have Skills: Strong More ❯

Role Title: Sr.Databricks Engineer Location: Glasgow Days on site: 2-3 Pay Rate: £405 per day MUST BE PAYE THROUGH UMBRELLA Role Description: We are currently migrating our data pipelines from AWS to Databricks, and are seeking a Senior Databricks Engineer to lead and contribute to this transformation. This is a hands-on engineering role focused on designing … building, and optimizing scalable data solutions using the Databricks platform. Key Responsibilities: . Lead the migration of existing AWS-based data pipelines to Databricks. . Design and implement scalable data engineering solutions using Apache Spark on Databricks. . Collaborate with cross-functional teams to understand data requirements and translate them into efficient … pipelines. . Optimize performance and cost-efficiency of Databricks workloads. . Develop and maintain CI/CD workflows for Databricks using GitLab or similar tools. . Ensure data quality and reliability through robust unit testing and validation frameworks. . Implement best practices for data governance, security, and access control within Databricks. . Provide technical mentorship and More ❯

Remote 6-month initial contract Start Date: 17th November 2025 £550 per day Inside IR35 We are seeking two SC Cleared Databricks Analysts to support a high-profile data engineering and analytics programme with one of our GovTech Consultancy clients. The successful candidates will play a key role in designing, developing, and optimising data pipelines and More ❯