1 to 25 of 41 Permanent Data Pipeline Jobs in Scotland

services we help our clients connect and communicate better with their customers. As we continue to grow, we are seeking a talented Martech Data Engineer to join our team, focusing on implementing and optimizing a fully integrated Martech stack for an international client. In this role, you'll … to define and deliver technical solutions that support business goals and enhance decision-making on a global scale. The role: As a Martech Data Engineer, you will play a crucial role in implementing and deploying the client's Martech stack. You'll work closely with their marketing, analytics … -driven insights. Key Responsibilities: Martech Architecture: Develop and manage a scalable data architecture using Azure and Snowflake. Data Pipeline Management: Implement and maintain data ingestion and integration from platforms like HubSpot and Shopify. Client Collaboration: Work within the client project team More ❯

At Victrex, we are dedicated to harnessing the power of data to drive innovation and deliver exceptional value. We are seeking a talented and experienced IT Data Engineering Manager to join our dynamic team and lead our data engineering efforts. As Data Engineering Manager you will beresponsible for leading the data engineering team to design, build, and maintain scalable, high-performance data infrastructure and pipelines. This role ensures the availability, reliability, and security of data systems to support business intelligence, analytics, and data … a dynamic and fast-paced environment. Strong understanding of data architecture, data modelling, ETL/ELT processesand data pipeline development. Competency with cloud platforms (e.g., AWS, Azure, GCP) and big data technologies (e.g., Hadoop, Spark, Kafka etc). Excellent communication and More ❯

roles and also offer work place accommodations to ensure you have what you need to effectively deliver in your role. The Role: Digital Data Lead As a Digital Data Lead, you will be responsible for overseeing the management and optimisation of digital data across … various platforms. You will ensure compliance with consent and regulatory frameworks, develop marketing automation strategies, and manage data pipelines. Your expertise in Adobe Experience Platform or Salesforce Marketing Cloud will be crucial in driving data-driven decision-making and enhancing digital media performance. Key Responsibilities: Lead … management. Marketing Automation: Expert in developing and managing marketing automation strategies to enhance customer engagement and conversion rates is important. Data Pipeline Management: The ability to oversee the creation and optimisation of data pipelines to ensure efficient data flow and integration is More ❯

We are Dufrain, a pure-play data consultancy specialising in helping businesses unlock the true value of their data by providing market-leading data solutions and services which includes developing strategies for AI readiness, improving data literacy and culture, enhancing real-time … reporting, and managing data from mergers and acquisitions. At Dufrain, we pride ourselves on a creative and innovative approach, focusing on delivering exceptional outcomes for clients by leveraging data to drive growth and efficiency. Our mission is to inspire, shape and deliver the data capabilities of tomorrow. We have great opportunities for Data Engineers to play a pivotal role in supporting clients as they navigate the complexities of data management, analytics, and strategy. Our Data Engineers Possess a broad range of data engineering skills More ❯

Data Engineer Location: Glasgow, UK (Hybrid) The opportunity of a lifetime Are you someone who is keen to learn new things? Do you want to take your existing skill set and apply it to a new, growing, in-demand technology? We are currently recruiting experienced IT professionals to … cross-train as Data Engineers, and subsequently place at our client, One of the biggest banks in the Finance Industry. This is an amazing opportunity to join a large Finance organization and create a real impact by becoming part of their unique journey. The Role As a world … leading cloud talent creation expert, we’re committed to helping people just like you become one of the best Data Engineer professionals in the world. If you take this opportunity, you’ll learn everything you need to know to become an expert in Data Engineering, in More ❯

index of the London Stock Exchange. The Position Our roster has an opening with your name on it! We are seeking a Staff Data Engineer to lead the technical design and implementation of our most critical data infrastructure and products. In this senior-level individual contributor … role, you'll be responsible for designing scalable systems, setting data architecture standards, and solving complex technical challenges that power analytics, data science, and business function use cases across the company. You will collaborate closely with engineers, product managers, and business stakeholders to architect data … pipelines and architectures that support enterprise-wide data needs Define standards for data modeling, data product design, and pipeline orchestration using modern tools and cloud-native technologies Collaborate with cross-functional stakeholders to translate business and analytical requirements into end-to-end data More ❯

A highly-successful Data Consultancy are seeking a technical Databricks Architect to design and deliver cutting-edge solutions using Databricks on Azure. This Consultancy are both a Microsoft Partner and a Databricks Partner, and are experts in helping their clients to better manage and uncover the value in … their data. They pride themselves on developing tailor-made data-driven solutions to suit the specific needs of their clients, with a growing client base largely within Financial Services, amongst other industries. In this role, you'll get involved from the early pre-sales stage of client projects … of high-level design skills and hands-on data engineering skills, spanning areas such as data modelling, data pipeline development and optimisation, data governance and documentation, with the ultimate goal of delivering a best-in-class yet cost-effective solution for More ❯

Data Engineer (Consultant/Senior Consultant) £60,000-£65,000+ Benefits London, Manchester, Birmingham Locations Available Looking for your next challenge in Data Engineering ? We’re seeking talented professionals to help businesses unlock the power of their data using cutting-edge technologies. 🔹 Are you … passionate about Azure-based data solutions ? 🔹 Do you have expertise in SQL, Python, and modern data platforms ? 🔹 Want to work on high-impact projects with leading organizations? 💡 What You’ll Do: ✅ Design and deliver data solutions using Fabric, Azure Data Factory, and … team 🎯 What We’re Looking For: ✔️ Strong data engineering experience in Azure ✔️ Hands-on expertise in SQL, Python , and data pipeline development ✔️ Familiarity with Agile, DevOps, Git, APIs, and Cloud Data Platforms ✔️ A team player with problem-solving skills and a consulting mindset More ❯

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the More ❯

and towards a sustainable future for the world. We're looking for a highly skilled AI Developer with expertise in .NET, C#, Python, Data Science, and Data Engineering. This role requires hands-on experience in AI solution integration, API development, data processing, and cloud … based data pipelines. A deep understanding of Microsoft's Semantic Kernel and enterprise-grade AI-powered application development is essential. The ideal candidate thrives in a collaborative environment, demonstrating strong problem-solving, communication, and teamwork skills to drive innovation and deliver cutting-edge AI solutions. Why Aggreko? Here … are some of the perks and rewards. Work on cutting-edge AI and data-driven applications. Be part of an innovative and collaborative new team. Gain continuous learning and career growth opportunities. Competitive compensation and benefits package. What you'll do: AI & Software Development: Design and maintain AI More ❯

have big plans to continue growing the business, our products, our technology, and our people. About the role We're looking for a Data Engineer with 3-5 years of experience in SQL and data engineering to join our collaborative team and work on high-impact … projects in a fast-paced environment. The role will primarily focus on building and maintaining data pipelines in DBT using SQL, with opportunities to get hands-on experience with Dagster, Synq, AWS, and Python. Key responsibilities Develop and maintain SQL-based data solutions (PostgreSQL/MySQL … . Work with DBT for data transformation and modeling. Support the scheduling and execution of data pipelines using Dagster. Assist in managing and optimizing AWS-lambda based data infrastructure. Collaborate with the team to identify opportunities to improve the overall data architecture More ❯

Data Engineer (Azure) - Outside IR35 - 3 Months+ - Remote/Glasgow We're currently looking for an experienced Data Engineer to join a Glasgow-based organisation going through a significant transformation. As the organisation looks to mature their data capabilities, this role will be pivotal … in building out their data infrastructure, specifically focusing on designing and developing scalable data pipelines. The data to be ingested will vary; however, a focus will be placed initially on the company's analytics platforms and the company's CRM, so experience here would … be advantageous. Desired Skills Designing and building robust data pipelines for scalable data processing Developing and maintaining ETL workflows to support analytics and reporting Hands-on with Azure ecosystem: Data Factory, Databricks, and Synapse Analytics Experience working with data warehousing solutions and More ❯

Job Title: Data Engineer Location: Aberdeen (Hybrid 3 days on-site) Salary: £55,000 – 65,000 About Us: Join a dynamic and innovative team at one of the top oil and gas firms in Aberdeen. We are committed to leveraging cutting-edge technology to drive efficiency and sustainability … in the energy sector. Job Description: We are seeking a skilled Data Engineer to join our team. The ideal candidate will have a strong background in data management, analytics, and engineering, with a passion for solving complex problems and optimising data processes. Key Responsibilities … Design, develop, and maintain data pipelines and architectures. Collaborate with cross-functional teams to understand data requirements and deliver solutions. Implement data integration and transformation processes. Ensure data quality and integrity across various platforms. Optimize data storage and retrieval systems More ❯

Description As a Data Solutions Architect you'll work closely with key stakeholders to map out their data/insights requirements and develop roadmaps and design architecture which you'll communicate effectively to the project teams, implementation teams and end-users - leading top quality solutions design … and delivery. Requirements Strong experience as a Cloud data architect Skilled in one or more of the following architectural frameworks (TOGAF, ZACHMAN, FEAF) Cloud Experience: AWS or GCP preferred, particularly around migrations and cloud architecture Good technical knowledge and understanding of big data frameworks like Hadoop … experience using languages such as Python & Bash etc. ETL and workflow management knowledge Experience of Agile methodologies Experience in the Financial Services Sector Data Engineering or Data Science experience Job responsibilities Interface with client project sponsors to gather, assess and interpret client needs and requirements. Define More ❯

based on experience) Why Join Us? At the City of Stirling, we're not just embracing digitaltransformation - we're leading it. Asa Cloud Data Specialist , you'll be atthe forefront of revolutionising how we manage and use data todrive smarter decisions and better outcomes for our … ll Do Join our forward-thinking Corporate InformationServices team and take the lead on cloud dataintegration and transformation projects. You'll: Modernise our data landscape by migratingon-premises warehouses to MicrosoftFabric using Medallionarchitecture and Common Data Models(CDM) . Build scalable, secure data pipelinesusing … Azureservices , APIs ,and Event Hubs for real-time andbatch processing. Ensure quality through robust cleansing,monitoring, and compliance with data governance and securitystandards. Collaborate with stakeholders to translatebusiness needs into technical solutions and integratethird-party systems. Empower users with intuitive data accesslayers and self-service analytics More ❯

growing tech team working on an exciting new platform. This is an opportunity to work with cutting-edge search technologies and large-scale data processing while contributing to a product that makes a real impact. Your Role As a Senior Java Developer, you’ll play a key role … in designing, building, and maintaining a robust data platform that powers our core products. You’ll collaborate with cross-functional teams to create highly performant and scalable solutions. Key Responsibilities: Deliver high-quality, well-structured code using Agile and TDD practices Develop new features across the full stack … front-end to Java-based backend services Build and optimize search solutions using technologies like Apache Lucene, Solr, or OpenSearch Design and implement data pipelines in collaboration with Data Engineers Work with cloud technologies (Azure, AWS, or GCP) for scalable data processing Conduct code More ❯

CDS Developer/Data Engineer – Training & Deployment with a Global Financial Leader 📍 Location: Glasgow (Hybrid) 💰 Salary: £30,000–£35,000 (dependent on experience) 📅 Start Date: Summer 2025 🏢 Employment Type: Full-time, Permanent (with Revolent) Are you a Developer or Data Engineer looking to take your career … to the next level? Want to gain specialist skills in enterprise data systems while working with one of the world’s leading financial institutions? We’re offering an incredible opportunity to cross-train in Corporate Data Services (CDS) and gain hands-on experience at Barclays , building … a future-proof career in data-driven development. 💡 What is CDS? Corporate Data Services (CDS) is the engine room of enterprise data. It’s where developers and engineers collaborate to build robust systems that manage, process, and deliver business-critical data across the organisation. More ❯

CDS Developer/Data Engineer – Training & Deployment with a Global Financial Leader 📍 Location: Glasgow (Hybrid) 💰 Salary: £30,000–£35,000 (dependent on experience) 📅 Start Date: Summer 2025 🏢 Employment Type: Full-time, Permanent (with Revolent) Are you a Developer or Data Engineer looking to take your career … to the next level? Want to gain specialist skills in enterprise data systems while working with one of the world’s leading financial institutions? We’re offering an incredible opportunity to cross-train in Corporate Data Services (CDS) and gain hands-on experience at Barclays , building … a future-proof career in data-driven development. 💡 What is CDS? Corporate Data Services (CDS) is the engine room of enterprise data. It’s where developers and engineers collaborate to build robust systems that manage, process, and deliver business-critical data across the organisation. More ❯

An esteemed Data Consultancy are seeking a number of ambitious Databricks Data Engineers to join their team. They are both a Microsoft Partner and a Databricks Partner, and are experts in helping their clients to better manage and uncover the value in their data. They pride … themselves on developing tailor-made data-driven solutions to suit the specific needs of their clients, with a growing client base largely within Financial Services, amongst other industries. In this role, you will be working in a team of highly skilled professionals to deliver effective market-leading data solutions using the latest cutting-edge technologies. This particular role will focus on leveraging the Databricks Data Intelligence platform, and Azure Data Platform technologies. You will split your time between client-site, home and the Edinburgh office depending on requirements, and are asked to More ❯

Wood Mackenzie is the global data and analytics business for the renewables, energy, and natural resources industries. Enhanced by technology. Enriched by human intelligence. In an ever-changing world, companies and governments need reliable and actionable insight to lead the transition to a sustainable future. That's why … the heart of our decisions Future Focused - we accelerate change Curious - we turn knowledge into action Job Description We are looking for a Data Analyst to join Wood Mackenzie's Power and Renewables Data team. This role will focus on the analysis, programmatic acquisition, and preparation … of data for delivery to our customers and research teams. Wood Mackenzie produces research and data that the energy industry relies on to understand and navigate the energy transition. Examples of products that you will contribute to include: Power supply and demand long-term outlooks Power More ❯

examples to give you a flavour of what you will do: Identify and define technical tasks from project requirements Implement machine learning models, data pipelines, and integrations with Storm's product suite Investigate new AI approaches, frameworks, and best practices for application in public sector contexts Work closely More ❯

Data Engineer Remote (to +/- 2 hrs of UK Time Zone) We are looking for the right expertise and £ is negotiable Are you a skilled Data Engineer with a passion for financial markets? We're working with a pioneering tech-driven company building innovative financial … data solutions. This is an exciting opportunity to join a collaborative and forward-thinking engineering team working on a cutting-edge data platform for financial datasets. Youll help shape how complex market data is processed, structured, and made accessible for analytics, research, and insight … generation. What youll be doing: Designing and maintaining data pipelines Working with time-series and structured/unstructured datasets Applying your industry know-how within financial data to ensure continual product development Tech youll work with: Functional programming i.e. Ruby, Python, Elixir PostgreSQL OpenAPI integrations Various More ❯

Data Engineer – Remote (to +/- 2 hrs of UK Time Zone) We are looking for the right expertise and £ is negotiable Are you a skilled Data Engineer with a passion for financial markets? We're working with a pioneering tech-driven company building innovative financial … data solutions. This is an exciting opportunity to join a collaborative and forward-thinking engineering team working on a cutting-edge data platform for financial datasets. You’ll help shape how complex market data is processed, structured, and made accessible for analytics, research, and … insight generation. What you’ll be doing: Designing and maintaining data pipelines Working with time-series and structured/unstructured datasets Applying your industry know-how within financial data to ensure continual product development Tech you’ll work with: Functional programming i.e. Ruby, Python, Elixir PostgreSQL More ❯

growing tech team working on an exciting new platform. This is an opportunity to work with cutting-edge search technologies and large-scale data processing while contributing to a product that makes a real impact. Your Role As a Senior Java Developer, you'll play a key role … in designing, building, and maintaining a robust data platform that powers our core products. You'll collaborate with cross-functional teams to create highly performant and scalable solutions. Key Responsibilities: Deliver high-quality, well-structured code using Agile and TDD practices Develop new features across the full stack … front-end to Java-based backend services Build and optimize search solutions using technologies like Apache Lucene, Solr, or OpenSearch Design and implement data pipelines in collaboration with Data Engineers Work with cloud technologies (Azure, AWS, or GCP) for scalable data processing Conduct code More ❯

will be responsible for the seamless deployment, monitoring, and maintenance of machine learning models in production. Acting as the critical link between the data science and R&D teams, this team will ensure that ML models transition smoothly from development to production, maintaining high availability, scalability, and performance. … to ensure reliability and efficiency. Continuously improving the architecture, processes, and tools used for model deployment, monitoring, and lifecycle management. Collaborating closely with data scientists to understand and implement model requirements. Partnering with R&D teams to align technical strategies and integrate ML solutions into broader systems. Implementing … cloud environments. Proficiency with containerization and orchestration tools (Docker, Kubernetes). Experience with version control systems and CI/CD pipelines. Knowledge of data engineering concepts (e.g., ETL, data pipelines). Ability to troubleshoot complex production systems. Strong communication and collaboration skills. More ❯