1 to 25 of 54 Data Lake Jobs in Scotland

to technology, delivering bespoke software solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science and AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles, with openings at senior or lead level to suit your experience. You may be … or solving tough engineering challenges. You'd also be expected to spend some time on-site with clients in the London area on an ad-hoc basis. Our data engineers combine a strong software engineering approach with solid data fundamentals and experience with modern tools. We’re technology agnostic, and we’re open minded when it More ❯

in the digital lifecycle and helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited opportunities digital offers. Our reputation … Backed by Goldman Sachs Asset Management and Everstone Capital, Apexon now has a global presence of 15 offices (and 10 delivery centers) across four continents. Job Title: Lead Data Engineer with Azure Experience Location: Sunderland, UK About the Role: We are currently looking for a Lead Data Engineer to manage teams on client projects. Your Profile … applications using Azure, specifically a Data Warehouse and/or Data Lake. Technologies : Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, Azure Databricks and Power BI. Experience with creating low-level designs for data platform implementations. ETL pipeline development for the integration with data sources and More ❯

We are Dufrain, a pure-play data consultancy specialising in helping businesses unlock the true value of their data by providing market-leading data solutions and services which includes developing strategies for AI readiness, improving data literacy and culture, enhancing real-time reporting, and managing data from mergers and acquisitions. … At Dufrain, we pride ourselves on a creative and innovative approach, focusing on delivering exceptional outcomes for clients by leveraging data to drive growth and efficiency. Our mission is to inspire, shape and deliver the data capabilities of tomorrow. We have great opportunities for Data Engineers to play a pivotal role in supporting clients … as they navigate the complexities of data management, analytics, and strategy. Our Data Engineers Possess a broad range of data engineering skills, with a focus on Microsoft Azure, although experience with other cloud platforms is also desirable. Develop good working relationships with clients on a project including interpersonal skills with both business and technical More ❯

with 5 years or more experience and have a strong working knowledge of PySpark, Azure Data Bricks, Azure Data Factory and Azure Data Lake Storage. Ideally you will be based in Aberdeen or within a commutable distance of Aberdeen as the role cannot be worked remotely. Experience required: Proven competency working with data … flows) is essential for Senior Data Engineer. Working knowledge of PySpark is essential for Senior Data Engineer Capability working with Azure Data Lake Storag e is essential for Senior Data Engineer Working knowledge of medallion data lakehouse architecture is essential for Senior Data Engineer Strong background … and utility of datasets and systems to then analyse, model and organise data from their respective source data systems into the medallion data lake for further use in reporting. Ensure data quality and data reliability: Drive improvements in data quality assessments, and ensure that data More ❯

The Role As a Core Data Engineer, you will play a pivotal role in designing, building, and optimising data pipelines, architectures, and workflows for our diverse client base. You'll work within dynamic, multi-disciplinary project teams to implement scalable data solutions while adhering to best practices and emerging trends in data engineering. This is an exciting and valuable opportunity for an enthusiastic, earlier-stage data engineer to advance their career across a variety of commercial sectors. At Optima, you'll work within cross-functional teams, collaborating with experts in different fields and gaining exposure to varied business challenges. Optima provides an inclusive space for professional development, with … a focus on continuous learning and knowledge sharing. Engineering at Optima is a fast-growing team with strong partnerships in the wider data science community. With the chance to work alongside seasoned engineers, scientists, data architects, and product specialists, you'll be contributing to our collective effort to stay at the forefront of a fast-paced More ❯

Join to apply for the Core Data Engineer role at Optima Partners Join to apply for the Core Data Engineer role at Optima Partners The Role As a Core Data Engineer, you will play a pivotal role in designing, building, and optimising data pipelines, architectures, and workflows for our diverse client base. … You’ll work within dynamic, multi-disciplinary project teams to implement scalable data solutions while adhering to best practices and emerging trends in data engineering. The Role As a Core Data Engineer, you will play a pivotal role in designing, building, and optimising data pipelines, architectures, and workflows for our diverse client … base. You’ll work within dynamic, multi-disciplinary project teams to implement scalable data solutions while adhering to best practices and emerging trends in data engineering. This is an exciting and valuable opportunity for an enthusiastic, earlier-stage data engineer to advance their career across a variety of commercial sectors. At Optima, you’ll More ❯

Description As a Data Solutions Architect you'll work closely with key stakeholders to map out their data/insights requirements and develop roadmaps and design architecture which you'll communicate effectively to the project teams, implementation teams and end-users - leading top quality solutions design and delivery. Requirements Strong experience as a Cloud data … more of the following architectural frameworks (TOGAF, ZACHMAN, FEAF) Cloud Experience: AWS or GCP preferred, particularly around migrations and cloud architecture Good technical knowledge and understanding of big data frameworks like Hadoop, Cloudera etc. Deep technical knowledge of database development, design and migration Experience of deployment in cloud using Terraform or CloudFormation Automation or Scripting experience using languages … achieve target states successfully. Familiar with common architectural patterns and able to define and customise them for different use cases. Develop data models and Data Lake designs around stated use cases to capture KPIs and data transformations. Identify relevant AWS services - on Amazon EMR, Redshift, Athena, Glue, Lambda, to design an architecture that More ❯

the first 25 applicants Get AI-powered advice on this job and more exclusive features. Direct message the job poster from SR2 | Socially Responsible Recruitment | Certified B Corporation Data Engineering Recruitment Consultant @ SR2 | Certified B Corporation Lead Data Engineer Lead Data Engineer Salary: £85,000–£90,000 +Up to 10% Bonus + 15% Non … you’ll be doing: Leading the design, build, and optimisation of robust data pipelines and platforms Enhancing and scaling existing Data Warehouse, Data Lake, and BI systems Driving end-to-end delivery across ingestion, modelling, transformation, and governance Collaborating with architects, technical leads, and business stakeholders across functions Driving a culture of data … across both technical and business domains. Key technical skills: Strong SQL and ELT/data pipeline development experience Expertise in Data Warehouse & Data Lake design (including Star Schema, Snowflake Schema, Data Vault) Hands-on experience with enterprise databases: Oracle, Snowflake, Teradata, or SQL Server Solid understanding of AWS (S3, Lambda, IAM More ❯

Data Engineer - Near Edinburgh (Hybrid) - 60-70K DOE *** Near Edinburgh - 3 days per week in office, 2 days WFH Lorien’s long-standing, successful (and growing) client, with offices very commutable from Central Edinburgh and the surrounding, is looking to recruit a Data Engineer to join their technical function in a brand-new role for … You’ll Be Doing: Design and develop Data Solutions, Pipelines and ETL Processes using tools such as Azure Data Factory/Azure Data Lake/Azure SQL/SSIS and other relevant offerings Build and tailor Data Models and Data Warehouses Work with other Data personnel such … background as a Data Engineer with skills across as many of the following Microsoft tooling as possible including Azure Data Factory, Azure Data Lake, Azure SQL, Azure Synapse Analytics, SQL Server/SSIS/T-SQL Strong skills across Data Modelling, Warehousing and ETL processes Skills in Business Intelligence tooling such More ❯

your own stamp to what we are doing. What will your role look like? In this role you will work on a modern tech stack, tackling software and data challenges that drive our business forward. You will be instrumental in designing and delivering robust, scalable solutions within an agile, DevOps … driven environment, using the latest Microsoft and Azure technologies. Your initial focus will be on collaborating closely with a Technical Architect to develop a cutting-edge data lake for HRPW, forming the foundation for custom AI solutions that will drive team efficiencies. Though this is a very varied role, your key responsibilities will include: Collaborating with our … which will emerge in the delivery of our software system. Leading non-functional improvement efforts (such as security and performance profiling). Liaising closely with the company’s data engineering expert group which aims to keep abreast of the latest developments in Azure data tooling, promoting best practice and guidance to the wider business. If you More ❯

Lead Data Engineer Salary: £85,000–£90,000 + Up to 10% Bonus + 15% Non - Contributory Pension Location: Hybrid working (3 days P/W On-Site) | Edinburgh Level: Lead We’re looking for a Lead Data Engineer to play a key role in expanding our client's data-driven capabilities and driving … you’ll be doing: Leading the design, build, and optimisation of robust data pipelines and platforms Enhancing and scaling existing Data Warehouse, Data Lake, and BI systems Driving end-to-end delivery across ingestion, modelling, transformation, and governance Collaborating with architects, technical leads, and business stakeholders across functions Driving a culture of data … across both technical and business domains. ✅ Key technical skills: Strong SQL and ELT/data pipeline development experience Expertise in Data Warehouse & Data Lake design (including Star Schema, Snowflake Schema, Data Vault) Hands-on experience with enterprise databases: Oracle, Snowflake, Teradata, or SQL Server Solid understanding of AWS (S3, Lambda, IAM More ❯

Data Engineering Consultant (all levels) We’re working with a globally recognised consultancy that delivers cutting-edge digital, data, and analytics solutions to some of the most complex infrastructure projects across the UK and beyond. With a strong commitment to technical excellence, inclusion, and client impact, they partner with high-profile organisations to help them unlock … the full potential of their data assets. Due to continued growth and demand for their data services, they are expanding their specialist engineering team and seeking talented Data Engineering Consultants at various seniority levels — from experienced engineers to those ready to step into leadership roles. The Role As a Data Engineering Consultant … and contribute to internal knowledge repositories and best practice libraries Key Skills & Experience Strong hands-on experience with Azure tooling, including: Databricks, Data Factory, Data Lake, and Synapse (or similar data warehouse tools) Azure Analysis Services or comparable BI tooling Solid programming capability in: SQL, Python, Spark, and ideally DAX Familiarity with CI More ❯

expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and AWS tech stack. Qualifications We are looking for a skilled Lead Data … pipeline/ELT development, including performance tuning Very good SQL skills Past experience and solid understanding of end to end Data Warehouse, Data Lake and BI design and delivery at scale (high level and detailed) and various architectural strategies Solid information architecture skills/experience: Data ingestions, and Data Warehouse and Date Lake modelling experience (Star Schema, Snowflake Schema, Data Vault etc.) Past hands-on development experience in at least one enterprise analytics database like Oracle/Terradata/SQL Server/Snowflake Understanding of AWS cloud and fundamental services like IAM, Lambda, S3 etc. Experience of liaising with both in-house and third More ❯

expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and AWS tech stack. About You We are looking for a skilled Lead Data … pipeline/ELT development, including performance tuning Very good SQL skills Past experience and solid understanding of end to end Data Warehouse, Data Lake and BI design and delivery at scale (high level and detailed) and various architectural strategies Solid information architecture skills/experience: Data ingestions, and Data Warehouse and Date Lake modelling experience (Star Schema, Snowflake Schema, Data Vault etc.) Past hands-on development experience in at least one enterprise analytics database like Oracle/Terradata/SQL Server/Snowflake Understanding of AWS cloud and fundamental services like IAM, Lambda, S3 etc. Experience of liaising with both in-house and third More ❯

We are looking for a hands-on, technically driven Data Engineer to join our expanding data team. This role is ideal for someone with a strong foundation in SQL and data management, who has recently graduated from a Data Science or Data Engineering programme and is eager to apply their … skills in a modern, forward-thinking environment. You will be responsible for developing and maintaining robust data solutions that support reporting, automation, and strategic decision-making across the business. The successful candidate will have up-to-date knowledge of data tooling and methodologies, particularly in SQL, Power BI, and data automation, with an interest … Experience with Power Automate for data-driven workflows. Understanding of ETL concepts and processes. Exposure to modern data platforms such as Azure Data Lake, Databricks, or Microsoft Fabric is a bonus. Analytical Skills: Ability to understand complex data structures and derive actionable insights. Strong problem-solving ability with attention to detail. More ❯

We are looking for a hands-on, technically driven Data Engineer to join our expanding data team. This role is ideal for someone with a strong foundation in SQL and data management, who has recently graduated from a Data Science or Data Engineering programme and is eager to apply their … skills in a modern, forward-thinking environment. You will be responsible for developing and maintaining robust data solutions that support reporting, automation, and strategic decision-making across the business. The successful candidate will have up-to-date knowledge of data tooling and methodologies, particularly in SQL, Power BI, and data automation, with an interest … Experience with Power Automate for data-driven workflows. Understanding of ETL concepts and processes. Exposure to modern data platforms such as Azure Data Lake, Databricks, or Microsoft Fabric is a bonus. Analytical Skills: Ability to understand complex data structures and derive actionable insights. Strong problem-solving ability with attention to detail. More ❯

Join to apply for the Data Engineer (5 Months Fixed Term Contract) role at Motability Operations Ltd 5 days ago Be among the first 25 applicants Join to apply for the Data Engineer (5 Months Fixed Term Contract) role at Motability Operations Ltd Get AI-powered advice on this job and more exclusive features. The D … and peer review of ETL code in Oracle ODI Working with business users to design and configure self-serve data environments within our snowflake data lake Analysing, developing, delivering, and managing BI reports Assisting in the design of the data processes, including data quality, reconciliation, testing, and governance Contributing to technical … improve interactions with our customers and business partners. This could be data transfer from third parties, ETL into the data warehouse or data lake, providing insights and metrics, or improving performance or processes. This is a dynamic team, with data engineers and analysts working closely alongside members of the business in More ❯

officially designated Posts. Our UK-based staff work in King Charles Street, London, Abercrombie House in East Kilbride and in Milton Keynes. These roles contribute to FCDOs Data Strategy to improve insights to the business by provisioning it with reliable and trustworthy data sources and improving theirdeliveryin a secure manner in compliance with Data regulations. The team is primarily Azure focused but other Cloud technologies such as Oracle andAmazon Web Services (AWS) are usedin FCDO. The successful candidates will build complex data pipelines (both Extract Transform and Load ETL and Extract Load and Transform ELT ) in the Azure cloud platforms. You will work with structured and unstructured data, data lakes, data warehouses to service operational and analytical business needs. The successful candidates will: Work collaboratively with Enterprise Data Colleagues to develop pipelines and data product that aligns with data architecture and engineering best practice. Develop data assets and products that assist Power Business Intelligence (BI) colleagues to More ❯

officially designated Posts. Our UK-based staff work in King Charles Street, London, Abercrombie House in East Kilbride and in Milton Keynes. These roles contribute to FCDOs Data Strategy to improve insights to the business by provisioning it with reliable and trustworthy data sources and improving their delivery in a secure manner in compliance with Data … The team is primarily Azure focused but other Cloud technologies such as Oracle and Amazon Web Services (AWS) are used in FCDO. The successful candidates will build complex data pipelines (both Extract Transform and Load {ETL} and Extract Load and Transform {ELT}) in the Azure cloud platforms. You will work with structured and unstructured data, data lakes, data warehouses to service operational and analytical business needs. Job description The successful candidates will: Work collaboratively with Enterprise Data Colleagues to develop pipelines and data product that aligns with data architecture and engineering best practice. Develop data assets and products that assist Power Business Intelligence (BI More ❯

Description We use innovation to shape data so it works for everyone and we're planning to re-platform and improve the existing (commercial, operational and customer) data assets and develop new ones, as well as transform how we work with the business to use our data better. As our Digital Data … MO products and services. You will be at the forefront of our digital business, leveraging digital channels to better serve our customers. We're looking for a digital data enthusiast, working collaboratively with a variety of stakeholders to ensure alignment with business objectives and customer outcomes. Your support will help the team in managing and evolving our digital … & Analytics Team within MO provides tools and methods for the wider business to garner insights and analysis from our Data Warehouse and Data Lake, playing a key role in providing support to the business in their Data Science, AI, and ML initiatives. Our Data & Analytics technology stack consists primarily More ❯

Software & Data Engineer (Azure/AI Focus) - Edinburgh or Glasgow (Hybrid) - £70k plus benefits Join Us to Shape the Future of Data and AI Are you a forward thinking software and data engineer eager to work with cutting-edge Microsoft technologies? Our client is looking for a passionate and collaborative engineer to join their … to the design and delivery of scalable, secure systems using modern cloud technologies. Your initial focus will be partnering with an architecture team to create a next generation data lake. What You’ll Be Doing: Collaborating with an AI team to design and develop bespoke Copilot applications. Helping to deliver data driven solutions using Azure data … autonomy. Enhancing integrations, automation frameworks, and software maturity. Addressing key non-functional concerns such as system performance and security. Staying ahead of developments in Azure tooling via our data engineering expert group and promoting best practices. Essential skills: Strong experience with Microsoft’s development stack (or similar), Azure cloud tools, and/or MS SQL database technologies. A More ❯

Social network you want to login/join with: Senior Software Engineer (Data/AI), Livingston Client: Change Digital – Digital & Tech Recruitment Location: Livingston, United Kingdom Job Category: Other EU work permit required: Yes Job Views: 6 Posted: 16.06.2025 Expiry Date: 31.07.2025 Job Description: Software & Data Engineer (Azure/AI Focus) - Edinburgh or Glasgow (Hybrid) - £70k … plus benefits Join Us to Shape the Future of Data and AI Are you a forward-thinking software and data engineer eager to work with cutting-edge Microsoft technologies? Our client is looking for a passionate and collaborative engineer to join their team and help build transformative solutions that power business performance. In this role, you … to the design and delivery of scalable, secure systems using modern cloud technologies. Your initial focus will be partnering with an architecture team to create a next-generation data lake. What You’ll Be Doing: Collaborating with an AI team to design and develop bespoke Copilot applications. Helping to deliver data-driven solutions using Azure data More ❯

Social network you want to login/join with: Senior Software Engineer (Data/AI), dunfermline col-narrow-left Client: Change Digital – Digital & Tech Recruitment Location: Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 6 Posted: 16.06.2025 Expiry Date: 31.07.2025 col-wide Job Description: Software & Data Engineer (Azure/AI Focus … Edinburgh or Glasgow (Hybrid) - £70k plus benefits Join Us to Shape the Future of Data and AI Are you a forward thinking software and data engineer eager to work with cutting-edge Microsoft technologies? Our client is looking for a passionate and collaborative engineer to join their team and help build transformative solutions that power business … to the design and delivery of scalable, secure systems using modern cloud technologies. Your initial focus will be partnering with an architecture team to create a next generation data lake. What You’ll Be Doing: Collaborating with an AI team to design and develop bespoke Copilot applications. Helping to deliver data driven solutions using Azure data More ❯

EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Key Responsibilities Lead the technical delivery of complex data engineering projects, ensuring solutions are scalable, secure, and aligned with our delivery framework, and client goals. Design and build high-quality data pipelines and integration workflows, setting … throughout the development lifecycle. Collaborate with multidisciplinary teams, including a wide range of other roles, to shape solutions that meet both technical and business requirements. Mentor and support data engineering teams, fostering a culture of continuous improvement, knowledge sharing, and technical excellence. Support testing activities by ensuring pipelines are testable, observable, and reliable; work with QA and analysts … sense of ownership and accountability. Technologies, Methodologies and Frameworks: Direct delivery experience using cloud-native data services, specifically in Microsoft Azure, Fabric, Dataverse, Synapse, Data Lake, Purview. Deep expertise in data engineering tools and practices, including Python, SQL, and modern ETL/ELT frameworks (e.g., Azure Data Factory, Talend, dbt). More ❯

in the digital lifecycle and helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited opportunities digital offers. Our reputation … improvement. Backed by Goldman Sachs Asset Management and Everstone Capital, Apexon now has a global presence of 15 offices (and 10 delivery centers) across four continents. Job Title: Data Solution Architect Location: Newcastle Upon Tyne/Sunderland, UK The Role: We are looking for a highly skilled Data Solution Architect with deep expertise in designing and … a focus on data platforms and cloud data solutions . Hands-on experience designing data solutions on Azure (e.g., Azure Data Lake, Synapse, Data Factory) and AWS (e.g., Redshift, Glue, S3, Lambda) . Strong background in data architecture , including data modeling, warehousing, real-time and More ❯