21 of 21 Data Lake Jobs in Scotland

expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and AWS tech stack. Qualifications We are looking for a skilled Lead Data … pipeline/ELT development, including performance tuning Very good SQL skills Past experience and solid understanding of end to end Data Warehouse, Data Lake and BI design and delivery at scale (high level and detailed) and various architectural strategies Solid information architecture skills/experience: Data ingestions, and Data Warehouse and Date Lake modelling experience (Star Schema, Snowflake Schema, Data Vault etc.) Past hands-on development experience in at least one enterprise analytics database like Oracle/Terradata/SQL Server/Snowflake Understanding of AWS cloud and fundamental services like IAM, Lambda, S3 etc. Experience of liaising with both in-house and third More ❯

Embark on a transformative journey as an Enterprise Data Architect. At Barclays, our vision is clear -To define, direct and govern the bank's target data architecture (inc. shared data environment, data model and standards) in support of business strategy, ensuring that data is accurate, secure and accessible to meet … as an Enterprise Data Architect, you should have experience with: Developing architectural solutions and patterns using latest data engineering approaches, for example data lake, events, API Ability to logically model financial data Excellent written communications skills with experience using structured design languages, for example UML, Archimate or equivalent Some other highly … valued skills may include: Good stakeholder management skills up to C-level execs Understanding of data governance and data management processes and best practice You may be assessed on the key critical skills relevant for success in role, such as risk and controls, change and transformation, business acumen strategic thinking and digital and technology, as well More ❯

Job Description - Data Architect () Data Architect - Job title: Data Architect Location: Filton/Frimley/Portsmouth Broad Oak/Scotstoun. We offer a range of hybrid and flexible working arrangements. Please speak to your recruiter about the options for this particular role Salary: Up to £72,000 depending on skills and experience What you … ll be doing: Design and implementation of the integration layer within the established Enterprise Integration & Data Warehouse (EIDW) platform Design and implementation of effective, robust data solutions Design and maintenance of conceptual, logical and physical data models Delivery and ownership of a Data Architecture strategy that underpins the Naval Ships strategy and … solutions Experience in Master Data Management and Data Governance Hands on experience working in Data Warehouse (normalised/dimensional) or Data Lake programs/projects primarily as a Data Architect or Data Modeller Strong knowledge in conventional data modelling techniques (conceptual/physical/logical More ❯

Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Date: 11 Jul 2025 Company: Royal London Group Job Title: Lead Data Engineer Contract Type: Permanent Location: Edinburgh or Alderley Park Working style: Hybrid 50% home/office based Closing date: 20th August 2025 We are seeking to hire a Lead … Data Engineer to design, develop and operate automated data engineering platforms. This role will contribute to the Group by improving the speed, accuracy, consistency, repeatability, and overall quality of data processing. This reduces costs and enables the Data Automation team to focus on more complex strategic tasks. The Lead Data … processing systems. Has successfully led data platform initiatives. A good understanding of data processing technologies and tools such as Apache Spark, Data Lake, Data Warehousing and SQL Databases. Proficiency in programming languages such as Python and CICD techniques to efficiently deliver change in a consistent, controlled, and high-quality manner More ❯

Content Link Select how often (in days) to receive an alert: Create Alert Competitive salary UK/Glasgow: hybrid working model (2-3 days on site) At NTT DATA, we know that with the right people on board, anything is possible. The quality, integrity, and commitment of our employees are key factors in our company's growth, market … clients stay a step ahead of the competition. By hiring the best people and helping them grow both professionally and personally, we ensure a bright future for NTT DATA and for the people who work here. NTT DATA is currently looking for a Data Engineer for our growing team in the UK. Overview: NTT … DATA is seeking a highly skilled Data Engineer with over 4+ years of experience to join our team to help a strategic banking client in various data transformation activities. Key Responsibilities: Collaborating with cross-functional teams to understand data requirements, and design efficient, scalable, and reliable ETL processes using Python and Databricks More ❯

Join Barclays as a Senior Cloud Data Platform Engineer , where you'll be responsible for building and maintaining systems that collect, store, process, and evaluate data-such as data pipelines, data warehouses, and data lakes-to ensure all data is accurate, accessible, and secure. To be successful in … this role, you should have experience with: Cloud platforms (AWS/Azure) Data Engineering (Airflow/DBT, Spark) DevSecOps practices Additional highly valued skills include: Terraform Python/Java AWS/Azure Data Engineering Snowflake/Databricks You may be assessed on key skills relevant for success in this role, such as risk and controls, change … as well as job-specific technical skills. This role is based in Glasgow. Purpose of the role To build and maintain systems that collect, store, process, and analyze data, such as data pipelines, data warehouses, and data lakes, ensuring data accuracy, accessibility, and security. Accountabilities Build and maintain data More ❯

Embark on a transformative journey with Barclays as a Data Security Lead to play a pivotal role in building and maintaining the secure systems that collect, store, process, and analyse data across our organisation. This includes safeguarding data pipelines, data warehouses, and data lakes-ensuring all information is accurate, accessible … and, above all, secure. As a Data Security Lead, you will collaborate with cross-functional teams to embed security by design into our data infrastructure, enabling advanced analytics and data science use cases-including AI and Machine Learning-without compromising on compliance or control. To be successful as a Data Security Lead … you should have experience with: Proven architecture and control design experience in a data security or cybersecurity context. Strong background as a Cloud technologist with hands-on experience in data science platforms and AI/ML use cases. Demonstrated expertise in implementing security by design principles and conducting threat modelling and translating this into designs mitigations More ❯

Data Engineer (MS/Azure) - Near Edinburgh (Hybrid) Lorien's long-standing, successful (and growing) client, with offices very commutable from Central Edinburgh and the surrounding, is looking to recruit a Data Engineer to join their technical function in a brand-new role for the firm. In return, you'll join a supportive organisation well versed … You'll Be Doing: Design and develop Data Solutions, Pipelines and ETL Processes using tools such as Azure Data Factory/Azure Data Lake/Azure SQL/SSIS and other relevant offerings Build and tailor Data Models and Data Warehouses Work with other Data personnel such … background as a Data Engineer with skills across as many of the following Microsoft tooling as possible including Azure Data Factory, Azure Data Lake, Azure SQL, Azure Synapse Analytics, SQL Server/SSIS/T-SQL Background programming with Python and/or R Strong skills across Data Modelling, Warehousing and More ❯

Data Engineer (MS/Azure) - Near Edinburgh (Hybrid) Lorien's long-standing, successful (and growing) client, with offices very commutable from Central Edinburgh and the surrounding, is looking to recruit a Data Engineer to join their technical function in a brand-new role for the firm. In return, you'll join a supportive organisation well versed … You'll Be Doing: Design and develop Data Solutions, Pipelines and ETL Processes using tools such as Azure Data Factory/Azure Data Lake/Azure SQL/SSIS and other relevant offerings Build and tailor Data Models and Data Warehouses Work with other Data personnel such … background as a Data Engineer with skills across as many of the following Microsoft tooling as possible including Azure Data Factory, Azure Data Lake, Azure SQL, Azure Synapse Analytics, SQL Server/SSIS/T-SQL Background programming with Python and/or R Strong skills across Data Modelling, Warehousing and More ❯

About the role: We're looking for a hands-on Data Engineer to join us on a 12-month max-term contract and play a key role in supporting and scaling our growing data infrastructure. In this role, you'll be responsible for building and maintaining scalable ETL/ELT pipelines using Databricks and modern cloud … to temporarily support our business intelligence needs, developing and maintaining reports and dashboards in ThoughtSpot (or a similar BI platform). You'll collaborate closely with our Lead Data Engineer, who will provide architectural guidance and help drive the strategic direction of our data transformation initiatives. This role is a great fit for a data … best work. Key Responsibilities: Data Engineering Build, maintain, and optimize robust ETL/ELT pipelines using Databricks. Contribute to the design and implementation of data lake and data warehouse architecture. Translate business requirements into reliable and scalable data solutions. Collaborate with the Lead Data Engineer on data More ❯

to Skip to Content Link Select how often (in days) to receive an alert: Date: 5 Aug 2025 Location: Edinburgh, GB Company: Royal London Group Job Title: Senior Data Engineer Contract Type: Permanent Working style: Hybrid 50% home/office based Overview: We have a fantastic opportunity for a Senior Data Engineer to join the Core … Data Engineering team in our Data & AI Office. The successful candidate can be based at our Edinburgh, Glasgow, or Alderley Edge office locations, offering a hybrid working model. This role involves managing data and technical assets to support analytics, data science, and machine learning projects that drive business insights and decision-making. … About the role: The Data Engineers in the Core Data Engineering Team work collaboratively with their peers in the wider team - the Data Modelling and QA Testing teams, to transform raw data into modelled, curated data assets for use by stakeholders in teams performing BI, analytics, and data More ❯

throughout MO, allowing the organisation to maximise on the power of its data. The successful candidate would be: Working in an agile scrum team to design and build data feeds and related applications Writing, testing … and peer review of ETL code in Oracle ODI Working with business users to design and configure self-serve data environments within our snowflake data lake Analysing, developing, delivering, and managing BI reports Assisting in the design of the data processes, including data quality, reconciliation, testing, and governance Contributing to technical … improve interactions with our customers and business partners. This could be data transfer from third parties, ETL into the data warehouse or data lake, providing insights and metrics, or improving performance or processes. This is a dynamic team, with data engineers and analysts working closely alongside members of the business in More ❯

Join Barclays as a Digital Customer Data Engineer, where you'll be leading the development for a new shared data platform that is transforming how individuals/organisations interact with the bank. Your role involves using the latest data and AI engineering skills to deliver a digital capability. As part of our team, you … ll also benefit from being part of a vast professional network, collaborating with industry mentors and experts. To be successful you should have experience with: Modern data engineering practices, inc. event-driven and data lake. Digital platform development, inc. experience developing colleague and customer facing applications. Banking software development. Deep technical awareness of cloud and data technology, such as Kafka, Data Bricks, microservices, API. Some other highly valued skills may include: Technical design: Analysis and documentation of system characteristics, inc. designing solutions to meet multi-faceted non-functional requirements. Communication Skills: Ability to clearly convey project goals to senior leadership, updates, and technical details to stakeholders at all levels, including non-technical More ❯

Join our innovative AI/ML team at Barclays Corporate Bank as a Senior Machine Learning Engineer , where we bridge the gap between cutting-edge data science exploration and real-world business application integration. We manage internal cloud platforms that support exploratory data science work while specialising in transforming conceptual ML models into production-ready applications … decisions and processes. As part of Barclays' strategic AI/ML initiative, our team plays a vital role in establishing the corporate bank as a leader in financial data analytics innovation. We offer the opportunity to work with enterprise-scale data using cloud technologies, implement MLOps best practices, and collaborate with talented data scientists … experience in AWS based Machine Learning technologies (AWS SageMaker, Lambda, S3, EC2). Experience with CI/CD pipelines and Docker containerisation for ML model development/deployment. Data preprocessing and feature engineering expertise. Programming skills in Python and ML frameworks (TensorFlow, Torch, scikit-learn). Statistical analysis and model evaluation capabilities. Previous experience in the banking sector More ❯

field service calls Development Design, develop and deploy cloud-based solutions using Microsoft Azure's suite of services such as Azure Logic Apps, Cosmos DB, Azure Data Lake Develop and test new business rules to support new target areas identified by the team. Implementing data storage solutions, integrating databases, and using Azure data services for efficient data management and analytics Provide innovated methods by which management teams maintain their business objectives Analysts Insights Supporting SeeR team business analysts with data and resulting rule implementations through visualizations. Insights to rule effectiveness as it may pertain to specific customers, countries, regions which may include negative effects from outside influences … weather, power management and/or social factors. Skills and Qualifications: Minimum 1-3 years of experience Bachelor's Degree in a Computing, Science, Engineering discipline. Familiarity with data formats, languages, protocols, and architecture styles required to provide Azure-based integration solutions (for example, Java, .NET, JSON, REST, and SOAP) Experience developing software for an enterprise environment The More ❯

Azure Cognitive Services to address specific business challenges. Implement and maintain scalable and efficient AI systems, ensuring they meet business requirements and performance benchmarks. Collaborate with business analysts, data scientists, and IT teams to integrate AI solutions into existing systems and workflows, enhancing their capabilities and impact. Stay abreast of advancements in AI, machine learning, and Azure services … s AI strategy and innovation efforts. Conduct data analysis and feature engineering to prepare data for use in AI models, utilizing Azure Data Lake Develop robust testing and validation processes to ensure the accuracy and reliability of AI models and solutions. Ensure that operational issues are identified, recorded, monitored and resolved. Align all … with Azure AI solutions, including Azure OpenAI Service, Azure Cognitive Services, and Azure Machine Learning. Familiarity with Azure Databricks is a plus. Solid background in machine learning algorithms, data pre-processing, feature engineering, and model evaluation. Experience with deep learning frameworks like TensorFlow or PyTorch is desirable. Proficiency in handling large datasets, experience with Azure Data More ❯

Data Analyst - PowerBI Developer and MS Fabric Specialist Data Analyst - PowerBI Developer and MS Fabric Specialist Europe United Kingdom Full time Permanent Share Data Analyst - PowerBI Developer and MS Fabric Specialist Aberdeen We are currently recruiting for a talented PowerBI Developer and MS Fabric Specialist to support the delivery of digital data … Solid understanding of Power BI, DAX, Power Query and data modelling best practices Solid understanding of Power BI security models Demonstratable experience with Azure Data Lake, Synapse and MS Fabric Minimum 4 years hands on experience delivering Power BI solutions working across all ecosystems, dataflows, dashboards, performance tuning Proven experience supporting digital system or software … implementation, we drive efficiency and improvement and reduce risk, and help established, and emerging businesses achieve their goals. The Core29 BI Team develop reporting solutions to cultivate a data-oriented culture within an organisation and empower business decision-making at all levels based on quantifiable fact. More ❯

+ a range of benefits to support your finances, wellbeing and family. Working Pattern: Permanent Full Time Flexible First options available The role As a Forecasting Data Scientist, you are responsible for analysing energy forecasting and settlements data to support business decisions. You will - Perform energy forecasting and settlements data analysis, ensuring outputs meet … and deadlines to support informed business and commercial decisions. - Develop and maintain new and/or existing Python-based machine learning models to interrogate large volumes of settlements data to forecast future energy consumption. - Working with a high degree of independence, implement novel solutions or appropriate mitigations as required by changing circumstance or requirement to ensure analysis remains … knowledge of VBA and SQL would also be preferable. - Competent user of specific Azure data related resources (or similar) including: Databricks and Storage Account (Data Lake). - The ability to plan and develop new and existing models or analytical tools with a logical approach to design and maintenance. - Advanced skills when using Microsoft Excel, with More ❯

Select how often (in days) to receive an alert: We are currently looking for a Data Analyst to join our Quality team based in Dunfermline. In this role, you will be leading the way in gathering data from a variety of sources, uncovering trends, and transforming complex information into clear, actionable intelligence. Your insights will help … product performance, drive continuous improvement, and support strategic business moves. ESSENTIAL DUTIES AND RESPONSIBILITIES Responsible for development and maintenance of metrics and reporting with the ability to analyse data and provide relevant information focussing on key messages. Responsible for leading the modernisation of regular reporting from across the business with a primary focus on the Quality team. Responsible … for the creation and implementation of automated processes in data preparation to replace manual processes. Support the business from a data management perspective, ensuring that reports are current alongside the update of any IT infrastructure. Responsible for providing Power BI training and support for business users. Perform monitoring and auditing of data quality and More ❯

Data Analyst (Power BI, Azure) - Near Edinburgh Hybrid Having placed a number of people into their teams ourselves, Lorien's long standing client based near Edinburgh - a leader in their industry with a growing and consistently award-winning product line - have asked us to help them in their searches for a Data Analyst to join their … truly a rewarding opportunity, and everyone in the team feels part of that journey. Here's a snapshot of the duties involved: Developing/maintaining metrics & reporting, analysing data and relaying relevant information collected Modernising the business' reporting processes and implementing automation to reduce manual reliance wherever possible while monitoring, auditing and improving data quality Offering … in the queue, craft relevant solutions and train them on how to use them Collaborate with the wider IT function to ensure reports are in line with necessary data infrastructure in place from Databases to Data Lakes/Factory/and more The kind of skills they're looking for: Strong Power BI skills with the More ❯

Data Analyst (Power BI, Azure) - Near Edinburgh Hybrid Having placed a number of people into their teams ourselves, Lorien's long standing client based near Edinburgh - a leader in their industry with a growing and consistently award-winning product line - have asked us to help them in their searches for a Data Analyst to join their … truly a rewarding opportunity, and everyone in the team feels part of that journey. Here's a snapshot of the duties involved: Developing/maintaining metrics & reporting, analysing data and relaying relevant information collected Modernising the business' reporting processes and implementing automation to reduce manual reliance wherever possible while monitoring, auditing and improving data quality Offering … in the queue, craft relevant solutions and train them on how to use them Collaborate with the wider IT function to ensure reports are in line with necessary data infrastructure in place from Databases to Data Lakes/Factory/and more The kind of skills they're looking for: Strong Power BI skills with the More ❯