1 to 25 of 52 Data Lake Jobs in Scotland

based out of Milton Keynes or Glasgow. In this role, you will be responsible for engineering, operating, and evolving the AWS data lake platform, including the cloud infrastructure, shared services, and data engineering applications that sit on top of it. You will work closely with … focused on building and running cloud platforms rather than line management. The difference you’ll make: Engineering and operating the AWS data lake infrastructure, ensuring high availability, resilience, performance, and security Designing, building, and maintaining Infrastructure as Code (IaC) for AWS environments, shared services, and data ...

properly articulated, understood, and realized as secure and robust solutions.Design and assess end-to-end solution architectures for enterprise-scale platforms, including data modeling, meta-modeling, master and reference data management, data quality, metadata management, data taxonomy, data integration … modeling (such as UML) or tools such as ERwin, Power Designer, or MagicDraw.Knowledge of data architecture options including ODS, Data Lake, Data Catalog (DCAT), Data Warehousing, OLTP, and OLAP, and the treatment of data as a technology asset.Knowledge ...

properly articulated, understood, and realized as secure and robust solutions. Design and assess end-to-end solution architectures for enterprise-scale platforms, including data modeling, meta-modeling, master and reference data management, data quality, metadata management, data taxonomy, data integration … such as UML) or tools such as ERwin, Power Designer, or MagicDraw. Knowledge of data architecture options including ODS, Data Lake, Data Catalog (DCAT), Data Warehousing, OLTP, and OLAP, and the treatment of data as a technology asset. Knowledge ...

Data Engineer Permanent - £50k - £60k Glasgow area - approx. 2 days a month onsite We're looking for an experienced Data Engineer to join a growing Data Team within a global organisation and play a key role in the development of its next-generation data … hear from you. Experience of Microsoft Azure would also be highly advantageous, particularly: Azure Data Factory Azure SQL Azure Data Lake/ADLS Azure DevOps Microsoft Fabric Azure Databricks Experience with PySpark, Airflow, Dagster, Prefect or other orchestration technologies would also be useful. ...

design and maintenance of data warehouses, ensuring efficient storage and retrieval.Work with data lakes (such as Azure Data Lake Storage) to ingest and process large volumes of data.Understand ETL (Extract, Transform, Load) processes and their impact on BI solutions.Implement data governance … practices within the data warehouse and data lake environments.GeneralParticipate in cross-functional teams to provide insights and recommendations for data-related initiatives.Participate in training and development opportunities to enhance technical skills and domain knowledge.Demonstration of safe approach in working practises.Encouragement of attention ...

speed (ultra low latency) is paramount. They should understand modern data structures such as the differences between a centralised data lake and a data mesh and can translate how these technical choices impact the business operating model. They should have a blend … governance, operating models, and use of externally sourced/licensed data Expertise in modern data architectures (e.g. data lake vs. data mesh) and how they shape operating models Ability to design decoupled, cloud-agnostic architectures and conceptual data models ...

Data Engineer/BI Developer Data Science and Artificial Intelligence Department The Bermuda Monetary Authority (Authority or BMA) is seeking the services of a skilled and capable individual to work as a Data Engineer/BI Developer in our Data Science … responsible for, but not limited to: Designing, developing and implementing modern and scalable data management platforms (including modern data lake and enterprise data warehouse solutions as well as consolidated and modern data pipelines (ETL\ELT) to extract, aggregate and manipulate data ...

seeking a Data Infrastructure Architect with 7+ years of experience in designing and governing enterprise-scale data platforms within regulated environments. The role ensures data is accessible, trusted, secure, and optimized for analytics, machine learning, and AI-driven solutions. Ideal candidates will either already … have transitioned to or be ready to transition from a hands-on delivery role to strategic influence, shaping data architecture standards and guiding technology decisions across the organization. The Architecture & Modernization (A+M) team drives the Firm's multi-year technology modernization roadmap, focusing on architecture frameworks, product delivery ...

seeking a Data Infrastructure Architect with 7+ years of experience in designing and governing enterprise-scale data platforms within regulated environments. The role ensures data is accessible, trusted, secure, and optimized for analytics, machine learning, and AI-driven solutions. Ideal candidates will either already … have transitioned to or be ready to transition from a hands-on delivery role to strategic influence, shaping data architecture standards and guiding technology decisions across the organization.The Architecture & Modernization (A+M) team drives the Firm's multi-year technology modernization roadmap, focusing on architecture frameworks, product delivery ...

Data Analytics & Business Intelligence (BI) Experience 5-10 years Location United Kingdom - Glasgow, London Skills Apache Airflow, AWS, Data Lake/Lakehouse, Databricks Certified (Data Engineer, ML), DBT, Python, SQL We are seeking a highly skilled Сonsultant Data Engineer … driving force behind this massive architectural shift. You will be hands-on in moving a highly complex, highly regulated data ecosystem from an on-premise Teradata environment to a cutting-edge AWS «Lakehouse» architecture. In this role, you will focus on building robust data pipelines, modernizing ...

ready to shape the future of data engineering at JPMorganChase? Join a dynamic team where your unique skills will help build innovative solutions and contribute to a winning culture. You'll have opportunities for career growth, collaborate with talented professionals, and make a real impact on our business … software engineering concepts and expanding applied experienceGood working knowledge of cloud-based data services (especially Glue jobs and Federated Data Lake), unified analytics platforms, and PythonExperience across the data lifecycle, including ingestion, transformation, storage, and access patternsAdvanced proficiency in SQL, including joins ...

scale data processing.Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning.Hands-on experience with data lake platforms (Databricks, Apache Spark, or similar).Experience with AWS cloud services (S3, ECS, SNS/SQS, Lambda, etc.).Strong understanding of data … Functions, etc.).Databricks or AWS certifications.Demonstrated proficiency in cloud-native development (e.g., cloud, artificial intelligence, machine learning).Experience with Parquet, JSON, CSV, Avro, Delta Lake file formats.J.P. Morgan is a global leader in financial services, providing strategic advice and products to the world’s most prominent corporations, governments, wealthy ...

processing. Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning. Hands-on experience with data lake platforms (Databricks, Apache Spark, or similar).Experience with AWS cloud services (S3, ECS, SNS/SQS, Lambda, etc.).Strong understanding of data … etc.).Databricks or AWS certifications. Demonstrated proficiency in cloud-native development (e.g., cloud, artificial intelligence, machine learning).Experience with Parquet, JSON, CSV, Avro, Delta Lake file formats.J.P. Morgan is a global leader in financial services, providing strategic advice and products to the world's most prominent corporations, governments, wealthy ...

processing. Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning. Hands-on experience with data lake platforms (Databricks, Apache Spark, or similar). Experience with AWS cloud services (S3, ECS, SNS/SQS, Lambda, etc.). Strong understanding of data … Databricks or AWS certifications. Demonstrated proficiency in cloud-native development (e.g., cloud, artificial intelligence, machine learning). Experience with Parquet, JSON, CSV, Avro, Delta Lake file formats. #J-18808-Ljbffr ...

ready to shape the future of data engineering at JPMorganChase? Join a dynamic team where your unique skills will help build innovative solutions and contribute to a winning culture. You'll have opportunities for career growth, collaborate with talented professionals, and make a real impact on our business … software engineering concepts and proficient applied experienceGood working knowledge of cloud-based data services (especially Glue jobs and Federated Data Lake), unified analytics platforms, and PythonExperience across the data lifecycle, including ingestion, transformation, storage, and access patternsAdvanced proficiency in SQL, including joins ...

Title: Data Architect (Contract) Job Description We're looking for an experienced Data Architect to support a major transformation programme focused on modernising policy administration and data services. Key Requirements: Proven experience as a Data Architect. Strong background in large-scale data … transformation programmes. experience designing end-to-end solutions across both legacy and cloud environments. Strong knowledge of Azure technologies, including Data Lake, Data Factory, Databricks, Synapse and Azure SQL. Financial Services experience is essential. Excellent stakeholder management and communication skills. Desirable: experience supporting ...

ready to shape the future of data engineering at JPMorganChase? Join a dynamic team where your unique skills will help build innovative solutions and contribute to a winning culture. You'll have opportunities for career growth, collaborate with talented professionals, and make a real impact on our business … engineering concepts and proficient applied experience Good working knowledge of cloud-based data services (especially Glue jobs and Federated Data Lake), unified analytics platforms, and Python Experience across the data lifecycle, including ingestion, transformation, storage, and access patterns Advanced proficiency in SQL, including ...

Data Security Assurance LeadDivision: OperationsDepartment: Cyber and Information ResilienceSalary: National (Edinburgh and Leeds) ranging from 57,000 to 77,000 and London from 63,000 to 85,000. (Salary offered will be based on skills and experience)This role is graded as: Lead Associate, RegulatoryYour external recruitment contact … Resilience (C&IR) is responsible for the management of cyber security at the FCA. 'Cyber security' means the protection of the FCA's data and systems from malicious activity, including theft, damage and disruption, in order that the FCA can deliver its key business functions. ...

have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.The Chief Data & Analytics Office (CDAO) at JPMorgan Chase is responsible for accelerating the firm’s data and analytics journey. This includes ensuring the quality, integrity … technology products focused on data and analytics. You will tackle complex cloud data platform challenges, especially around Data Lake Tools. In this role you will work in an agile environment, collaborating with cross-functional teams.Job Responsibilities:Leads a team of Site Reliability Engineers ...

have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. The Chief Data & Analytics Office (CDAO) at JPMorgan Chase is responsible for accelerating the firm's data and analytics journey. This includes ensuring the quality … technology products focused on data and analytics. You will tackle complex cloud data platform challenges, especially around Data Lake Tools. In this role you will work in an agile environment, collaborating with cross-functional teams. Job Responsibilities: Leads a team of Site Reliability ...

build and operate innovative products and platforms that help keep the BBC at the forefront of the industry. WHY JOIN THE TEAM Core Data Platform is part of Data Platform, providing trusted, fast, and reliable access to audience and business data that enables … platforms and ingestion pipelines. YOUR KEY RESPONSIBILITIES AND IMPACT Lead the optimisation, performance, and evolution of the organisation's data lake and data warehouse platforms, ensuring scalable, cost-effective data services while enabling future architectural improvements and modernisation initiatives. Support ...

Principal Data Engineer (Azure) We're looking for an experienced Principal Data Engineer to lead the technical direction of a modern Azure-based data platform. This is a hands-on leadership role where you'll shape data engineering standards, design scalable lakehouse … technical authority for data engineering best practice. Key Skills: Extensive Azure Data Engineering experience Microsoft Fabric, Azure Data Lake & Databricks Python, SQL and modern data pipeline development Azure DevOps & CI/CD Data governance, security and quality assurance Strong ...

accelerating chemical discovery to improve quality of life and extend the reach of humanity. The Role Everything Chemify does runs on the Unified Data Platform. When a molecule is designed, registered, sourced, synthesised by a robot, tested, and shipped, the platform is what carries it, one canonical identity … cases, and the abstractions you choose will outlive the code. Data pipelines and orchestration. Dagster pipelines feeding a versioned data lake and a warehouse serving multiple use cases, with the reproducibility and governance that scientific data demands. Reconciling sources that disagree. External datasets ...

Sector: AI & DataReference: BBBH185943_1788534559Principal Data Engineer (Azure)We're looking for an experienced Principal Data Engineer to lead the technical direction of a modern Azure-based data platform. This is a hands-on leadership role where you'll shape data engineering … technical authority for data engineering best practice.Key Skills:Extensive Azure Data Engineering experienceMicrosoft Fabric, Azure Data Lake & DatabricksPython, SQL and modern data pipeline developmentAzure DevOps & CI/CDData governance, security and quality assuranceStrong stakeholder engagement and technical leadershipDesirable: Spark, Terraform/ ...

Basic informationLocationBelfast, Glasgow, LondonBusiness LineTechnology & TransformationJob TypePermanent/FTCDate published17-Aug-2026Req #24694Job descriptionConnect to your IndustryMarketing is increasingly shaped by data, AI, and automation — and practitioners who understand all three are rare. As a Senior Consultant specialising in Agentic Marketing Data & Analytics, you will work … intersection of marketing analytics, AI, and data strategy, helping clients harness data to understand their customers more deeply, measure marketing effectiveness, and unlock the potential of agentic AI - intelligent, autonomous systems that can analyse, recommend, and act on marketing data at scale.This ...