1 to 25 of 68 Data Lake Jobs in Scotland

based out of Milton Keynes or Glasgow. In this role, you will be responsible for engineering, operating, and evolving the AWS data lake platform, including the cloud infrastructure, shared services, and data engineering applications that sit on top of it. You will work closely with … focused on building and running cloud platforms rather than line management. The difference you’ll make: Engineering and operating the AWS data lake infrastructure, ensuring high availability, resilience, performance, and security Designing, building, and maintaining Infrastructure as Code (IaC) for AWS environments, shared services, and data ...

properly articulated, understood, and realized as secure and robust solutions.Design and assess end-to-end solution architectures for enterprise-scale platforms, including data modeling, meta-modeling, master and reference data management, data quality, metadata management, data taxonomy, data integration … modeling (such as UML) or tools such as ERwin, Power Designer, or MagicDraw.Knowledge of data architecture options including ODS, Data Lake, Data Catalog (DCAT), Data Warehousing, OLTP, and OLAP, and the treatment of data as a technology asset.Knowledge ...

properly articulated, understood, and realized as secure and robust solutions. Design and assess end-to-end solution architectures for enterprise-scale platforms, including data modeling, meta-modeling, master and reference data management, data quality, metadata management, data taxonomy, data integration … such as UML) or tools such as ERwin, Power Designer, or MagicDraw. Knowledge of data architecture options including ODS, Data Lake, Data Catalog (DCAT), Data Warehousing, OLTP, and OLAP, and the treatment of data as a technology asset. Knowledge ...

driving transformational change for our clients. We leverage proven technology, specialist teams, and extensive domain expertise to create robust technical foundations across platforms, data, and business applications. Our mission is fueled by a passion for technology as a means to solve complex business problems and achieve our clients … pipelines using Azure Data Factory, Synapse, Fabric Pipelines, or Databricks Integrate data from multiple systems into Azure Data Lake Storage or OneLake, ensuring consistency, reliability, and performance Develop and maintain ELT/ETL processes using Azure-native tools and Fabric capabilities, optimising ...

maintenance of data warehouses, ensuring efficient storage and retrieval. Work with data lakes (such as Azure Data Lake Storage) to ingest and process large volumes of data. Understand ETL (Extract, Transform, Load) processes and their impact on BI solutions. Implement data governance practices within the data warehouse and data lake environments. General Participate in cross-functional teams to provide insights and recommendations for data-related initiatives. Participate in training and development opportunities to enhance technical skills and domain knowledge. Demonstration of safe ...

design and maintenance of data warehouses, ensuring efficient storage and retrieval.Work with data lakes (such as Azure Data Lake Storage) to ingest and process large volumes of data.Understand ETL (Extract, Transform, Load) processes and their impact on BI solutions.Implement data governance … practices within the data warehouse and data lake environments.GeneralParticipate in cross-functional teams to provide insights and recommendations for data-related initiatives.Participate in training and development opportunities to enhance technical skills and domain knowledge.Demonstration of safe approach in working practises.Encouragement of attention ...

speed (ultra low latency) is paramount. They should understand modern data structures such as the differences between a centralised data lake and a data mesh and can translate how these technical choices impact the business operating model. They should have a blend … governance, operating models, and use of externally sourced/licensed data Expertise in modern data architectures (e.g. data lake vs. data mesh) and how they shape operating models Ability to design decoupled, cloud-agnostic architectures and conceptual data models ...

Data Engineer/BI Developer Data Science and Artificial Intelligence Department The Bermuda Monetary Authority (Authority or BMA) is seeking the services of a skilled and capable individual to work as a Data Engineer/BI Developer in our Data Science … responsible for, but not limited to: Designing, developing and implementing modern and scalable data management platforms (including modern data lake and enterprise data warehouse solutions as well as consolidated and modern data pipelines (ETL\ELT) to extract, aggregate and manipulate data ...

Responsibilities Act as a data-domain subject matter expert and influence business decision-making Build, develop and deploy data science solutions in compliance with internal best practices and procedures Help establish best practices, understanding and compliance within the data science team Communicate with business … such as A/B/N, multivariate, sample size calculation and factorial designs (desirable) Database, data warehouse or data lake experience, including SQL packages, processes, queries and data-model performance tuning (desirable) Cloud architecture experience, such as AWS or Microsoft Azure (desirable ...

seeking a Data Infrastructure Architect with 7+ years of experience in designing and governing enterprise-scale data platforms within regulated environments. The role ensures data is accessible, trusted, secure, and optimized for analytics, machine learning, and AI-driven solutions. Ideal candidates will either already … have transitioned to or be ready to transition from a hands-on delivery role to strategic influence, shaping data architecture standards and guiding technology decisions across the organization.The Architecture & Modernization (A+M) team drives the Firm's multi-year technology modernization roadmap, focusing on architecture frameworks, product delivery ...

seeking a Senior Data Engineer with strong SQL and Java expertise to design and deliver scalable data solutions. In this role, you will leverage Java's robustness and Scala's functional data-processing power to build scalable pipelines, manage distributed big data … Exposure to cloud platforms such as Azure, AWS, or GCP. Experience with CI/CD pipelines and DevOps practices. Familiarity with data lake and lakehouse architectures. Experience in banking or financial services industry Benefits By joining us you can expect Autonomy to develop and grow your skills ...

Senior Data Engineer Who we are We are an advanced data and business consultancy headquartered in Edinburgh, UK. We are a practitioner-led organisation that collaborates with top consumer brands to drive transformation and foster customer-centricity through our expertise in customer strategy, innovative design … advanced data science and engineering. We work with leading consumer brands to tackle and overcome complex business and customer problems to drive transformation and champion customer-centric agendas. We are proud to include some of the leading UK and global brands among our current clients such as Lloyds ...

Data Analytics & Business Intelligence (BI) Experience 5-10 years Location United Kingdom - Glasgow, London Skills Apache Airflow, AWS, Data Lake/Lakehouse, Databricks Certified (Data Engineer, ML), DBT, Python, SQL We are seeking a highly skilled Сonsultant Data Engineer … driving force behind this massive architectural shift. You will be hands-on in moving a highly complex, highly regulated data ecosystem from an on-premise Teradata environment to a cutting-edge AWS «Lakehouse» architecture. In this role, you will focus on building robust data pipelines, modernizing ...

work, for business aligned support areas to keep up to speed with business activity and the business strategy. Engage in complex analysis of data from multiple sources of information, internal and external sources such as procedures and practises (in other areas, teams, companies, etc) to solve problems creatively … with a willingness to continue learning. Some other highly valued skills may include: Exposure to cloud platforms such as AWS, including services like Lake Formation or Data Lake environments. Scripting skills (for example, Python or Shell) to support data validation, automation, or analysis. ...

driving transformational change for our clients. We leverage proven technology, specialist teams, and extensive domain expertise to create robust technical foundations across platforms, data, and business applications. Our mission is fueled by a passion for technology as a means to solve complex business problems and achieve our clients … improvements Strong hands-on experience with Microsoft Azure data services (e.g. Azure Data Factory, Azure Synapse, Azure Data Lake, Azure SQL) Proven experience designing and delivering solutions using Microsoft Fabric, including Lakehouse, Warehousing, Data Engineering, and Real-Time Analytics Advanced skills ...

Role As a Core Data Engineer, you will play a pivotal role in designing, building, and optimising data pipelines, architectures, and workflows for our diverse client base. You’ll work within dynamic, multi-disciplinary project teams to implement scalable data solutions while adhering … best practices and emerging trends in data engineering. This is an exciting and valuable opportunity for an enthusiastic, earlier-stage data engineer to advance their career across a variety of commercial sectors. At Optima, you’ll work within cross-functional teams, collaborating with experts in different ...

scale data processing.Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning.Hands-on experience with data lake platforms (Databricks, Apache Spark, or similar).Experience with AWS cloud services (S3, ECS, SNS/SQS, Lambda, etc.).Strong understanding of data … Functions, etc.).Databricks or AWS certifications.Demonstrated proficiency in cloud-native development (e.g., cloud, artificial intelligence, machine learning).Experience with Parquet, JSON, CSV, Avro, Delta Lake file formats.J.P. Morgan is a global leader in financial services, providing strategic advice and products to the world’s most prominent corporations, governments, wealthy ...

processing. Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning. Hands-on experience with data lake platforms (Databricks, Apache Spark, or similar). Experience with AWS cloud services (S3, ECS, SNS/SQS, Lambda, etc.). Strong understanding of data … Databricks or AWS certifications. Demonstrated proficiency in cloud-native development (e.g., cloud, artificial intelligence, machine learning). Experience with Parquet, JSON, CSV, Avro, Delta Lake file formats. J.P. Morgan is a global leader in financial services, providing strategic advice and products to the world’s most prominent corporations, governments ...

processing. Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning. Hands-on experience with data lake platforms (Databricks, Apache Spark, or similar). Experience with AWS cloud services (S3, ECS, SNS/SQS, Lambda, etc.). Strong understanding of data … Databricks or AWS certifications. Demonstrated proficiency in cloud-native development (e.g., cloud, artificial intelligence, machine learning). Experience with Parquet, JSON, CSV, Avro, Delta Lake file formats. #J-18808-Ljbffr ...

ready to shape the future of data engineering at JPMorganChase? Join a dynamic team where your unique skills will help build innovative solutions and contribute to a winning culture. You'll have opportunities for career growth, collaborate with talented professionals, and make a real impact on our business … software engineering concepts and proficient applied experienceGood working knowledge of cloud-based data services (especially Glue jobs and Federated Data Lake), unified analytics platforms, and PythonExperience across the data lifecycle, including ingestion, transformation, storage, and access patternsAdvanced proficiency in SQL, including joins ...

Title: Data Architect (Contract) Job Description We're looking for an experienced Data Architect to support a major transformation programme focused on modernising policy administration and data services. Key Requirements: Proven experience as a Data Architect. Strong background in large-scale data … transformation programmes. experience designing end-to-end solutions across both legacy and cloud environments. Strong knowledge of Azure technologies, including Data Lake, Data Factory, Databricks, Synapse and Azure SQL. Financial Services experience is essential. Excellent stakeholder management and communication skills. Desirable: experience supporting ...

Description Are you ready to shape the future of data engineering at JPMorganChase? Join a dynamic team where your unique skills will help build innovative solutions and contribute to a winning culture. You'll have opportunities for career growth, collaborate with talented professionals, and make a real impact … engineering concepts and proficient applied experience Good working knowledge of cloud-based data services (especially Glue jobs and Federated Data Lake), unified analytics platforms, and Python Experience across the data lifecycle, including ingestion, transformation, storage, and access patterns Advanced proficiency in SQL, including ...

ready to shape the future of data engineering at JPMorganChase? Join a dynamic team where your unique skills will help build innovative solutions and contribute to a winning culture. You'll have opportunities for career growth, collaborate with talented professionals, and make a real impact on our business … engineering concepts and proficient applied experience Good working knowledge of cloud-based data services (especially Glue jobs and Federated Data Lake), unified analytics platforms, and Python Experience across the data lifecycle, including ingestion, transformation, storage, and access patterns Advanced proficiency in SQL, including ...

have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.The Chief Data & Analytics Office (CDAO) at JPMorgan Chase is responsible for accelerating the firm’s data and analytics journey. This includes ensuring the quality, integrity … technology products focused on data and analytics. You will tackle complex cloud data platform challenges, especially around Data Lake Tools. In this role you will work in an agile environment, collaborating with cross-functional teams.Job Responsibilities:Leads a team of Site Reliability Engineers ...

have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. The Chief Data & Analytics Office (CDAO) at JPMorgan Chase is responsible for accelerating the firm's data and analytics journey. This includes ensuring the quality … technology products focused on data and analytics. You will tackle complex cloud data platform challenges, especially around Data Lake Tools. In this role you will work in an agile environment, collaborating with cross-functional teams. Job Responsibilities: Leads a team of Site Reliability ...