1 to 25 of 266 Data Lake Jobs in the UK

+ Excellent Benefits | Permanent Azure Data Platform | Azure Architecture | Data Platform Design | Databricks | Data Factory | Data Lake | Synapse Are you an experienced Azure Data Platform Manager, Azure Data Architect or Data Platform Lead with … solutions, defining data architecture and making technical design decisions across Azure Data Factory, Azure Databricks, Azure Data Lake, Azure SQL and Azure Synapse. You'll combine deep Azure Data Platform knowledge with leadership, stakeholder management and project delivery experience, helping ...

build tool) – modelling layers, testing, documentation, incremental strategies Application Databases Data Integration AWS – S3, RDS, Aurora, Redshift (migration context), Glue, Lake Formation, IAM, VPC Data Governance Data lineage, cataloguing (Apache Atlas/Collibra/Snowflake Horizon), GDPR, BCBS … contracts, schema versioning Redis Cache invalidation, persistence strategy, data consistency MongoDB TimescaleDB NATS JetStream AWS S3/Glue Data lake staging, archival, batch ingestion into Snowflake Partitioning, file format (Parquet/ORC), Lake Formation governance Finance Domain Knowledge Candidates should have hands ...

insights that support strategic decision-making and operational performance. The role combines leadership of data engineering capability (including the data lake, pipelines and environments) with ownership of analytics and reporting outputs, ensuring data is transformed into accessible, trusted and actionable insight … Engineering & Platform Leadership * Lead the design, development and ongoing management of the Society's data architecture, including the data lake and associated data environments. * Ensure robust, scalable and secure data pipelines are in place to support timely and accurate data ...

Senior Data Manager Location: Remote, UK Working pattern: Full-time, flexible working Salary: £50k - £64k Are you an experienced Data Management leader who wants the freedom to shape and deliver an enterprise-wide data transformation? This is an opportunity to take genuine ownership … data governance, data quality, master data management and metadata across a complex, global, mission-driven organisation. You will not simply write policies or coordinate activity. You will create the roadmap, develop a practical data management playbook and lead the transition from fragmented ...

Lead Funds Data Architect will be a pivotal member of our team, responsible for bridging the gap between business needs and technical solutions within the Funds domain. This individual will lead the design, development, and implementation of data strategies and architectures that support Fund accounting, Fund … Administration, ETFs, IBOR (Investment Book of Record), ABOR (Accounting Book of Record), and various regulatory and client reporting functions. A profound understanding of data governance, data lineage, data modeling, and core data concepts specific to the investment and funds industry is paramount. ...

clearance required £860 per day inside IR35 Role purpose The Data Architect will specify the target design for the data lake, data ingestion, integration, transformation, governance and security architecture. The role acts as the design authority, ensuring the solution is secure, scalable, auditable … operating environments with multiple security classifications. Key responsibilities Define the target data architecture and design principles for the AWS data lake and associated ingestion patterns. Design secure data integration patterns across multiple security classifications and operating environments. Specify API-based, file-based, legacy ...

Products (Medallion Architecture) and Cloud-based data design (Preferably AWS). Extensive experience in Data Warehouse and Data Lake designs. Good understanding of Data Modelling techniques (both Relational and Dimensional) Some other highly valued skills may include: Good understanding … Tools and Infrastructure used for Data Lake Proficient in SQLs. Knowledge of Databricks will be of great advantage. Good understanding of Data Quality, Data Lineage, Metadata Management and Data Governance You may be assessed on the key critical skills relevant ...

Data & Automation Lead, Data Laking, Data Lake, Data Lakes, AWS, AI, LLM, Automation, Part Remote, Part Central London AI Data & Automation Lead required to work for a fast growing and already established company based in Central London. This … more details... Key Responsibilities Lead the design and evolution of a modern data architecture, leveraging cloud-based data lake technologies and scalable data engineering practices. Define and deliver a roadmap for transforming investment operations through automation, workflow modernisation and AI enabled solutions. Build ...

range of cloud and data technologies such as Fabric, Azure Data Factory, Azure Event Hubs, Azure Data Lake Storage, Azure Function Apps, Azure Synapse Analytics, AWS Glue, AWS S3, AWS Lambda Functions, AWS Redshift, Databricks, Snowflake, Google BigQuery, Alteryx, SSIS or Informatica, with … awareness of equivalent alternatives Strong understanding of data warehouse and data lake principles Demonstrable data modelling capabilities using Kimball, Inmon or Data Vault methodologies Experience working with relational database platforms Advanced SQL skills Exposure to data engineering coding languages ...

Role Overview We are looking for an experienced Data Architect . This role will be responsible for defining and delivering data architecture that supports key business capabilities across risk, placement, broking, analytics, and operational data domains. The successful candidate will bring strong data … NoSQL technologies, including MongoDB Knowledge of document-based and operational data models Data warehousing and/or data lake architecture Metadata, lineage, and data governance Cloud platforms such as Azure, AWS, or GCP Strong analytical, problem-solving, and communication skills Domain ...

configure and support Microsoft Fabric solutions for our clients across public and private sector environments. This role will support the delivery of modern data platforms, analytics services and integrated data solutions, helping customers make better use of their data through Microsoft Fabric, Power … best practice. Experience with Azure data services such as Azure Data Factory, Azure Synapse Analytics, Azure SQL, Data Lake Storage or Databricks would be advantageous. Understanding of data governance, security, access control, data quality and data lifecycle ...

range of cloud and data technologies such as Fabric, Azure Data Factory, Azure Event Hubs, Azure Data Lake Storage, Azure Function Apps, Azure Synapse Analytics, AWS Glue, AWS S3, AWS Lambda Functions, AWS Redshift, Databricks, Snowflake, Google BigQuery, Alteryx, SSIS or Informatica, with … awareness of equivalent alternatives Strong understanding of data warehouse and data lake principles Demonstrable data modelling capabilities using Kimball, Inmon or Data Vault methodologies Experience working with relational database platforms Advanced SQL skills Exposure to data engineering coding languages ...

warehouse architectures: Implement logical and physical data models, data quality controls, and governance practices using Amazon S3 (data lake), AWS Lake Formation, Amazon Redshift, and Amazon Athena to ensure trusted data.* Ability to design AI/ML-enabled solutions: Enable feature-ready … governed delivery.* Stay ahead of the curve: Continuously learn and adapt to the evolving AWS data and analytics landscape, including AWS Glue, Lake Formation, Redshift, Athena, EMR, and related best practices.* Define the platform operating model: Establish AWS multi-account strategies, environment separation (dev/test/ ...

Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles … Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles ...

diverse, ambitious team that celebrates creativity and collaboration.Ready to make your mark? Join us and be part of something bigger.As a Data Architect (Manager) in Kainos, you’ll be responsible for providing SME guidance in traditional data architecture disciplines around data structures, data … models and capacity planning across heterogeneous data store technologies.Experience of establishing data governance processesExperience of architecting a data lake and solutions that reside within a data lake ecosystemEnterprise Data Architecture experience.Embracing our differences At Kainos, we believe ...

Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles … Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles ...

Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles … Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles ...

Asset Alliance Group - Head Of Data & Analytics Asset Alliance Group is part of the Arbuthnot Latham Banking Group. We serve the commercial vehicle, bus, coach, and general asset finance sectors with tailored award-winning lending, contract hire, rental and finance packages. We are a full-service finance … hands‐on experience with Azure cloud services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Data Lake Storage. Proficiency in programming languages such as Python, SQL, .Net, PowerBI. Previous experience working with various LLMs, Copilot, Agentforce and MuleSoft would be advantageous. ...

diverse, ambitious team that celebrates creativity and collaboration. Ready to make your mark? Join us and be part of something bigger. As a Data Architect (Manager) in Kainos, you'll be responsible for providing SME guidance in traditional data architecture disciplines around data structures … capacity planning across heterogeneous data store technologies. Experience of establishing data governance processes Experience of architecting a data lake and solutions that reside within a data lake ecosystem Enterprise Data Architecture experience. Embracing our differences At Kainos ...

business-critical decision-making. Essential to this role are strong python skills, expertise in MS Fabric, SQL, data warehousing, Data Lake and Azure technologies. The Role As the Lead Data Engineer, you will be responsible for designing, developing, and maintaining modern data … development skills. Experience building and optimising ETL/ELT pipelines. Strong understanding of Lakehouse, Data Warehouse, and Data Lake architectures. Experience with Azure Data Factory, Azure Synapse, and Apache Spark. Knowledge of data modelling, semantic models, and enterprise reporting solutions. Experience ...

Data Architect Permanent | Remote (UK) with occasional travel to London Up to £120k + bonus + benefits (depending on experience and level) All candidates must be eligible for UK Security Clearance (SC) Architect the Future of Enterprise Data Platforms Are you a Data Analytics … across the Microsoft data ecosystem, including: Microsoft Fabric Azure Databricks Azure Data Factory Azure Synapse Analytics Azure Data Lake Storage Strong understanding of modern data engineering concepts including: Data pipelines ETL/ELT frameworks Data ingestion patterns ...

Your new company You'll be joining a secure defence programme delivering a central AWS data lake and integration capability across multiple source systems and security classifications. Due to the nature of the programme, applicants must already hold active DV clearance and meet the client's security … ingestion, integration, transformation, governance and security.You will be responsible for: Defining the target architecture and design principles for a secure AWS data lake Designing secure integration patterns across multiple classifications and MOD operating environments Defining conceptual, logical and physical data models Specifying Apache NiFi architecture ...

properly articulated, understood, and realized as secure and robust solutions. Design and assess end-to-end solution architectures for enterprise-scale platforms, including data modeling, meta-modeling, master and reference data management, data quality, metadata management, data taxonomy, data integration … such as UML) or tools such as ERwin, Power Designer, or MagicDraw. Knowledge of data architecture options including ODS, Data Lake, Data Catalog (DCAT), Data Warehousing, OLTP, and OLAP, and the treatment of data as a technology asset. Knowledge ...

properly articulated, understood, and realized as secure and robust solutions. Design and assess end-to-end solution architectures for enterprise-scale platforms, including data modeling, meta-modeling, master and reference data management, data quality, metadata management, data taxonomy, data integration … such as UML) or tools such as ERwin, Power Designer, or MagicDraw. Knowledge of data architecture options including ODS, Data Lake, Data Catalog (DCAT), Data Warehousing, OLTP, and OLAP, and the treatment of data as a technology asset. Knowledge ...

responsible for building and operating an Azure-based data platform, ensuring it provides a secure, scalable and trusted data lake using Azure Databricks. Working alongside data architects and engineering teams, you will help deliver new data products, onboard data … external data sharing. Implement data governance, security, access controls, backup, retention and monitoring to maintain the data lake as a trusted single source of truth. Develop and maintain data ingestion, transformation and data product pipelines. Collaborate with data ...