1 to 25 of 228 Permanent Data Lake Jobs in the UK

+ Excellent Benefits | Permanent Azure Data Platform | Azure Architecture | Data Platform Design | Databricks | Data Factory | Data Lake | Synapse Are you an experienced Azure Data Platform Manager, Azure Data Architect or Data Platform Lead with … solutions, defining data architecture and making technical design decisions across Azure Data Factory, Azure Databricks, Azure Data Lake, Azure SQL and Azure Synapse. You'll combine deep Azure Data Platform knowledge with leadership, stakeholder management and project delivery experience, helping ...

build tool) – modelling layers, testing, documentation, incremental strategies Application Databases Data Integration AWS – S3, RDS, Aurora, Redshift (migration context), Glue, Lake Formation, IAM, VPC Data Governance Data lineage, cataloguing (Apache Atlas/Collibra/Snowflake Horizon), GDPR, BCBS … contracts, schema versioning Redis Cache invalidation, persistence strategy, data consistency MongoDB TimescaleDB NATS JetStream AWS S3/Glue Data lake staging, archival, batch ingestion into Snowflake Partitioning, file format (Parquet/ORC), Lake Formation governance Finance Domain Knowledge Candidates should have hands ...

insights that support strategic decision-making and operational performance. The role combines leadership of data engineering capability (including the data lake, pipelines and environments) with ownership of analytics and reporting outputs, ensuring data is transformed into accessible, trusted and actionable insight … Engineering & Platform Leadership * Lead the design, development and ongoing management of the Society's data architecture, including the data lake and associated data environments. * Ensure robust, scalable and secure data pipelines are in place to support timely and accurate data ...

Senior Data Manager Location: Remote, UK Working pattern: Full-time, flexible working Salary: £50k - £64k Are you an experienced Data Management leader who wants the freedom to shape and deliver an enterprise-wide data transformation? This is an opportunity to take genuine ownership … data governance, data quality, master data management and metadata across a complex, global, mission-driven organisation. You will not simply write policies or coordinate activity. You will create the roadmap, develop a practical data management playbook and lead the transition from fragmented ...

## Lead Funds Data ArchitectApplyremote type: Hybridlocations: Belfast United Kingdomtime type: Full timeposted on: Posted Todayjob requisition id: 26979743The Lead Funds Data Architect will be a pivotal member of our team, responsible for bridging the gap between business needs and technical solutions within the Funds domain.This … individual will lead the design, development, and implementation of data strategies and architectures that support Fund accounting, Fund Administration, ETFs, IBOR (Investment Book of Record), ABOR (Accounting Book of Record), and various regulatory and client reporting functions.A profound understanding of data governance, data lineage ...

Data & Automation Lead, Data Laking, Data Lake, Data Lakes, AWS, AI, LLM, Automation, Part Remote, Part Central London AI Data & Automation Lead required to work for a fast growing and already established company based in Central London. This … more details... Key Responsibilities Lead the design and evolution of a modern data architecture, leveraging cloud-based data lake technologies and scalable data engineering practices. Define and deliver a roadmap for transforming investment operations through automation, workflow modernisation and AI enabled solutions. Build ...

range of cloud and data technologies such as Fabric, Azure Data Factory, Azure Event Hubs, Azure Data Lake Storage, Azure Function Apps, Azure Synapse Analytics, AWS Glue, AWS S3, AWS Lambda Functions, AWS Redshift, Databricks, Snowflake, Google BigQuery, Alteryx, SSIS or Informatica, with … awareness of equivalent alternatives Strong understanding of data warehouse and data lake principles Demonstrable data modelling capabilities using Kimball, Inmon or Data Vault methodologies Experience working with relational database platforms Advanced SQL skills Exposure to data engineering coding languages ...

configure and support Microsoft Fabric solutions for our clients across public and private sector environments. This role will support the delivery of modern data platforms, analytics services and integrated data solutions, helping customers make better use of their data through Microsoft Fabric, Power … best practice. Experience with Azure data services such as Azure Data Factory, Azure Synapse Analytics, Azure SQL, Data Lake Storage or Databricks would be advantageous. Understanding of data governance, security, access control, data quality and data lifecycle ...

warehouse architectures: Implement logical and physical data models, data quality controls, and governance practices using Amazon S3 (data lake), AWS Lake Formation, Amazon Redshift, and Amazon Athena to ensure trusted data.* Ability to design AI/ML-enabled solutions: Enable feature-ready … governed delivery.* Stay ahead of the curve: Continuously learn and adapt to the evolving AWS data and analytics landscape, including AWS Glue, Lake Formation, Redshift, Athena, EMR, and related best practices.* Define the platform operating model: Establish AWS multi-account strategies, environment separation (dev/test/ ...

range of cloud and data technologies such as Fabric, Azure Data Factory, Azure Event Hubs, Azure Data Lake Storage, Azure Function Apps, Azure Synapse Analytics, AWS Glue, AWS S3, AWS Lambda Functions, AWS Redshift, Databricks, Snowflake, Google BigQuery, Alteryx, SSIS or Informatica, with … awareness of equivalent alternatives Strong understanding of data warehouse and data lake principles Demonstrable data modelling capabilities using Kimball, Inmon or Data Vault methodologies Experience working with relational database platforms Advanced SQL skills Exposure to data engineering coding languages ...

Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles … Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles ...

Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles … Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles ...

Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles … Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles ...

Asset Alliance Group - Head Of Data & Analytics Asset Alliance Group is part of the Arbuthnot Latham Banking Group. We serve the commercial vehicle, bus, coach, and general asset finance sectors with tailored award-winning lending, contract hire, rental and finance packages. We are a full-service finance … hands‐on experience with Azure cloud services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Data Lake Storage. Proficiency in programming languages such as Python, SQL, .Net, PowerBI. Previous experience working with various LLMs, Copilot, Agentforce and MuleSoft would be advantageous. ...

diverse, ambitious team that celebrates creativity and collaboration. Ready to make your mark? Join us and be part of something bigger. As a Data Architect (Manager) in Kainos, you'll be responsible for providing SME guidance in traditional data architecture disciplines around data structures … capacity planning across heterogeneous data store technologies. Experience of establishing data governance processes Experience of architecting a data lake and solutions that reside within a data lake ecosystem Enterprise Data Architecture experience. Embracing our differences At Kainos ...

business-critical decision-making. Essential to this role are strong python skills, expertise in MS Fabric, SQL, data warehousing, Data Lake and Azure technologies. The Role As the Lead Data Engineer, you will be responsible for designing, developing, and maintaining modern data … development skills. Experience building and optimising ETL/ELT pipelines. Strong understanding of Lakehouse, Data Warehouse, and Data Lake architectures. Experience with Azure Data Factory, Azure Synapse, and Apache Spark. Knowledge of data modelling, semantic models, and enterprise reporting solutions. Experience ...

Data Architect Permanent | Remote (UK) with occasional travel to London Up to £120k + bonus + benefits (depending on experience and level) All candidates must be eligible for UK Security Clearance (SC) Architect the Future of Enterprise Data Platforms Are you a Data Analytics … across the Microsoft data ecosystem, including: Microsoft Fabric Azure Databricks Azure Data Factory Azure Synapse Analytics Azure Data Lake Storage Strong understanding of modern data engineering concepts including: Data pipelines ETL/ELT frameworks Data ingestion patterns ...

Your new company You'll be joining a secure defence programme delivering a central AWS data lake and integration capability across multiple source systems and security classifications. Due to the nature of the programme, applicants must already hold active DV clearance and meet the client's security … ingestion, integration, transformation, governance and security.You will be responsible for: Defining the target architecture and design principles for a secure AWS data lake Designing secure integration patterns across multiple classifications and MOD operating environments Defining conceptual, logical and physical data models Specifying Apache NiFi architecture ...

properly articulated, understood, and realized as secure and robust solutions. Design and assess end-to-end solution architectures for enterprise-scale platforms, including data modeling, meta-modeling, master and reference data management, data quality, metadata management, data taxonomy, data integration … such as UML) or tools such as ERwin, Power Designer, or MagicDraw. Knowledge of data architecture options including ODS, Data Lake, Data Catalog (DCAT), Data Warehousing, OLTP, and OLAP, and the treatment of data as a technology asset. Knowledge ...

properly articulated, understood, and realized as secure and robust solutions. Design and assess end-to-end solution architectures for enterprise-scale platforms, including data modeling, meta-modeling, master and reference data management, data quality, metadata management, data taxonomy, data integration … such as UML) or tools such as ERwin, Power Designer, or MagicDraw. Knowledge of data architecture options including ODS, Data Lake, Data Catalog (DCAT), Data Warehousing, OLTP, and OLAP, and the treatment of data as a technology asset. Knowledge ...

design experience Experience with cloud and data technologies including Fabric, Azure Data Factory, Azure Event Hubs, Azure Data Lake Storage, Azure Function Apps, Azure Synapse Analytics, AWS Glue, AWS S3, AWS Lambda Functions, AWS Redshift, Databricks, Snowflake, Google BigQuery, Alteryx, SSIS or Informatica … Strong understanding of data warehouse and data lake principles Data modelling using Kimball, Inmon or Data Vault methodologies Experience with relational database platforms and advanced SQL Exposure to Python, R or Spark Awareness of AI and ML methodologies and their application ...

Help Shape the UKs Energy Future Data Engineer Opportunity with the Civil Works Alliance (CWA), Supporting Sizewell C As part of the CWA (Civil Works Alliance), you will support the building of Sizewell C. Sizewell C will be a 3.2-gigawatt power station generating low-carbon electricity …/CD & Release Management Technical Documentation Technical Azure Databricks, PySpark, Python & SQL Azure Data Factory Azure Functions Azure Data Lake/Lakehouse REST APIs & Third-Party System Integration Azure SQL Logic Apps Azure DevOps, Git & CI/CD Docker/Containers Data Quality ...

modelling, optimisation and supporting data solutions. You'll be working with Azure Databricks, Data Factory, Synapse, Data Lake, SQL and Python/PySpark. Key responsibilities: Build and enhance data pipelines across Azure and Databricks Develop ETL/ELT solutions … sources Transform and model data for use across analytics and reporting Support the ongoing development of the organisation's Data Lake and wider cloud data environment Troubleshoot pipeline and data issues, improving performance and reliability Help maintain strong standards around data ...

Data Engineer Permanent - £50k - £60k Glasgow area - approx. 2 days a month onsite We're looking for an experienced Data Engineer to join a growing Data Team within a global organisation and play a key role in the development of its next-generation data … hear from you. Experience of Microsoft Azure would also be highly advantageous, particularly: Azure Data Factory Azure SQL Azure Data Lake/ADLS Azure DevOps Microsoft Fabric Azure Databricks Experience with PySpark, Airflow, Dagster, Prefect or other orchestration technologies would also be useful. ...

every report and every operational data feed at ECP, continue the migration of our data warehouse and data lake to a modern dimensional model, finish the rollout of a principle-of-least-privilege security model across a multi-server SQL estate, and continue … personally delivering target architecture for the ECP data estate the data warehouse, data hub, data lake, raw/ODS layers, dimensional model, audit and schema-change tracking, and the load schedules that tie them together. Hands-on T-SQL, stored procedure ...