1 to 25 of 257 Data Lake Jobs in London

+ Excellent Benefits | Permanent Azure Data Platform | Azure Architecture | Data Platform Design | Databricks | Data Factory | Data Lake | Synapse Are you an experienced Azure Data Platform Manager, Azure Data Architect or Data Platform Lead with … solutions, defining data architecture and making technical design decisions across Azure Data Factory, Azure Databricks, Azure Data Lake, Azure SQL and Azure Synapse. You'll combine deep Azure Data Platform knowledge with leadership, stakeholder management and project delivery experience, helping ...

DescriptionWe’re passionate about using technology to drive sustainability. You too? Join us as a Data Architect for Technology Architecture at Ramboll Tech and help us become the leading Tech-Enabled Partner for Sustainable Change. We are seeking an experienced and results-driven Data Architect … with business goals, to drive growth and operational excellence. If you are passionate about collaborating with business leaders to shape strategies and have data-centric mindset, we want to hear from you. Join Ramboll Tech to support the formulation of business strategy, outcomes and capabilities and make your ...

Project descriptionWe are seeking a Data Architect to join our AI project team. In this role, you will design and implement the data architecture needed to support machine learning and AI solutions, including defining data models, storage patterns, and governance frameworks. You will ensure … modern data architecture concepts and patterns. This could include implementing or working with data lakehouse architectures (combining data lake flexibility with data warehouse performance), data mesh principles (decentralising data ownership to domain teams), or event-driven/ ...

build tool) – modelling layers, testing, documentation, incremental strategies Application Databases Data Integration AWS – S3, RDS, Aurora, Redshift (migration context), Glue, Lake Formation, IAM, VPC Data Governance Data lineage, cataloguing (Apache Atlas/Collibra/Snowflake Horizon), GDPR, BCBS … contracts, schema versioning Redis Cache invalidation, persistence strategy, data consistency MongoDB TimescaleDB NATS JetStream AWS S3/Glue Data lake staging, archival, batch ingestion into Snowflake Partitioning, file format (Parquet/ORC), Lake Formation governance Finance Domain Knowledge Candidates should have hands ...

platform.Develop and operate batch and incremental data pipelines leveraging Azure Data Factory for orchestration and Azure Data Lake Storage Gen2 as the primary data store.Independently implement SQL- and Spark‐based transformations to produce curated datasets that support enterprise reporting, analytics … Factory pipelines for batch and incremental data ingestion.Implement Spark‐based transformations that write curated datasets to Azure Data Lake Storage Gen2 using established folder structures and naming conventions.Create and maintain SQL views and tables in Azure Synapse to support analytics and reporting ...

relationships, and the variety of our skills and expertise that we bring to help them achieve their mission. We’re growing our Data & AI Architecture teams. If you are cleared to SC level and want to grow your career in this sector, we are very keen to hear … design teams.Experience in data solution architecture, including establishing design principles, defining solution patterns, and following architecture methodologies.Expertise in Data Lake, Lakehouse, and Data Mesh architecture.Observability and FinOps (Financial Operations) expertise.Experience of establishing common data models and suitable structures to enhance ...

clearance required £860 per day inside IR35 Role purpose The Data Architect will specify the target design for the data lake, data ingestion, integration, transformation, governance and security architecture. The role acts as the design authority, ensuring the solution is secure, scalable, auditable … operating environments with multiple security classifications. Key responsibilities Define the target data architecture and design principles for the AWS data lake and associated ingestion patterns. Design secure data integration patterns across multiple security classifications and operating environments. Specify API-based, file-based, legacy ...

days per week)Duration: Initial 6 months+Robert Half are supporting a leading global risk consulting firm organisation on a major Finance Data Lake, Self-Service Reporting and AI Enablement programme and are seeking an experienced Enterprise Data Architect with deep Databricks expertise. This … Data Lineage FrameworksExperience integrating Dynamics 365 Finance & Operations (D365 F&O) into enterprise data platformsExperience delivering Finance Data Lake, Data Warehouse or Lakehouse programmesStrong stakeholder engagement and solution design capabilitiesHighly DesirablePrevious experience working within specialist Databricks consultancies or Databricks partner organisationsMosaic ...

Data & Automation Lead, Data Laking, Data Lake, Data Lakes, AWS, AI, LLM, Automation, Part Remote, Part Central London AI Data & Automation Lead required to work for a fast growing and already established company based in Central London. This … more details... Key Responsibilities Lead the design and evolution of a modern data architecture, leveraging cloud-based data lake technologies and scalable data engineering practices. Define and deliver a roadmap for transforming investment operations through automation, workflow modernisation and AI enabled solutions. Build ...

inclusion – it’s a place where you can grow, belong and thrive.We are looking for a Forward Deployment Engineer specializing in AI Data Platforms and Data Spaces to help customers accelerate their AI transformation. You will work directly with clients to understand business challenges, assess their … digital and data ecosystems, and design innovative AI-ready data platforms and sovereign data spaces that enable scalable AI solutions.Key ResponsibilitiesEngage with customers to identify business challenges, data opportunities, and AI use cases.Assess enterprise data ecosystems, applications, infrastructure, and digital ...

Role Overview We are looking for an experienced Data Architect . This role will be responsible for defining and delivering data architecture that supports key business capabilities across risk, placement, broking, analytics, and operational data domains. The successful candidate will bring strong data … NoSQL technologies, including MongoDB Knowledge of document-based and operational data models Data warehousing and/or data lake architecture Metadata, lineage, and data governance Cloud platforms such as Azure, AWS, or GCP Strong analytical, problem-solving, and communication skills Domain ...

LondonRef: 23377Please follow us on WeChat to see all our Cantonese and Mandarin jobs, interview tips and London news:Your New Job Title: Data Management OfficerPlease click for similar jobsThe Skills You'll Need: English fluent,Strong knowledge of Data Governance, Data Management, Data … migration, report automation and process management toolsShould be able to read and write SQLShould understand the architecture and concept of data lake and data warehouse related knowledge and designMust be proactive and analytical to evaluate and solve problems independentlyMust be able to work under ...

install, configure and support Microsoft Fabric solutions for our clients across public and private sector environments.This role will support the delivery of modern data platforms, analytics services and integrated data solutions, helping customers make better use of their data through Microsoft Fabric, Power … best practice.· Experience with Azure data services such as Azure Data Factory, Azure Synapse Analytics, Azure SQL, Data Lake Storage or Databricks would be advantageous.· Understanding of data governance, security, access control, data quality and data lifecycle ...

Senior Data Engineer Who we areArtefact is a new generation of data service provider, specialising in data consulting and data-driven digital marketing, dedicated to transforming data into business impact across the entire value chain of organisations. We are proud … assisted workflows to optimise task efficiency.Strong communication and interpersonal skills.Excellent understanding of data architecture involving data mesh, data lake, data warehouse and data lakehouse.Preferred Qualifications:Certifications in Azure, AWS, or GCP.Certifications in Databricks, Snowflake or similar technologies.Experience ...

warehouse architectures: Implement logical and physical data models, data quality controls, and governance practices using Amazon S3 (data lake), AWS Lake Formation, Amazon Redshift, and Amazon Athena to ensure trusted data.* Ability to design AI/ML-enabled solutions: Enable feature-ready … governed delivery.* Stay ahead of the curve: Continuously learn and adapt to the evolving AWS data and analytics landscape, including AWS Glue, Lake Formation, Redshift, Athena, EMR, and related best practices.* Define the platform operating model: Establish AWS multi-account strategies, environment separation (dev/test/ ...

diverse, ambitious team that celebrates creativity and collaboration.Ready to make your mark? Join us and be part of something bigger.As a Data Architect (Manager) in Kainos, you’ll be responsible for providing SME guidance in traditional data architecture disciplines around data structures, data … models and capacity planning across heterogeneous data store technologies.Experience of establishing data governance processesExperience of architecting a data lake and solutions that reside within a data lake ecosystemEnterprise Data Architecture experience.Embracing our differences At Kainos, we believe ...

umbrella)Duration: Initial 6 months+Robert Half are supporting a leading property and real estate organisation on a major Finance Data Lake and Data Transformation programme and are looking for an experienced Data Architect to join the team. This role requires a hands … Platform expertiseDevOps/CI/CD experience within data environmentsStrong stakeholder engagement and solution design capabilitiesExperience delivering enterprise-scale data lake initiativesDesirable:Finance Data Lake programme experienceLead Data Engineering backgroundExperience working within large transformation programmesRobert Half Ltd acts ...

diverse, ambitious team that celebrates creativity and collaboration. Ready to make your mark? Join us and be part of something bigger. As a Data Architect (Manager) in Kainos, you'll be responsible for providing SME guidance in traditional data architecture disciplines around data structures … capacity planning across heterogeneous data store technologies. Experience of establishing data governance processes Experience of architecting a data lake and solutions that reside within a data lake ecosystem Enterprise Data Architecture experience. Embracing our differences At Kainos ...

business-critical decision-making. Essential to this role are strong python skills, expertise in MS Fabric, SQL, data warehousing, Data Lake and Azure technologies. The Role As the Lead Data Engineer, you will be responsible for designing, developing, and maintaining modern data … development skills. Experience building and optimising ETL/ELT pipelines. Strong understanding of Lakehouse, Data Warehouse, and Data Lake architectures. Experience with Azure Data Factory, Azure Synapse, and Apache Spark. Knowledge of data modelling, semantic models, and enterprise reporting solutions. Experience ...

Cloud Data Architect - AWS-focusedAbout BIPBIP is an international consultancy specialising in business transformation, technology and innovation. We work with leading organisations to solve complex challenges and deliver meaningful, sustainable change.BIP xTech is our Centre of Excellence for technology consulting and digital engineering, bringing together specialists across modern … data platforms, cloud, data science, AI and emerging technologies.We are looking for a Cloud Data Architect to join our xTech team and help design and deliver modern, scalable and secure data platforms for major UK and international clients.The roleAs a Cloud Data ...

Lead Solution Data Architect in ARCHITECTURE Leeds, United Kingdom London, United Kingdom Job Description Lead Solution Data Architect in Architecture, Technology Directorate Permanent Full time Location - Leeds or London Flexible Working Options: We support a range of flexible working patterns including hybrid working, flexible start … expertise and demonstrable hands-on design experience with cloud-based services for modern analytics on the Microsoft Cloud (e.g. e.g. Azure Data Lake, Azure Data Factory, Azure Databricks & Unity Catalog, MS Purview, PowerBI, Ms Fabric) Deep expertise in data architecture, including data ...

every report and every operational data feed at ECP, continue the migration of our data warehouse and data lake to a modern dimensional model, finish the rollout of a principle-of-least-privilege security model across a multi-server SQL estate, and continue … personally delivering target architecture for the ECP data estate the data warehouse, data hub, data lake, raw/ODS layers, dimensional model, audit and schema-change tracking, and the load schedules that tie them together. Hands-on T-SQL, stored procedure ...

pharmaceuticals and life sciences, manufacturing, and technology, media and telecoms, with capabilities spanning strategy, transformation and operational excellence - all powered by advanced technology, data, AI and digital innovation. Clients value the company’s collaborative approach and the way its teams integrate seamlessly - all working with a shared understanding … AWS. What you will be doing Defining and implementing on premise or cloud architectures, (e.g. a cloud data warehouse, data lake or data platform) to enable digital transformation Working with clients on data warehousing, building operational ETL/ELT data ...

team you'll be working with: We are seeking a detail-oriented and capable Data Migration Engineer to join our Data & AI practice. The successful candidate will bring solid experience in data migration, ETL/ELT pipeline development, and cloud-based data … especially AWS GluePython/PySparkSQL querying and validationYAML configuration (desirable)Experience testing or supporting: ETL/ELT pipelinesData migration processesFamiliarity with: Data lake/Lakehouse concepts (e.g., Apache Iceberg)Distributed processing frameworks (e.g., Spark)Basic understanding of: ETL vs ELT approachesCloud-based data architecturesExposure ...

inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT DATAWe are seeking a highly experienced and visionary Data Solutions Architect (Modern Big Data) to join our Data & AI practice. The successful candidate will bring extensive expertise in architecting … Unity Catalog.• Strong knowledge of cloud ecosystems (AWS, Azure, GCP) and infrastructure-as-code (Terraform, CloudFormation).• Hands-on expertise with data lake/lakehouse architectures and modern streaming solutions.• Experience with SQL, NoSQL, ETL/ELT pipelines, and programming languages (Python, R, Java).• Familiarity with ...