76 to 100 of 433 Data Lake Jobs in the UK

Microsoft Fabric workloads, including Lakehouse and Warehouse structures, Medallion Architecture flows, Data Factory pipelines, notebooks, semantic models, Power BI outputs and Direct Lake reporting patterns. Establish QA practices for EBX master and reference data capabilities, including workflow validation, hierarchy testing, data governance rule … testing modern data platform configuration, data feeds, inputs and outputs across Microsoft Fabric, Medallion Architecture patterns, Azure Data Lake Gen2, SQL-based warehouses and related analytics services. Practical understanding of Microsoft Fabric workloads including Lakehouse, Warehouse, Data Factory, Dataflows Gen2, notebooks ...

Role We are seeking a capable Consulting Data Architect to join our Insurance Technology Consulting practice and play a pivotal role in shaping, selling, and delivering data-led consulting engagements for insurance clients.Location: London, United Kingdom (Hybrid)Scope: UK-Based Role with Global Client & Delivery RemitReporting … secure enterprise data platforms using technologies such as Microsoft Fabric, Azure Synapse Analytics, Azure Data Factory, Azure Data Lake, Databricks, and Snowflake.Data Management, Governance & Controls – Experience establishing data governance frameworks, operating models, metadata management, lineage, cataloguing, data quality ...

pharmaceuticals and life sciences, manufacturing, and technology, media and telecoms, with capabilities spanning strategy, transformation and operational excellence – all powered by advanced technology, data, AI and digital innovation. Clients value Baringa’s collaborative approach and the way its teams integrate seamlessly – all working with a shared understanding … . What you will be doing Defining and implementing on premise or cloud architectures, (e.g. a cloud data warehouse, data lake or data platform) to enable digital transformation Working with clients on data warehousing, building operational ETL/ELT data ...

team you'll be working with:We are seeking an accomplished and detail-oriented Lead Data Migration Engineer to join our Data & AI practice. The successful candidate will bring deep expertise in data migration, ETL/ELT pipeline engineering, and cloud-native data … validating:End-to-end ETL/ELT pipelinesData migration workflowsFamiliarity with:Apache Iceberg and Lakehouse architecturesDistributed processing frameworks (e.g., Apache Spark)Data lake environmentsUnderstanding of:ETL vs ELT design patternsMigration performance tuningExperience with version control and CI/CD tools desirableWho we are:We’re a business ...

Data Engineer | Hybrid | South Wales | 3 months initially | Outside IR35 IntaPeople are excited to be appointed to recruit an experienced Data Engineer for a team that needs additional project resource for an interim period of time. You will be joining a small data team … modelling and data warehousing within platforms such as Azure. Practical experience with Microsoft Azure services, including Azure Data Lake (Gen2), Synapse, Event Hubs, and Cosmos DB, within scalable cloud -based architectures. Experience in using Git, Azure DevOps, or GitHub Actions for version control ...

within large-scale, complex environments. Strong experience designing modern cloud-based data platforms using AWS. Experience designing enterprise-scale Data Lake and Lakehouse architectures. Strong knowledge of Amazon S3 storage strategies, including Bronze, Silver and Gold data layer architectures. Experience designing scalable data … designs and supporting artefacts and design scalable ingestion patterns supporting databases, APIs and file-based integrations. You be involved with defining Data Lake and Lakehouse architecture using Amazon S3, supporting Bronze, Silver and Gold data layers, as well as design transformation, orchestration and processing patterns ...

Join us and build for travelers everywhere. Expedia Group seeks a motivated and results-oriented Senior Software Engineer to join our Data Lake and Catalog team. As a Senior Software Engineer on an industry-leading data platform, you will build the core of Expedia Group … with tools like Circus Train, a Hive dataset replication tool, and Waggle Dance, a federation service that allows access to data lake tables across multiple catalogs. Recently, we added Hive support to Apache Iceberg, a high-performance open table format for large analytic datasets that underpins many ...

Join us and build for travelers everywhere. the company seeks a motivated and results-oriented Senior Software Engineer to join our Data Lake and Catalog team. As a Senior Software Engineer on an industry-leading data platform, you will build the core of the company … with tools like Circus Train , a Hive dataset replication tool, and Waggle Dance , a federation service that allows access to data lake tables across multiple catalogs. Recently, we added Hive support to Apache Iceberg , a high-performance open table format for large analytic datasets that underpins many ...

Role: Data Engineer Location: Remote but able to attend client sites in Doncaster/London Exp. Start Date: ASAP Contract Duration: 6 Months initially Rate: £500 per day (Umbrella) Job Specification: See attached Experience Oracle experience beneficial Snowflake experience Experience Working with Data teams IDMC, Kafka … data sources. Understanding of Data Architecture patterns/Data lakes/kimbol Practical experience of Platforms Cloud platforms structuring Data Relational database Snowflake going through the cloud platform Informatica experience Change data capture experience Working with various data ...

Real EstateSalary: 60000Posted Date: 2026-06-10Contact Email: reasonableaccommodations@marsh.comMercer is seeking candidates for the following position based in the London office:Data EngineerWhat can you expect As a Data Engineer, you will be responsible for supporting the design, development, and maintenance of our data … Terraform)Experience with CI/CD pipelines and version control systems like Git.Familiarity with Dremio and/or Databricks as a data lake engine.Why join our team:We help you be your best through professional development opportunities, interesting work and supportive leadersWe foster a vibrant and inclusive ...

About The RoleTeam – Data and Information ServicesWorking Pattern - Hybrid – 2 days per week in the Vitality Bournemouth or London Office. Full-time hours per week. We are happy to discuss flexible working!Top 3 skills needed for this role:Proven delivery of scalable data solutionsDemonstrated expertise … warehousing, data management and ETL. Strong experience delivering data solutions within BI warehouses and/or data lake environments across both on-premise and cloud platforms. Hands-on experience with Big Data technologies, data ingestion and streaming. Confident ...

About The RoleTeam – Data and Information ServicesWorking Pattern - Hybrid – 2 days per week in the Vitality Bournemouth or London Office. Full-time hours per week. We are happy to discuss flexible working!Top 3 skills needed for this role:Proven delivery of scalable data solutionsDemonstrated expertise … warehousing, data management and ETL. Strong experience delivering data solutions within BI warehouses and/or data lake environments across both on-premise and cloud platforms. Hands-on experience with Big Data technologies, data ingestion and streaming. Confident ...

Powering Progress strategy on the journey to net-zero emissions. Achieving this ambition requires uniting Shell’s strategic and technical expertise across data, strategy, architecture, and innovation. This integration is essential to drive the transformative shifts needed in IT. As part of this journey, we are seeking … driven architecture (event hub, event bus, Kafka), ELKIntermediate to advanced exposure to Azure Active Directory, Azure Data Factory, Azure Data Lake, Azure Storage, Azure Kubernetes Service, CosmosDB, Azure SQLIntegration experience with Confluent/Kafka, API Management, Logic AppsCI/CD & DevOps:Brings substantial experience ...

suffers from inconsistent definitions and manual processing. This position exists to fix these foundational issues, unify customer data into a single lake, and ensure that data is never an afterthought in our product lifecycle. It bridges the gap between technical execution and business value, enabling … analytics are baked into new features from day one, rather than added as an afterthought. Enable Personalisation: Build a unified customer data lake that allows for advanced cohort segmentation and personalised experiences for our fans. Leadership & Roadmap: Review and manage the Data & BI teams, setting ...

trusted growth partner for the world’s leading brands. We unite cutting-edge media intelligence and data solutions, world-class creativity, next-generation production, transformative enterprise solutions and expert strategic counsel in a single company – powered by exceptional talent and our agentic marketing platform, WPP Open, to help … efficient data pipelines and architectures.Oversee the development and implementation of ETL/ELT processes, data warehousing, and data lake solutions.Collaborate with stakeholders to understand business requirements and translate them into technical data solutions.Ensure data quality, consistency, and security across ...

team you'll be working with: We are seeking an accomplished and detail-oriented Snowflake Data Engineer to join our Data & AI practice. The successful candidate will bring deep expertise in data engineering, ETL/ELT pipelines, and cloud-native data platforms … platforms (AWS, Azure, GCP).Knowledge of data modelling methodologies (star schemas, Data Vault, Kimball, Inmon).Familiarity with data lake architectures and distributed processing frameworks (e.g., Spark, Hadoop).Experience with version control tools (GitHub, Bitbucket) and CI/CD pipelines.Understanding of data ...

Architect - London (Hybrid) - Databricks - Spark - PySpark - AWS - Up to £115,000 + Bonus Our client, a large-scale organisation undergoing significant investment in data and cloud technologies, is seeking an experienced Senior Databricks Architect to join its expanding Data & AI practice. This is an exciting opportunity … Data Engineer or Solutions Architect Strong expertise in Databricks, Apache Spark, PySpark and SQL Experience designing and implementing modern data lake or lakehouse architectures Hands-on experience with Kafka Strong understanding of AWS data services, particularly Amazon S3 Experience integrating data ...

Title: HR Data Delivery Lead Role Overview A new data lake solution is being implemented and the HR Data Delivery Lead will be responsible for end-to-end delivery of data products, pipelines, and reporting solutions across multiple teams. This role … will be accountable for connecting data from the new Oracle HCM Cloud to the new AWS Snowflake solution and unifying data layer between legacy and new HRIS system feed to data warehouse. The role ensures high-quality, timely, and governed delivery of data ...

Senior Data Engineer Market Data 5 day onsite We are looking for a Senior Data Engineer to build and operate a high-performance market data platform supporting quantitative research and production trading systems. You'll design scalable data pipelines, process … actions. Implement automated data quality, reconciliation and monitoring frameworks. Optimise data storage using Parquet, Arrow and modern data lake technologies. Partner with quantitative researchers, traders and engineering teams to deliver trusted datasets. Essential Skills Strong Python and SQL. Experience building scalable, production data ...

mainly remote but require flexibility to travel to client sites, and our offices based in London, Sheffield, and Bristol.Strong understanding of Master Data Management principles, including domain identification, golden record design, survivorship rules, matching and merging, reference data, data ownership, stewardship and data … rights, escalation routes, data standards and ongoing service management.Strong Microsoft Azure data platform knowledge, ideally including Azure Data Lake, Microsoft Fabric, Azure SQL, Synapse, Databricks, integration services, Power BI and common enterprise integration patterns.Hands-on knowledge of Microsoft Purview, including data ...

role with purpose, influence and opportunity, ICAEW is a place where your future can truly take shape. We're looking for a Data Engineering Lead to join our team in Milton Keynes on a permanent basis. This role offers a salary of £75,000 - £85,000 per annum … track record leading data engineering delivery within a Microsoft-first environment - Azure Data Factory, Databricks, Synapse, Azure Data Lake Hands-on experience building and managing ETL/ELT pipelines, data lakes and data warehouses in a cloud environment Proficient ...

client stakeholders and internal delivery leadership Experience with multiple data storage technologies used in data warehouse and data lake solutions, such as: Relational DBMS, NoSQL, Graph databases, Cloud object storage & DB as a service Architecture and design concepts for ETL/ELT solutions … reporting and analytics Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling concepts Taking ownership of client requirements, deliverables and accountabilities, ensuring adherence to architecture governance processes, industry best practices and alignment with ...

sexual orientation, veteran status, or any basis prohibited by the laws that govern its operations.How does this role contribute to our collective success Data and analytics are of critical importance for AXIS. Simply put, we want to turn data into information, that can be used … related design and/or build work. The ideal experience would be working with data models and enterprise data lake/warehouse initiatives but a background in Software Engineering would also be useful.Experience in data analysis, data integration and data ...

Required Skills Data Architect Azure London Job Summary Data Architect – Insurance (Azure Data Platform) We're working with a leading organisation investing heavily in its data and analytics capabilities, and they're looking for an experienced Data Architect with … models, integration frameworks and enterprise data standards Lead the architecture of modern Azure-based data platforms, including Data Lake, Lakehouse and Data Warehouse environments Drive the design of scalable data pipelines, ETL/ELT frameworks and integration patterns Establish ...

that makes you unique is welcome; join us and let’s build what’s next - together!About the RoleWe're seeking a Principal Data Engineer who can work across the full stack of Anaplan’s data platform, setting the technical direction for how we ingest, transform … workflow orchestration tools (e.g., Apache Airflow, Dagster).Hands-on expertise with cloud data warehouses (e.g., Snowflake, BigQuery, Redshift) and data lake architectures (e.g., Databricks, Delta Lake, Apache Iceberg).Advanced SQL skills and proficiency in Python. Strong background in modern software development practices (testing, code ...