26 to 50 of 238 Data Lake Jobs in the UK

largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Who You'll Be Working With As a Data Solution Architect at Capgemini, you will design and lead the delivery of modern data platforms that enable analytics, AI, GenAI, and data … strong understanding of data warehousing, dimensional modelling, and lakehouse concepts. Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage/ADLS Gen2, Microsoft Fabric (OneLake, Workspaces, Capacity), Azure Synapse and/or SQL, and Azure Data Factory. Excellent problem-solving ...

reporting and analytics Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling concepts Taking ownership of client requirements, deliverables and accountabilities, ensuring adherence to architecture governance processes, industry best practices and alignment with … outcomes. We're looking for demonstrable experience in: Multiple data storage technologies used in data warehouse and data lake solutions, such as: o Relational DBMS o NoSQL o Graph databases o Cloud object storage o DB as a service Architecture and design concepts ...

Description The Role We are seeking a capable Consulting Data Architect to join our Insurance Technology Consulting practice and play a pivotal role in shaping, selling, and delivering data-led consulting engagements for insurance clients. Location: London, United Kingdom (Hybrid) Scope: UK-Based Role with Global … secure enterprise data platforms using technologies such as Microsoft Fabric, Azure Synapse Analytics, Azure Data Factory, Azure Data Lake, Databricks, and Snowflake. Data Management, Governance & Controls – Experience establishing data governance frameworks, operating models, metadata management, lineage, cataloguing, data ...

data migration using AWS-native tools such as DMS, Glue, DataSync, Step Functions, Redshift, Athena, Lambda, RDS, EC2, S3 Data Lake, and CloudWatch. Strong knowledge of data extraction, transformation, and loading (ETL) processes, leveraging tools such as Talend, Informatica, Matillion, Pentaho, MuleSoft, Boomi … security features (IAM, KMS, RBAC). Knowledge of Azure data engineering tools (ADF, Azure DB, Azure Synapse, Azure Data Lake, Azure Monitor) for hybrid migration scenarios. Proficiency with cloud automation/orchestration tools such as Terraform and Airflow. Strong analytical skills to assess data ...

reporting and analytics Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling concepts Taking ownership of client requirements, deliverables and accountabilities, ensuring adherence to architecture governance processes, industry best practices and alignment with … outcomes. We’re looking for demonstrable experience in: Multiple data storage technologies used in data warehouse and data lake solutions, such as: Relational DBMS NoSQL Graph databases Cloud object storage DB as a service Architecture and design concepts for ETL/ELT solutions ...

queries, stored procedures and analytical views within Azure Synapse Analytics. Manage data ingestion, transformation and storage across Azure Data Lake Storage (ADLS) and Azure SQL environments. Support processing of structured and semi-structured data formats, including Delta Lake and JSON. Collaborate with …/ELT pipelines. Experience with Change Data Capture (CDC) and data migration frameworks. Knowledge of Azure Data Lake Storage (ADLS) and Azure SQL Database. Experience working with Delta Lake and JSON data formats. Minimum 5 years' experience within cloud-based ...

reporting and analytics* Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling concepts* Taking ownership of client requirements, deliverables and accountabilities, ensuring adherence to architecture governance processes, industry best practices and alignment with … delivery outcomes.We're looking for demonstrable experience in:* Multiple data storage technologies used in data warehouse and data lake solutions, such as:o Relational DBMSo NoSQLo Graph databaseso Cloud object storageo DB as a service* Architecture and design concepts for ETL/ ...

Olympic Committee, and Mercedes-Benz. Our services span the full digital delivery lifecycle, including architecture, engineering, delivery management, user-centred design, business analysis, data, DevOps, and AI. We operate as a collaborative and inclusive organisation that empowers our people to take ownership, innovate, and develop their expertise. … approach, you’re comfortable engaging with clients, understanding their needs, and translating them into effective outcomes. The Role: We are looking for experienced Data Architects to work on our projects with our public sector clients, helping to deliver Solirius’ services to the highest standard. The role will involve ...

experience with Azure Cosmos DB, including data modelling, partitioning, indexing, throughput optimisation, and Change Feed processing. Experience with Azure Data Lake Storage (ADLS), OneLake, ABFS, and Azure Key Vault. Strong understanding of data modelling concepts, including temporal data patterns such … , including ISINs, CUSIPs, LEIs, PermIDs, and asset classifications. Experience with entity resolution, record matching platforms, and third-party enrichment services. Experience with Delta Lake and Change Data Feed (CDF) patterns. Knowledge of Cosmos DB SDK optimisation techniques, including bulk operations, optimistic concurrency, and RU optimisation. Experience ...

time data pipelines that ingest data from legacy and modern platforms Lead the development of cloud-based data lake architectures within AWS Build streaming data solutions using Kafka Design and implement Medallion Architecture (Bronze, Silver, Gold layers) to support analytics … Essential Experience Strong hands-on expertise with Databricks Extensive experience using Spark, PySpark and SQL Proven track record designing and implementing data lake architectures Experience building both batch and streaming data pipelines Strong knowledge of Kafka Good understanding of AWS data services, particularly ...

inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Data Solution Architect Position Description At CGI, we help organisations transform data into a strategic asset that drives innovation, informed decision-making … guiding technical delivery teams Desirable qualifications and expertise: Microsoft Fabric Azure Databricks Azure Synapse Analytics Azure Data Factory Azure Data Lake Storage Power BI Microsoft Purview AWS Glue AWS Lake Formation Amazon Redshift Amazon Athena Amazon EMR Amazon S3 SQL, Python, and PySpark ...

Senior Databricks Architect Technology: Databricks (Spark, PySpark/SQL) and data lake architectures. Location: London, UK. Compensation: Competitive (including bonus). Job Description We are looking for a Data Architect to design, build, and operate scalable data pipelines and data products … support analytics, reporting, and domain-owned data products. Primary Skills Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures. Hands‐on experience with streaming technologies, especially Kafka/Confluent Kafka. Experience integrating legacy data sources such as DB2 (mainframe ...

Role –Senior Databricks Architect Technology – Databricks (Spark, PySpark/SQL) and data lake architectures Location – London, UK Duration-Permanent Job Description We are looking for a Data Architect to design, build, and operate scalable data pipelines and data products, enabling … support analytics, reporting, and domain-owned data products. Primary Skills • Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures. • Hands-on experience with streaming technologies, especially Kafka/Confluent Kafka. • Experience integrating legacy data sources such as DB2 (mainframe ...

Venesky-Brown’s client, a public sector organisation in Glasgow, is currently looking to recruit Data Modeller for initial 8 month contracts with potential to extend on a rate of £526/day (Inside IR35). These roles will be hybrid working with a minimum of 2 days … week in their Glasgow office. Responsibilities: - The Data Modeller will be responsible for designing, developing, and maintaining high-quality data models and datamarts that support analytical and reporting needs. They will translate business requirements into scalable, performant, and well-structured data models that enable ...

will have the opportunity to design and develop scalable data pipelines, shape the architecture of a Microsoft-based data lake and work directly with senior stakeholders across technology and finance. Reporting to the Group IT Director, you will build and maintain data solutions … pipelines Building data architecture that brings together multiple business systems Developing and supporting a Microsoft-based enterprise data lake Designing and maintaining MS SQL databases and related data systems Building ETL and data transformation solutions using Databricks and Azure ...

member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Job Title : Cloud Data Engineer About the Job you are considering: We are seeking an experienced Cloud Data Engineer with expertise in AWS, Snowflake, dbt, PySpark … Manager Data Modelling Skills Star Schema Snowflake Schema Dimensional Modeling Data Vault Data Warehouse Design Data Lake Architecture Data Formats Experience working with: Parquet Avro JSON CSV ORC CI/CD & DevOps Git GitHub GitLab Bitbucket Jenkins GitHub Actions ...

optimise scalable ETL/ELT pipelines using modern cloud data integration and orchestration services Design and implement secure, scalable data lake, lakehouse, and analytics platforms supporting structured, semi-structured, and unstructured data Establish robust data governance, quality, lineage, metadata management … Azure Functions, Container Apps, Azure Kubernetes Service (AKS) Docker and Kubernetes Storage & Data Amazon S3, Azure Blob Storage, Azure Data Lake Storage Gen2 Amazon Aurora PostgreSQL, RDS, DynamoDB Azure Database for PostgreSQL, Azure SQL Database, Cosmos DB Integration & Messaging Amazon EventBridge, SQS, SNS, API Gateway ...

Data Engineer | Hybrid | South Wales | 3 months initially | Outside IR35 IntaPeople are excited to be appointed to recruit an experienced Data Engineer for a team that needs additional project resource for an interim period of time. You will be joining a small data team … modelling and data warehousing within platforms such as Azure. Practical experience with Microsoft Azure services, including Azure Data Lake (Gen2), Synapse, Event Hubs, and Cosmos DB, within scalable cloud -based architectures. Experience in using Git, Azure DevOps, or GitHub Actions for version control ...

work. Join us and build for travelers everywhere.Expedia Group seeks a motivated and results-oriented Senior Software Engineer to join our Data Lake and Catalog team.As a Senior Software Engineer on an industry-leading data platform, you will build the core of Expedia Group … with tools like Circus Train , a Hive dataset replication tool, and Waggle Dance , a federation service that allows access to data lake tables across multiple catalogs. Recently, we added Hive support to Apache Iceberg , a high-performance open table format for large analytic datasets that underpins many ...

within large-scale, complex environments. Strong experience designing modern cloud-based data platforms using AWS. Experience designing enterprise-scale Data Lake and Lakehouse architectures. Strong knowledge of Amazon S3 storage strategies, including Bronze, Silver and Gold data layer architectures. Experience designing scalable data … designs and supporting artefacts and design scalable ingestion patterns supporting databases, APIs and file-based integrations. You be involved with defining Data Lake and Lakehouse architecture using Amazon S3, supporting Bronze, Silver and Gold data layers, as well as design transformation, orchestration and processing patterns ...

Role: Data Engineer Location: Remote but able to attend client sites in Doncaster/London Exp. Start Date: ASAP Contract Duration: 6 Months initially Rate: £500 per day (Umbrella) Job Specification: See attached Experience Oracle experience beneficial Snowflake experience Experience Working with Data teams IDMC, Kafka … data sources. Understanding of Data Architecture patterns/Data lakes/kimbol Practical experience of Platforms Cloud platforms structuring Data Relational database Snowflake going through the cloud platform Informatica experience Change data capture experience Working with various data ...

suffers from inconsistent definitions and manual processing. This position exists to fix these foundational issues, unify customer data into a single lake, and ensure that data is never an afterthought in our product lifecycle. It bridges the gap between technical execution and business value, enabling … analytics are baked into new features from day one, rather than added as an afterthought. Enable Personalisation: Build a unified customer data lake that allows for advanced cohort segmentation and personalised experiences for our fans. Leadership & Roadmap: Review and manage the Data & BI teams, setting ...

Title: HR Data Delivery Lead Role Overview A new data lake solution is being implemented and the HR Data Delivery Lead will be responsible for end-to-end delivery of data products, pipelines, and reporting solutions across multiple teams. This role … will be accountable for connecting data from the new Oracle HCM Cloud to the new AWS Snowflake solution and unifying data layer between legacy and new HRIS system feed to data warehouse. The role ensures high-quality, timely, and governed delivery of data ...

Architect - London (Hybrid) - Databricks - Spark - PySpark - AWS - Up to £115,000 + Bonus Our client, a large-scale organisation undergoing significant investment in data and cloud technologies, is seeking an experienced Senior Databricks Architect to join its expanding Data & AI practice. This is an exciting opportunity … Data Engineer or Solutions Architect Strong expertise in Databricks, Apache Spark, PySpark and SQL Experience designing and implementing modern data lake or lakehouse architectures Hands-on experience with Kafka Strong understanding of AWS data services, particularly Amazon S3 Experience integrating data ...

Senior Data Engineer Market Data 5 day onsite We are looking for a Senior Data Engineer to build and operate a high-performance market data platform supporting quantitative research and production trading systems. You'll design scalable data pipelines, process … actions. Implement automated data quality, reconciliation and monitoring frameworks. Optimise data storage using Parquet, Arrow and modern data lake technologies. Partner with quantitative researchers, traders and engineering teams to deliver trusted datasets. Essential Skills Strong Python and SQL. Experience building scalable, production data ...