1 to 25 of 144 Data Lake Jobs in the UK

Acquisitions, and Citi Commercial Bank client segments in over 100 countries. As a critical component of the TWCS Business Execution team, the Data Organization is responsible for establishing and implementing the overall data strategy and governance framework, ensuring high-quality data to drive business … value. This Director-level role is a senior global position responsible for defining and executing the data strategy and roadmap, aligned with various Lines of Business (LOBs) that act as domain owners for their respective products. The role is pivotal in delivering the Technology Book of Work assigned ...

build tool) – modelling layers, testing, documentation, incremental strategies Application Databases Data Integration AWS – S3, RDS, Aurora, Redshift (migration context), Glue, Lake Formation, IAM, VPC Data Governance Data lineage, cataloguing (Apache Atlas/Collibra/Snowflake Horizon), GDPR, BCBS … contracts, schema versioning Redis Cache invalidation, persistence strategy, data consistency MongoDB TimescaleDB NATS JetStream AWS S3/Glue Data lake staging, archival, batch ingestion into Snowflake Partitioning, file format (Parquet/ORC), Lake Formation governance Finance Domain Knowledge Candidates should have hands ...

ready insights that support strategic decision-making and operational performance.The role combines leadership of data engineering capability (including the data lake, pipelines and environments) with ownership of analytics and reporting outputs, ensuring data is transformed into accessible, trusted and actionable insight … Engineering & Platform Leadership * Lead the design, development and ongoing management of the Society's data architecture, including the data lake and associated data environments.* Ensure robust, scalable and secure data pipelines are in place to support timely and accurate data ...

solutions* Evaluate and recommend architectural approaches for data storage, processing, and consumption, including lakehouse, data warehousing, and data lake patterns* Design technical architecture for cloud-based data platforms (AWS preferred: Redshift, Athena, S3, Glue)* Create and maintain architecture documentation, including data … tools that enhance Arriva's data and BI capabilities* Stay current with emerging trends including open table formats (Apache Iceberg, Delta Lake), data observability, real-time/streaming architectures, and cloud-native solutions* Conduct proofs-of-concept and technical assessments to validate new technologies before ...

solutions* Evaluate and recommend architectural approaches for data storage, processing, and consumption, including lakehouse, data warehousing, and data lake patterns* Design technical architecture for cloud-based data platforms (AWS preferred: Redshift, Athena, S3, Glue)* Create and maintain architecture documentation, including data … tools that enhance Arriva's data and BI capabilities* Stay current with emerging trends including open table formats (Apache Iceberg, Delta Lake), data observability, real-time/streaming architectures, and cloud-native solutions* Conduct proofs-of-concept and technical assessments to validate new technologies before ...

solutionsEvaluate and recommend architectural approaches for data storage, processing, and consumption, including lakehouse, data warehousing, and data lake patternsDesign technical architecture for cloud-based data platforms (AWS preferred: Redshift, Athena, S3, Glue)Create and maintain architecture documentation, including data … technologies and tools that enhance Arriva's data and BI capabilitiesStay current with emerging trends including open table formats (Apache Iceberg, Delta Lake), data observability, real-time/streaming architectures, and cloud-native solutionsConduct proofs-of-concept and technical assessments to validate new technologies before ...

IaaS, specifically: App Services, Azure SQL Database, SQL Server, Storage, Synapse Analytics, Purview, Databricks, Azure data Factory, Azure data lake & Fabric. Understand which Azure data focused components to use for which purpose.Microsoft certified architectDatabricksDesign and build high-performance data platforms: Utilize … Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services.Ability to Design, Build and deploy AI/ML models: Integrate Machine Learning into data pipelines, leverage Databricks ML and Azure ML to develop predictive ...

Asset Alliance Group - Head Of Data & Analytics Asset Alliance Group is part of the Arbuthnot Latham Banking Group. We serve the commercial vehicle, bus, coach, and general asset finance sectors with tailored award-winning lending, contract hire, rental and finance packages. We are a full-service finance … hands‐on experience with Azure cloud services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Data Lake Storage. Proficiency in programming languages such as Python, SQL, .Net, PowerBI. Previous experience working with various LLMs, Copilot, Agentforce and MuleSoft would be advantageous. ...

estate rather than inherit someone else's blueprint. Day to day, you will provide authoritative direction across Microsoft Fabric, Data Lake, Databricks, Informatica MDM and Salesforce Data Cloud, working closely with the Director of Data & Analytics, delivery portfolios, the Platform Architect … Director of Data and Analytics and associated delivery teams, ensuring solutions align to enterprise standards across Azure Fabric, Data Lake, Databricks, Informatica MDM, and Salesforce Data Cloud Lead the architectural design and governance of the key technology and data programmes, bringing ...

initiative delivery outcomes. The supplier will validate data across the full data lifecycle, including ingestion, transformation, data lake, data warehouse, reporting and BI, APIs, metadata, lineage, and reconciliation.**Assignment Tasks/Deliverables**Full Stack Data Quality Engineering:* Design … execute data quality testing across ingestion, transformation, warehouse, reporting/BI, APIs, metadata, lineage, and reconciliation layers.* Validate Snowflake data lake and data warehouse outputs against source systems, business rules, transformation logic, and reporting requirements.* Test ETL and ELT processes, dbt models ...

every report and every operational data feed at ECP, continue the migration of our data warehouse and data lake to a modern dimensional model, finish the rollout of a principle-of-least-privilege security model across a multi-server SQL estate, and continue … personally delivering target architecture for the ECP data estate the data warehouse, data hub, data lake, raw/ODS layers, dimensional model, audit and schema-change tracking, and the load schedules that tie them together. Hands-on T-SQL, stored procedure ...

accountability for end‐to‐end data architecture. Strong understanding of data modelling, data warehousing and data lake architectures (e.g. lakehouse patterns), and data integration using event driven and API led approaches. Experience designing architectures across hybrid cloud … MODCloud – ICE, ACE environments AWS data services (e.g. S3, Redshift, EKS, Kinesis) Azure data services (e.g. Data Lake, Synapse, AKS) GCP Kubernetes‐based platforms and containerised data services Telicent Understanding of NATO data standards, interoperability requirements, or multi‐national ...

Factory and Python enabling efficient data ingestion and transformation Develop and manage data solutions using Azure Data Lake, Synapse Analytics and other Azure data services Support integration and migration of key data sources Write, optimise and maintain … Data Engineer delivering solutions in cloud-based environments Strong hands-on experience with Azure Data Factory, Azure Data Lake and Azure Synapse Analytics Solid understanding of ETL processes, data integration and pipeline development Advanced SQL skills as well as Python/ ...

leading role across a modern Microsoft technology stack, including: Microsoft Fabric (Lakehouse, Warehouse & OneLake) Azure Data Factory Azure Data Lake Azure Synapse Analytics SQL Server & advanced SQL development Enterprise ETL/ELT pipelines Power BI semantic models and reporting API integrations across internal and third … data technologies. You'll ideally bring experience in: Microsoft Fabric Azure Data Factory Azure Synapse Analytics Azure Data Lake SQL Server ETL/ELT design API integration Azure DevOps Git Power BI data modelling Cloud-native data engineering ...

Mandatory Skills: Databricks (PySpark/Spark SQL) , DBT , Azure DevOps (Repos, Pipelines, CI/CD), SQL ,Azure Data Services (Data Lake, Data Factory) Strong experience with Databricks (PySpark/Spark SQL) Hands-on expertise in DBT Expertise in Azure DevOps (Repos, Pipelines …/CD) Proficiency in SQL and Python Experience with Azure Data Services (Data Lake, Data Factory) Strong knowledge of Data warehousing and ETL/ELT concepts Knowledge of Data governance and security best practices Design and Leading the team ...

Description The Role We are seeking a capable Consulting Data Architect to join our Insurance Technology Consulting practice and play a pivotal role in shaping, selling, and delivering data-led consulting engagements for insurance clients. Location: London, United Kingdom (Hybrid) Scope: UK-Based Role with Global … secure enterprise data platforms using technologies such as Microsoft Fabric, Azure Synapse Analytics, Azure Data Factory, Azure Data Lake, Databricks, and Snowflake. Data Management, Governance & Controls – Experience establishing data governance frameworks, operating models, metadata management, lineage, cataloguing, data ...

best practices, and provide guidance to both technical and non-technical stakeholders. The role includes working to the Information Manager and Head of Data, contributing to the direction of BI initiatives and supporting the wider information team with data analysis, ad hoc requests, national/regional … mandatory returns, FOIs, and data transformation work, primarily using SQL. Main duties of the job Business Intelligence Support: Provide information to support the clinical and business needs of the trust, adopting a subject matter expert (SME) role within an area or more, shape/lead on best practice ...

Senior Databricks Architect Technology: Databricks (Spark, PySpark/SQL) and data lake architectures. Location: London, UK. Compensation: Competitive (including bonus). Job Description We are looking for a Data Architect to design, build, and operate scalable data pipelines and data products … support analytics, reporting, and domain-owned data products. Primary Skills Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures. Hands‐on experience with streaming technologies, especially Kafka/Confluent Kafka. Experience integrating legacy data sources such as DB2 (mainframe ...

will have the opportunity to design and develop scalable data pipelines, shape the architecture of a Microsoft-based data lake and work directly with senior stakeholders across technology and finance. Reporting to the Group IT Director, you will build and maintain data solutions … pipelines Building data architecture that brings together multiple business systems Developing and supporting a Microsoft-based enterprise data lake Designing and maintaining MS SQL databases and related data systems Building ETL and data transformation solutions using Databricks and Azure ...

work. Join us and build for travelers everywhere.Expedia Group seeks a motivated and results-oriented Senior Software Engineer to join our Data Lake and Catalog team.As a Senior Software Engineer on an industry-leading data platform, you will build the core of Expedia Group … with tools like Circus Train , a Hive dataset replication tool, and Waggle Dance , a federation service that allows access to data lake tables across multiple catalogs. Recently, we added Hive support to Apache Iceberg , a high-performance open table format for large analytic datasets that underpins many ...

Role: Data Engineer Location: Remote but able to attend client sites in Doncaster/London Exp. Start Date: ASAP Contract Duration: 6 Months initially Rate: £500 per day (Umbrella) Job Specification: See attached Experience Oracle experience beneficial Snowflake experience Experience Working with Data teams IDMC, Kafka … data sources. Understanding of Data Architecture patterns/Data lakes/kimbol Practical experience of Platforms Cloud platforms structuring Data Relational database Snowflake going through the cloud platform Informatica experience Change data capture experience Working with various data ...

through to release, optimisation, and retirement Collaborate closely with product owners and data scientists to align platform capabilities with business needs Lead datalake migration initiatives, including consolidation of legacy data, medallion architecture design, schema evolution, and cutover planning Provide hands-on data engineering expertise … Databricks, AWS) Proven ability to design and manage scalable data pipelines, models, and schemas Solid SQL and relational database expertise Experience with datalake migration concepts (medallion architecture, incremental loads, backfill, cutover) Strong understanding of data governance, quality, and lifecycle management Experience with BI tools such ...

suffers from inconsistent definitions and manual processing. This position exists to fix these foundational issues, unify customer data into a single lake, and ensure that data is never an afterthought in our product lifecycle. It bridges the gap between technical execution and business value, enabling … analytics are baked into new features from day one, rather than added as an afterthought. Enable Personalisation: Build a unified customer data lake that allows for advanced cohort segmentation and personalised experiences for our fans. Leadership & Roadmap: Review and manage the Data & BI teams, setting ...

role with purpose, influence and opportunity, ICAEW is a place where your future can truly take shape. We're looking for a Data Engineering Lead to join our team in Milton Keynes on a permanent basis. This role offers a salary of £75,000 - £85,000 per annum … track record leading data engineering delivery within a Microsoft-first environment - Azure Data Factory, Databricks, Synapse, Azure Data Lake Hands-on experience building and managing ETL/ELT pipelines, data lakes and data warehouses in a cloud environment Proficient ...

Business Intelligence tools that are used to monitor compliance against the Trust Performance Assurance Framework, external and internal reporting requirements and escalating major data quality issues to the Information Manager and Head of Information. Main duties of the job Key responsibilities o To oversee the delivery … responsible for evaluating key business intelligence reports identified by pan organisational strategic developments, combining detailed operational awareness with knowledge of data and systems. Support cultural changes with regards to mobilisation and usage of business intelligence data. o To lead on the communication of complex technical specifications and intelligence ...