1 to 25 of 150 Data Lake Jobs in England

Acquisitions, and Citi Commercial Bank client segments in over 100 countries. As a critical component of the TWCS Business Execution team, the Data Organization is responsible for establishing and implementing the overall data strategy and governance framework, ensuring high-quality data to drive business … value. This Director-level role is a senior global position responsible for defining and executing the data strategy and roadmap, aligned with various Lines of Business (LOBs) that act as domain owners for their respective products. The role is pivotal in delivering the Technology Book of Work assigned ...

build tool) – modelling layers, testing, documentation, incremental strategies Application Databases Data Integration AWS – S3, RDS, Aurora, Redshift (migration context), Glue, Lake Formation, IAM, VPC Data Governance Data lineage, cataloguing (Apache Atlas/Collibra/Snowflake Horizon), GDPR, BCBS … contracts, schema versioning Redis Cache invalidation, persistence strategy, data consistency MongoDB TimescaleDB NATS JetStream AWS S3/Glue Data lake staging, archival, batch ingestion into Snowflake Partitioning, file format (Parquet/ORC), Lake Formation governance Finance Domain Knowledge Candidates should have hands ...

Acquisitions, and Citi Commercial Bank client segments in over 100 countries. As a critical component of the TWCS Business Execution team, the Data Organization is responsible for establishing and implementing the overall data strategy and governance framework, ensuring high‐quality data to drive business … value. This Director‐level role is senior and global, responsible for defining and executing the data strategy and roadmap in alignment with various Lines of Business (LOBs) that act as domain owners for their respective products. The role is pivotal in delivering the Technology Book of Work assigned ...

solutions* Evaluate and recommend architectural approaches for data storage, processing, and consumption, including lakehouse, data warehousing, and data lake patterns* Design technical architecture for cloud-based data platforms (AWS preferred: Redshift, Athena, S3, Glue)* Create and maintain architecture documentation, including data … tools that enhance Arriva's data and BI capabilities* Stay current with emerging trends including open table formats (Apache Iceberg, Delta Lake), data observability, real-time/streaming architectures, and cloud-native solutions* Conduct proofs-of-concept and technical assessments to validate new technologies before ...

solutions* Evaluate and recommend architectural approaches for data storage, processing, and consumption, including lakehouse, data warehousing, and data lake patterns* Design technical architecture for cloud-based data platforms (AWS preferred: Redshift, Athena, S3, Glue)* Create and maintain architecture documentation, including data … tools that enhance Arriva's data and BI capabilities* Stay current with emerging trends including open table formats (Apache Iceberg, Delta Lake), data observability, real-time/streaming architectures, and cloud-native solutions* Conduct proofs-of-concept and technical assessments to validate new technologies before ...

solutionsEvaluate and recommend architectural approaches for data storage, processing, and consumption, including lakehouse, data warehousing, and data lake patternsDesign technical architecture for cloud-based data platforms (AWS preferred: Redshift, Athena, S3, Glue)Create and maintain architecture documentation, including data … technologies and tools that enhance Arriva's data and BI capabilitiesStay current with emerging trends including open table formats (Apache Iceberg, Delta Lake), data observability, real-time/streaming architectures, and cloud-native solutionsConduct proofs-of-concept and technical assessments to validate new technologies before ...

IaaS, specifically: App Services, Azure SQL Database, SQL Server, Storage, Synapse Analytics, Purview, Databricks, Azure data Factory, Azure data lake & Fabric. Understand which Azure data focused components to use for which purpose.Microsoft certified architectDatabricksDesign and build high-performance data platforms: Utilize … Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services.Ability to Design, Build and deploy AI/ML models: Integrate Machine Learning into data pipelines, leverage Databricks ML and Azure ML to develop predictive ...

estate rather than inherit someone else's blueprint. Day to day, you will provide authoritative direction across Microsoft Fabric, Data Lake, Databricks, Informatica MDM and Salesforce Data Cloud, working closely with the Director of Data & Analytics, delivery portfolios, the Platform Architect … Director of Data and Analytics and associated delivery teams, ensuring solutions align to enterprise standards across Azure Fabric, Data Lake, Databricks, Informatica MDM, and Salesforce Data Cloud Lead the architectural design and governance of the key technology and data programmes, bringing ...

initiative delivery outcomes. The supplier will validate data across the full data lifecycle, including ingestion, transformation, data lake, data warehouse, reporting and BI, APIs, metadata, lineage, and reconciliation.**Assignment Tasks/Deliverables**Full Stack Data Quality Engineering:* Design … execute data quality testing across ingestion, transformation, warehouse, reporting/BI, APIs, metadata, lineage, and reconciliation layers.* Validate Snowflake data lake and data warehouse outputs against source systems, business rules, transformation logic, and reporting requirements.* Test ETL and ELT processes, dbt models ...

every report and every operational data feed at ECP, continue the migration of our data warehouse and data lake to a modern dimensional model, finish the rollout of a principle-of-least-privilege security model across a multi-server SQL estate, and continue … personally delivering target architecture for the ECP data estate the data warehouse, data hub, data lake, raw/ODS layers, dimensional model, audit and schema-change tracking, and the load schedules that tie them together. Hands-on T-SQL, stored procedure ...

reporting and analytics * Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling concepts * Taking ownership of client requirements, deliverables and accountabilities, ensuring adherence to architecture governance processes, industry best practices and alignment with … outcomes. We're looking for demonstrable experience in: * Multiple data storage technologies used in data warehouse and data lake solutions, such as: o Relational DBMS o NoSQL o Graph databases o Cloud object storage o DB as a service * Architecture and design concepts ...

accountability for end‐to‐end data architecture. Strong understanding of data modelling, data warehousing and data lake architectures (e.g. lakehouse patterns), and data integration using event driven and API led approaches. Experience designing architectures across hybrid cloud … MODCloud – ICE, ACE environments AWS data services (e.g. S3, Redshift, EKS, Kinesis) Azure data services (e.g. Data Lake, Synapse, AKS) GCP Kubernetes‐based platforms and containerised data services Telicent Understanding of NATO data standards, interoperability requirements, or multi‐national ...

leading role across a modern Microsoft technology stack, including: Microsoft Fabric (Lakehouse, Warehouse & OneLake) Azure Data Factory Azure Data Lake Azure Synapse Analytics SQL Server & advanced SQL development Enterprise ETL/ELT pipelines Power BI semantic models and reporting API integrations across internal and third … data technologies. You'll ideally bring experience in: Microsoft Fabric Azure Data Factory Azure Synapse Analytics Azure Data Lake SQL Server ETL/ELT design API integration Azure DevOps Git Power BI data modelling Cloud-native data engineering ...

Description The Role We are seeking a capable Consulting Data Architect to join our Insurance Technology Consulting practice and play a pivotal role in shaping, selling, and delivering data-led consulting engagements for insurance clients. Location: London, United Kingdom (Hybrid) Scope: UK-Based Role with Global … secure enterprise data platforms using technologies such as Microsoft Fabric, Azure Synapse Analytics, Azure Data Factory, Azure Data Lake, Databricks, and Snowflake. Data Management, Governance & Controls – Experience establishing data governance frameworks, operating models, metadata management, lineage, cataloguing, data ...

data migration using AWS-native tools such as DMS, Glue, DataSync, Step Functions, Redshift, Athena, Lambda, RDS, EC2, S3 Data Lake, and CloudWatch. Strong knowledge of data extraction, transformation, and loading (ETL) processes, leveraging tools such as Talend, Informatica, Matillion, Pentaho, MuleSoft, Boomi … security features (IAM, KMS, RBAC). Knowledge of Azure data engineering tools (ADF, Azure DB, Azure Synapse, Azure Data Lake, Azure Monitor) for hybrid migration scenarios. Proficiency with cloud automation/orchestration tools such as Terraform and Airflow. Strong analytical skills to assess data ...

queries, stored procedures and analytical views within Azure Synapse Analytics. Manage data ingestion, transformation and storage across Azure Data Lake Storage (ADLS) and Azure SQL environments. Support processing of structured and semi-structured data formats, including Delta Lake and JSON. Collaborate with …/ELT pipelines. Experience with Change Data Capture (CDC) and data migration frameworks. Knowledge of Azure Data Lake Storage (ADLS) and Azure SQL Database. Experience working with Delta Lake and JSON data formats. Minimum 5 years' experience within cloud-based ...

experience with Azure Cosmos DB, including data modelling, partitioning, indexing, throughput optimisation, and Change Feed processing. Experience with Azure Data Lake Storage (ADLS), OneLake, ABFS, and Azure Key Vault. Strong understanding of data modelling concepts, including temporal data patterns such … , including ISINs, CUSIPs, LEIs, PermIDs, and asset classifications. Experience with entity resolution, record matching platforms, and third-party enrichment services. Experience with Delta Lake and Change Data Feed (CDF) patterns. Knowledge of Cosmos DB SDK optimisation techniques, including bulk operations, optimistic concurrency, and RU optimisation. Experience ...

Senior Databricks Architect Technology: Databricks (Spark, PySpark/SQL) and data lake architectures. Location: London, UK. Compensation: Competitive (including bonus). Job Description We are looking for a Data Architect to design, build, and operate scalable data pipelines and data products … support analytics, reporting, and domain-owned data products. Primary Skills Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures. Hands‐on experience with streaming technologies, especially Kafka/Confluent Kafka. Experience integrating legacy data sources such as DB2 (mainframe ...

will have the opportunity to design and develop scalable data pipelines, shape the architecture of a Microsoft-based data lake and work directly with senior stakeholders across technology and finance. Reporting to the Group IT Director, you will build and maintain data solutions … pipelines Building data architecture that brings together multiple business systems Developing and supporting a Microsoft-based enterprise data lake Designing and maintaining MS SQL databases and related data systems Building ETL and data transformation solutions using Databricks and Azure ...

work. Join us and build for travelers everywhere.Expedia Group seeks a motivated and results-oriented Senior Software Engineer to join our Data Lake and Catalog team.As a Senior Software Engineer on an industry-leading data platform, you will build the core of Expedia Group … with tools like Circus Train , a Hive dataset replication tool, and Waggle Dance , a federation service that allows access to data lake tables across multiple catalogs. Recently, we added Hive support to Apache Iceberg , a high-performance open table format for large analytic datasets that underpins many ...

Role: Data Engineer Location: Remote but able to attend client sites in Doncaster/London Exp. Start Date: ASAP Contract Duration: 6 Months initially Rate: £500 per day (Umbrella) Job Specification: See attached Experience Oracle experience beneficial Snowflake experience Experience Working with Data teams IDMC, Kafka … data sources. Understanding of Data Architecture patterns/Data lakes/kimbol Practical experience of Platforms Cloud platforms structuring Data Relational database Snowflake going through the cloud platform Informatica experience Change data capture experience Working with various data ...

through to release, optimisation, and retirement Collaborate closely with product owners and data scientists to align platform capabilities with business needs Lead datalake migration initiatives, including consolidation of legacy data, medallion architecture design, schema evolution, and cutover planning Provide hands-on data engineering expertise … Databricks, AWS) Proven ability to design and manage scalable data pipelines, models, and schemas Solid SQL and relational database expertise Experience with datalake migration concepts (medallion architecture, incremental loads, backfill, cutover) Strong understanding of data governance, quality, and lifecycle management Experience with BI tools such ...

Title: HR Data Delivery Lead Role Overview A new data lake solution is being implemented and the HR Data Delivery Lead will be responsible for end-to-end delivery of data products, pipelines, and reporting solutions across multiple teams. This role … will be accountable for connecting data from the new Oracle HCM Cloud to the new AWS Snowflake solution and unifying data layer between legacy and new HRIS system feed to data warehouse. The role ensures high-quality, timely, and governed delivery of data ...

role with purpose, influence and opportunity, ICAEW is a place where your future can truly take shape. We're looking for a Data Engineering Lead to join our team in Milton Keynes on a permanent basis. This role offers a salary of £75,000 - £85,000 per annum … track record leading data engineering delivery within a Microsoft-first environment - Azure Data Factory, Databricks, Synapse, Azure Data Lake Hands-on experience building and managing ETL/ELT pipelines, data lakes and data warehouses in a cloud environment Proficient ...

Business Intelligence tools that are used to monitor compliance against the Trust Performance Assurance Framework, external and internal reporting requirements and escalating major data quality issues to the Information Manager and Head of Information. Main duties of the job Key responsibilities o To oversee the delivery … responsible for evaluating key business intelligence reports identified by pan organisational strategic developments, combining detailed operational awareness with knowledge of data and systems. Support cultural changes with regards to mobilisation and usage of business intelligence data. o To lead on the communication of complex technical specifications and intelligence ...