1 to 25 of 81 Remote/Hybrid Data Lake Jobs

Acquisitions, and Citi Commercial Bank client segments in over 100 countries. As a critical component of the TWCS Business Execution team, the Data Organization is responsible for establishing and implementing the overall data strategy and governance framework, ensuring high-quality data to drive business … value. This Director-level role is a senior global position responsible for defining and executing the data strategy and roadmap, aligned with various Lines of Business (LOBs) that act as domain owners for their respective products. The role is pivotal in delivering the Technology Book of Work assigned ...

build tool) – modelling layers, testing, documentation, incremental strategies Application Databases Data Integration AWS – S3, RDS, Aurora, Redshift (migration context), Glue, Lake Formation, IAM, VPC Data Governance Data lineage, cataloguing (Apache Atlas/Collibra/Snowflake Horizon), GDPR, BCBS … contracts, schema versioning Redis Cache invalidation, persistence strategy, data consistency MongoDB TimescaleDB NATS JetStream AWS S3/Glue Data lake staging, archival, batch ingestion into Snowflake Partitioning, file format (Parquet/ORC), Lake Formation governance Finance Domain Knowledge Candidates should have hands ...

insights that support strategic decision-making and operational performance. The role combines leadership of data engineering capability (including the data lake, pipelines and environments) with ownership of analytics and reporting outputs, ensuring data is transformed into accessible, trusted and actionable insight … Engineering & Platform Leadership * Lead the design, development and ongoing management of the Society's data architecture, including the data lake and associated data environments. * Ensure robust, scalable and secure data pipelines are in place to support timely and accurate data ...

warehouse architectures: Implement logical and physical data models, data quality controls, and governance practices using Amazon S3 (data lake), AWS Lake Formation, Amazon Redshift, and Amazon Athena to ensure trusted data.* Ability to design AI/ML-enabled solutions: Enable feature-ready … governed delivery.* Stay ahead of the curve: Continuously learn and adapt to the evolving AWS data and analytics landscape, including AWS Glue, Lake Formation, Redshift, Athena, EMR, and related best practices.* Define the platform operating model: Establish AWS multi-account strategies, environment separation (dev/test/ ...

IaaS, specifically: App Services, Azure SQL Database, SQL Server, Storage, Synapse Analytics, Purview, Databricks, Azure data Factory, Azure data lake & Fabric. Understand which Azure data focused components to use for which purpose.Microsoft certified architectDatabricksDesign and build high-performance data platforms: Utilize … Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services.Ability to Design, Build and deploy AI/ML models: Integrate Machine Learning into data pipelines, leverage Databricks ML and Azure ML to develop predictive ...

umbrella) Duration: Initial 6 months+ Robert Half are supporting a leading property and real estate organisation on a major Finance Data Lake and Data Transformation programme and are looking for an experienced Data Architect to join the team. This role requires a hands …/CI/CD experience within data environments Strong stakeholder engagement and solution design capabilities Experience delivering enterprise-scale data lake initiatives Desirable: Finance Data Lake programme experience Lead Data Engineering background Experience working within large transformation programmes Robert Half ...

Data Architect Permanent | Remote (UK) with occasional travel to London Up to £120k + bonus + benefits (depending on experience and level) All candidates must be eligible for UK Security Clearance (SC) Architect the Future of Enterprise Data Platforms Are you a Data Analytics … across the Microsoft data ecosystem, including: Microsoft Fabric Azure Databricks Azure Data Factory Azure Synapse Analytics Azure Data Lake Storage Strong understanding of modern data engineering concepts including: Data pipelines ETL/ELT frameworks Data ingestion patterns ...

reporting and analytics Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling concepts Taking ownership of client requirements, deliverables and accountabilities, ensuring adherence to architecture governance processes, industry best practices and alignment with … outcomes. We're looking for demonstrable experience in: Multiple data storage technologies used in data warehouse and data lake solutions, such as: o Relational DBMS o NoSQL o Graph databases o Cloud object storage o DB as a service Architecture and design concepts ...

Description The Role We are seeking a capable Consulting Data Architect to join our Insurance Technology Consulting practice and play a pivotal role in shaping, selling, and delivering data-led consulting engagements for insurance clients. Location: London, United Kingdom (Hybrid) Scope: UK-Based Role with Global … secure enterprise data platforms using technologies such as Microsoft Fabric, Azure Synapse Analytics, Azure Data Factory, Azure Data Lake, Databricks, and Snowflake. Data Management, Governance & Controls – Experience establishing data governance frameworks, operating models, metadata management, lineage, cataloguing, data ...

queries, stored procedures and analytical views within Azure Synapse Analytics. Manage data ingestion, transformation and storage across Azure Data Lake Storage (ADLS) and Azure SQL environments. Support processing of structured and semi-structured data formats, including Delta Lake and JSON. Collaborate with …/ELT pipelines. Experience with Change Data Capture (CDC) and data migration frameworks. Knowledge of Azure Data Lake Storage (ADLS) and Azure SQL Database. Experience working with Delta Lake and JSON data formats. Minimum 5 years' experience within cloud-based ...

time data pipelines that ingest data from legacy and modern platforms Lead the development of cloud-based data lake architectures within AWS Build streaming data solutions using Kafka Design and implement Medallion Architecture (Bronze, Silver, Gold layers) to support analytics … Essential Experience Strong hands-on expertise with Databricks Extensive experience using Spark, PySpark and SQL Proven track record designing and implementing data lake architectures Experience building both batch and streaming data pipelines Strong knowledge of Kafka Good understanding of AWS data services, particularly ...

will have the opportunity to design and develop scalable data pipelines, shape the architecture of a Microsoft-based data lake and work directly with senior stakeholders across technology and finance. Reporting to the Group IT Director, you will build and maintain data solutions … pipelines Building data architecture that brings together multiple business systems Developing and supporting a Microsoft-based enterprise data lake Designing and maintaining MS SQL databases and related data systems Building ETL and data transformation solutions using Databricks and Azure ...

within large-scale, complex environments. Strong experience designing modern cloud-based data platforms using AWS. Experience designing enterprise-scale Data Lake and Lakehouse architectures. Strong knowledge of Amazon S3 storage strategies, including Bronze, Silver and Gold data layer architectures. Experience designing scalable data … designs and supporting artefacts and design scalable ingestion patterns supporting databases, APIs and file-based integrations. You be involved with defining Data Lake and Lakehouse architecture using Amazon S3, supporting Bronze, Silver and Gold data layers, as well as design transformation, orchestration and processing patterns ...

client stakeholders and internal delivery leadership Experience with multiple data storage technologies used in data warehouse and data lake solutions, such as: Relational DBMS, NoSQL, Graph databases, Cloud object storage & DB as a service Architecture and design concepts for ETL/ELT solutions … reporting and analytics Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling concepts Taking ownership of client requirements, deliverables and accountabilities, ensuring adherence to architecture governance processes, industry best practices and alignment with ...

seeking an experienced Lead Cybersecurity Engineer to join a global Cybersecurity Science & Analytics team responsible for developing next-generation cybersecurity and data analytics capabilities. This is an excellent opportunity for a hands-on engineer with expertise in Azure Cloud, Data Engineering, Platform Engineering and DevOps … following technologies: Cloud & Infrastructure Microsoft Azure Azure Active Directory (Azure AD) Azure Data Factory Azure Databricks Azure Data Lake Azure Storage Azure Functions Azure Monitor Azure Logic Apps Kubernetes Azure DevOps Programming & Automation Python PowerShell Bash Terraform SQL Kusto Query Language (KQL) GitHub CI/ ...

controls and operational guardrails Technical Leadership & Standards Serve as the senior technical authority for the Databricks platform architecture Establish engineering best practices covering Delta Lake design, workload orchestration, compute optimization, and cost management Provide technical assurance across platform implementation activities delivered by internal teams and external partners Define reusable … stakeholder engagement, and consulting capabilities Experience translating business requirements into strategic platform architecture solutions Technical Skills Deep expertise in Databricks, including Lakehouse Architecture, Delta Lake, Unity Catalog, Workflows, and cluster management Strong experience designing cloud-native data platforms on AWS Hands‐on knowledge of AWS services including ...

Data Engineer – NPPV 3 Cleared – Contract – Outside IR35 – Hybrid – Midlands VIQU have partnered with a well-established public-sector organisation in the Midlands, who are seeking a Data Engineer to join a major RMS (Records Management System) replacement programme. The successful Data Engineer will … projects involving multiple source and target systems. Strong understanding of data modelling, relational databases, data warehousing, and data lake architectures. Hands-on experience with Microsoft Azure data services and cloud-based data platforms. Experience working with technologies such ...

Fabric Data Engineer Up to £70,000 - West London (Hybrid - 1 Day Onsite) We are partnering with a well-established international organisation operating within a sustainability-led sector that is investing heavily in its technology and data capabilities. As part of an ambitious digital transformation programme … particularly within Fabric Notebooks Exposure to Azure data technologies such as Azure Data Factory, Synapse Analytics or Data Lake What's on Offer Salary up to £70,000 Hybrid working model with 1 day per week onsite in West London Opportunity to work ...

Description As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by equipping them with robust data platforms. You'll also join a data team … mission to get data knowledge and skills out of silos and embedded into delivery teams. You'll also help implement efficient data pipelines & storage. Key Responsibilities Define, shape and perfect data strategies in central and local government. Help public sector teams understand the value ...

Senior Data Engineer £70,000 - £90,000 + Benefits Remote | UK Permanent Help shape the future of enterprise data. 167 Solutions is partnering with an established international organisation to recruit an experienced Senior Data Engineer to design, build and optimise modern cloud-based data … Factory, Microsoft Fabric, Synapse Analytics or Databricks. Experience designing modern ETL/ELT data pipelines. Strong understanding of Azure Data Lake and cloud-native data architectures. Experience using Git, Azure DevOps and CI/CD pipelines. Knowledge of data modelling, governance ...

pipelines Developing Power BI semantic models and supporting reporting solutions Engineering robust Azure Data Factory integrations Building secure Azure Data Lake solutions Working with SQL Server and advanced SQL development Delivering API integrations across internal and third-party systems Supporting Azure DevOps and CI/… also bring strong experience across: Microsoft Fabric (essential) Azure Synapse Analytics (essential) Power BI Azure Data Factory Azure Data Lake SQL Server ETL/ELT development Azure DevOps Git Enterprise cloud data engineering AI Experience We're looking for engineers who have already ...

Azure Databricks Data Lake Deployment Squad Lead** (Contract) Duration: Up until 31 March 2026 (Possibility for extension) Location: London/Hybrid (3 days per week on site) Rate: A highly competitive Umbrella Day Rate is available for suitable candidates Role Profile This role will manage a scrum … team that will ingest data required for the ECB Onboarding program into the EMEA Data Platform with a focus on data required by the EUAG Finance Department. Key Responsibilities: Facilitate efficient and effective software delivery from inception to go-live for the EMEA Data ...

Data Factory and Azure Databricks . Build data models and analytics solutions using Synapse Analytics and Azure Data Lake Storage . Develop and optimise ETL/ELT processes. Work directly with clients to understand requirements and deliver robust data solutions. Troubleshoot … with Microsoft Azure Data Engineering . Hands-on expertise with Azure Data Factory, Databricks, Synapse Analytics and Data Lake Storage . Development experience in Python, Scala or SQL . Knowledge of data modelling and analytics solutions. Excellent communication skills and experience ...

network, you ll bring your unique skills and perspectives to help pioneer progress and protect what matters most. We re looking for a Data Engineering and Architecture Manager to lead and drive the successful delivery of complex data and technology initiatives within a highly regulated environment. … This is a managerial role leading a team that will underpin data activities across the business ensuring that data is treated as an asset, is trusted, is securely shared and is visible to those that need it. You ll be working closely with functional and value ...

hiring a hands-on BI Architect to support the evolution of a cloud-based data platform, with a strong focus on data warehousing, analytics, and reporting. You'll work closely with BI Developers to design, build, and optimise end-to-end data solutions across … operating at architecture level - s trong Azure expertise across: Azure Data Factory (ADF) Azure Synapse/Azure SQL Azure Data Lake (ADLS) Exposure to Microsoft Fabric (highly desirable) Strong background in data warehousing and BI environments Excellent dimensional modelling (Kimball) experience Experience working ...