1 to 25 of 62 Remote/Hybrid Permanent Data Lake Jobs

Acquisitions, and Citi Commercial Bank client segments in over 100 countries. As a critical component of the TWCS Business Execution team, the Data Organization is responsible for establishing and implementing the overall data strategy and governance framework, ensuring high-quality data to drive business … value. This Director-level role is a senior global position responsible for defining and executing the data strategy and roadmap, aligned with various Lines of Business (LOBs) that act as domain owners for their respective products. The role is pivotal in delivering the Technology Book of Work assigned ...

build tool) – modelling layers, testing, documentation, incremental strategies Application Databases Data Integration AWS – S3, RDS, Aurora, Redshift (migration context), Glue, Lake Formation, IAM, VPC Data Governance Data lineage, cataloguing (Apache Atlas/Collibra/Snowflake Horizon), GDPR, BCBS … contracts, schema versioning Redis Cache invalidation, persistence strategy, data consistency MongoDB TimescaleDB NATS JetStream AWS S3/Glue Data lake staging, archival, batch ingestion into Snowflake Partitioning, file format (Parquet/ORC), Lake Formation governance Finance Domain Knowledge Candidates should have hands ...

insights that support strategic decision-making and operational performance. The role combines leadership of data engineering capability (including the data lake, pipelines and environments) with ownership of analytics and reporting outputs, ensuring data is transformed into accessible, trusted and actionable insight … Engineering & Platform Leadership * Lead the design, development and ongoing management of the Society's data architecture, including the data lake and associated data environments. * Ensure robust, scalable and secure data pipelines are in place to support timely and accurate data ...

warehouse architectures: Implement logical and physical data models, data quality controls, and governance practices using Amazon S3 (data lake), AWS Lake Formation, Amazon Redshift, and Amazon Athena to ensure trusted data.* Ability to design AI/ML-enabled solutions: Enable feature-ready … governed delivery.* Stay ahead of the curve: Continuously learn and adapt to the evolving AWS data and analytics landscape, including AWS Glue, Lake Formation, Redshift, Athena, EMR, and related best practices.* Define the platform operating model: Establish AWS multi-account strategies, environment separation (dev/test/ ...

IaaS, specifically: App Services, Azure SQL Database, SQL Server, Storage, Synapse Analytics, Purview, Databricks, Azure data Factory, Azure data lake & Fabric. Understand which Azure data focused components to use for which purpose.Microsoft certified architectDatabricksDesign and build high-performance data platforms: Utilize … Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services.Ability to Design, Build and deploy AI/ML models: Integrate Machine Learning into data pipelines, leverage Databricks ML and Azure ML to develop predictive ...

Data Architect Permanent | Remote (UK) with occasional travel to London Up to £120k + bonus + benefits (depending on experience and level) All candidates must be eligible for UK Security Clearance (SC) Architect the Future of Enterprise Data Platforms Are you a Data Analytics … across the Microsoft data ecosystem, including: Microsoft Fabric Azure Databricks Azure Data Factory Azure Synapse Analytics Azure Data Lake Storage Strong understanding of modern data engineering concepts including: Data pipelines ETL/ELT frameworks Data ingestion patterns ...

Description The Role We are seeking a capable Consulting Data Architect to join our Insurance Technology Consulting practice and play a pivotal role in shaping, selling, and delivering data-led consulting engagements for insurance clients. Location: London, United Kingdom (Hybrid) Scope: UK-Based Role with Global … secure enterprise data platforms using technologies such as Microsoft Fabric, Azure Synapse Analytics, Azure Data Factory, Azure Data Lake, Databricks, and Snowflake. Data Management, Governance & Controls – Experience establishing data governance frameworks, operating models, metadata management, lineage, cataloguing, data ...

time data pipelines that ingest data from legacy and modern platforms Lead the development of cloud-based data lake architectures within AWS Build streaming data solutions using Kafka Design and implement Medallion Architecture (Bronze, Silver, Gold layers) to support analytics … Essential Experience Strong hands-on expertise with Databricks Extensive experience using Spark, PySpark and SQL Proven track record designing and implementing data lake architectures Experience building both batch and streaming data pipelines Strong knowledge of Kafka Good understanding of AWS data services, particularly ...

will have the opportunity to design and develop scalable data pipelines, shape the architecture of a Microsoft-based data lake and work directly with senior stakeholders across technology and finance. Reporting to the Group IT Director, you will build and maintain data solutions … pipelines Building data architecture that brings together multiple business systems Developing and supporting a Microsoft-based enterprise data lake Designing and maintaining MS SQL databases and related data systems Building ETL and data transformation solutions using Databricks and Azure ...

controls and operational guardrails Technical Leadership & Standards Serve as the senior technical authority for the Databricks platform architecture Establish engineering best practices covering Delta Lake design, workload orchestration, compute optimization, and cost management Provide technical assurance across platform implementation activities delivered by internal teams and external partners Define reusable … stakeholder engagement, and consulting capabilities Experience translating business requirements into strategic platform architecture solutions Technical Skills Deep expertise in Databricks, including Lakehouse Architecture, Delta Lake, Unity Catalog, Workflows, and cluster management Strong experience designing cloud-native data platforms on AWS Hands‐on knowledge of AWS services including ...

Fabric Data Engineer Up to £70,000 - West London (Hybrid - 1 Day Onsite) We are partnering with a well-established international organisation operating within a sustainability-led sector that is investing heavily in its technology and data capabilities. As part of an ambitious digital transformation programme … particularly within Fabric Notebooks Exposure to Azure data technologies such as Azure Data Factory, Synapse Analytics or Data Lake What's on Offer Salary up to £70,000 Hybrid working model with 1 day per week onsite in West London Opportunity to work ...

Description As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by equipping them with robust data platforms. You'll also join a data team … mission to get data knowledge and skills out of silos and embedded into delivery teams. You'll also help implement efficient data pipelines & storage. Key Responsibilities Define, shape and perfect data strategies in central and local government. Help public sector teams understand the value ...

Senior Data Engineer £70,000 - £90,000 + Benefits Remote | UK Permanent Help shape the future of enterprise data. 167 Solutions is partnering with an established international organisation to recruit an experienced Senior Data Engineer to design, build and optimise modern cloud-based data … Factory, Microsoft Fabric, Synapse Analytics or Databricks. Experience designing modern ETL/ELT data pipelines. Strong understanding of Azure Data Lake and cloud-native data architectures. Experience using Git, Azure DevOps and CI/CD pipelines. Knowledge of data modelling, governance ...

pipelines Developing Power BI semantic models and supporting reporting solutions Engineering robust Azure Data Factory integrations Building secure Azure Data Lake solutions Working with SQL Server and advanced SQL development Delivering API integrations across internal and third-party systems Supporting Azure DevOps and CI/… also bring strong experience across: Microsoft Fabric (essential) Azure Synapse Analytics (essential) Power BI Azure Data Factory Azure Data Lake SQL Server ETL/ELT development Azure DevOps Git Enterprise cloud data engineering AI Experience We're looking for engineers who have already ...

Data Factory and Azure Databricks . Build data models and analytics solutions using Synapse Analytics and Azure Data Lake Storage . Develop and optimise ETL/ELT processes. Work directly with clients to understand requirements and deliver robust data solutions. Troubleshoot … with Microsoft Azure Data Engineering . Hands-on expertise with Azure Data Factory, Databricks, Synapse Analytics and Data Lake Storage . Development experience in Python, Scala or SQL . Knowledge of data modelling and analytics solutions. Excellent communication skills and experience ...

network, you ll bring your unique skills and perspectives to help pioneer progress and protect what matters most. We re looking for a Data Engineering and Architecture Manager to lead and drive the successful delivery of complex data and technology initiatives within a highly regulated environment. … This is a managerial role leading a team that will underpin data activities across the business ensuring that data is treated as an asset, is trusted, is securely shared and is visible to those that need it. You ll be working closely with functional and value ...

Senior Data Engineer – Azure/Databricks £70,000 + bonus Hybrid Working – 1 day on-site per week East Midlands based I'm working with a business that's continuing to invest in its Azure data platform and is looking for a Senior Data … evolution of the Azure data platform Key experience: Azure Databricks Azure Data Factory Azure Synapse Analytics Azure Data Lake Storage Advanced SQL and Python CI/CD with Azure DevOps Strong stakeholder engagement and communication skills What's on offer: Flexible hybrid working ...

Data Engineer Location: Newcastle upon Tyne Salary: Up to £80,000 The Opportunity We are seeking a Data Engineer to join a growing data team responsible for developing and maintaining a modern cloud-based data platform. This role offers the opportunity … work on large-scale data challenges, build robust data solutions and contribute to the continued evolution of the organisation's data capabilities. The successful candidate will play a key role in designing, developing and optimising data pipelines that support reporting, analytics ...

validate all technical designs and implementation plans of the 3rd party SI/vendors Provide technical knowledge and understand of existing applications, data & integration configuration Own collation and delivery of Control Risks’ Non‐Functional Requirements to the project Accountable for the assurance of the technical design, system configuration … Agile environment Desirable Implementing and supporting Microsoft D365 solutions, Microsoft Power Platform solutions and Microsoft Data solutions (Data Lake, Data Factory, Data Warehouse) MS SQL DB, TSQL language, ETL, SSRS, SSIS Experience Dataverse, Common Data Services, Synapse Experience Strong ...

SENIOR DATA ENGINEER£63,500 - Hybrid Working (2 days a week in office) - Bridgend, Wales. Your new company The company is a not-for-profit housing association established in 2003 as the first large-scale voluntary transfer of council-owned homes to a social housing provider in Wales. … reliable "single version of the truth" for reporting and analytics;- Design and deploy secure, scalable ELT or ETL pipelines using Databricks (Unity Catalog), Delta Lake, and Azure Data Lake Storage (ADLS);- Implement shift-left security principles within the data ingestion layer, including automated data ...

impressive multinational firm is looking for an accomplished Data Architect to join its team. Please note the role is hybrid – you will work from the office 3 days per week with 2 from home.In this role, you will be responsible for designing, developing, and maintaining scalable data … Fabric and Azure data services, including technologies such as Databricks, Data Factory, Azure SQL Managed Instances, and Data Lake solutions. You will have a proven track record of designing and optimising data warehouses and large-scale data platforms, supported ...

impressive multinational firm is looking for an accomplished Data Architect to join its team. Please note the role is hybrid – you will work from the office 3 days per week with 2 from home.In this role, you will be responsible for designing, developing, and maintaining scalable data … Fabric and Azure data services, including technologies such as Databricks, Data Factory, Azure SQL Managed Instances, and Data Lake solutions. You will have a proven track record of designing and optimising data warehouses and large-scale data platforms, supported ...

# Senior Data Architect - London, UK - FulltimeLondonApply for this job* Permanent* Experienced Professionals* Architecture* ID 522521-en\_GB**About the Job you are considering:**Join Capgemini’s **Integration & Data (I&D)** practice, where we **Consult with Purpose, Continuously Evolve, and Architect Tomorrow**. As a **Data … Cloudera in AWS taking the lead on the delivery from an data design perspective* Design end-to-end data lake and distributed data solutions to meet business needs within the context of a broader solution implementation* Contributor to overall solution planning providing input ...

impressive multinational firm is looking for an accomplished Data Engineer to join its team. Please note the role is hybrid – you will work from the office 3 days per week with 2 from home. In this role, you will be responsible for designing, developing, and maintaining scalable data … Data Engineer with hands-on experience with Azure data services, including Databricks, Data Factory and Data Lake solutions. You will have a proven track record of designing and optimising data warehouses and large-scale data platforms, supported ...

Lakehouse solutions supporting critical business data. What you'll be doing Leading Azure Databricks architecture Designing enterprise Lakehouse solutions Building scalable Spark and Delta Lake pipelines Designing streaming and batch data platforms Driving engineering best practice Mentoring engineers Working closely with senior business stakeholders Defining future-state … data architecture Technical Environment Azure Databricks Apache Spark/PySpark Delta Lake Azure Data Factory Azure Data Lake Gen2 Azure Event Hubs Azure Synapse Python SQL Terraform CI/CD Medallion Architecture We're looking for Expert Databricks experience Strong Azure Data ...