1 to 25 of 178 Remote Permanent Data Lake Jobs

self-testing pipelines that proactively identify processing issues or discrepancies. You'll build solutions that pipe transform data into data lake storage areas, physical database models and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. … Databricks administration and pyspark. Data Factory/Synapse Workspace - for building data pipelines or synapse analytics pipelines. Data Lake - Delta Lake design pattern implementation experience in Azure Data Lake Gen2 with file hierarchy namespace and low-level permissions management. … Architecture - Knowledge or experience in implementing, Kimball style Data Warehouse. Experience in building Metadata with Azure Purview or Data Lake Gen2. Data Quality - Experience in applying Data Quality rules within Azure Data Flow Activities. Data Transformation More ❯

self-testing pipelines that proactively identify processing issues or discrepancies. You'll build solutions that pipe transform data into data lake storage areas, physical database models and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. … Databricks administration and pyspark. Data Factory/Synapse Workspace - for building data pipelines or synapse analytics pipelines. Data Lake - Delta Lake design pattern implementation experience in Azure Data Lake Gen2 with file hierarchy namespace and low-level permissions management. … Architecture - Knowledge or experience in implementing, Kimball style Data Warehouse. Experience in building Metadata with Azure Purview or Data Lake Gen2. Data Quality - Experience in applying Data Quality rules within Azure Data Flow Activities. Data Transformation More ❯

self-testing pipelines that proactively identify processing issues or discrepancies. You'll build solutions that pipe transform data into data lake storage areas, physical database models and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. … Databricks administration and pyspark. Data Factory/Synapse Workspace - for building data pipelines or synapse analytics pipelines. Data Lake - Delta Lake design pattern implementation experience in Azure Data Lake Gen2 with file hierarchy namespace and low-level permissions management. … Architecture - Knowledge or experience in implementing, Kimball style Data Warehouse. Experience in building Metadata with Azure Purview or Data Lake Gen2. Data Quality - Experience in applying Data Quality rules within Azure Data Flow Activities. Data Transformation More ❯

advantage, and its technology-led service provides access to all major exchanges, order-flow management via screen, voice and DMA, plus award-winning data, insights and analytics. The Technology Department delivers differentiation, scalability and security for the business. Reporting to the COO, Technology provides digital tools, software services … our enterprise-wide services to end users and actively manages the firm's infrastructure and data. Within IT, Marex Technology has established a Data team that enables the firm to leverage data assets to increase productivity and improve business decisions, as well as maintain data … of the risk and compliance requirements associated with this. • Oracle Database • MongoDB • Cloud Data Technologies (Mainly Azure - SQL Database, Data Lake, HD Insight, Data Factory etc.) • A collaborative team player, approachable, self-efficient and influences a positive work environment • Demonstrates curiosity • Resilient in More ❯

We are looking for an experienced Cloud Data Architect to join our Data (Migration) team and drive the architecture, design, and implementation of customers modern data platforms. The ideal candidate will have extensive experience migrating traditional data warehouse technologies, including Teradata, Oracle … BW, Hadoop to modern cloud data platforms like Databricks, Snowflake, Redshift, Bigquery, or Microsoft fabric. You will be responsible for leading data platform migrations and the design and development of scalable data solutions that support our organization's strategic goals. Data Architecture … and Strategy: Lead the development and implementation of data architecture strategies that align with business objectives. Design and oversee the architecture of enterprise data warehouses, data lakes, and big data platforms. Establish best practices and standards for data modeling, integration More ❯

Senior Data Engineer Job Type : Permanent Location: London – Hybrid/flexible Salary: £55,000 - £70,0000 Consultant: Mags Rendle Excellent career opportunity! The Organisation TDRC are excited to be once again working with one of the UK’s leading Wealth Management firms. Through their robust infrastructure, cutting edge … and optimising Azure Data Factory (ADF) pipelines, working with SQL Server (designing and populating data schemas), Azure Data Lake, and Power BI, and integrating machine learning and AI models into our data processes. Experience with Azure Synapse Analytics is beneficial as … in implementing machine learning models within Azure Machine Learning to enhance reporting and predictive analytics. Data Storage & Processing Azure Data Lake: Knowledge of Azure Data Lake for efficient storage and retrieval of large datasets. Azure Synapse Analytics (Familiarity): Familiarity with Azure Synapse More ❯

Senior Data Engineer Job Type : Permanent Location: London – Hybrid/flexible Salary: £55,000 - £70,0000 Consultant: Mags Rendle Excellent career opportunity! The Organisation TDRC are excited to be once again working with one of the UK’s leading Wealth Management firms. Through their robust infrastructure, cutting edge … and optimising Azure Data Factory (ADF) pipelines, working with SQL Server (designing and populating data schemas), Azure Data Lake, and Power BI, and integrating machine learning and AI models into our data processes. Experience with Azure Synapse Analytics is beneficial as … in implementing machine learning models within Azure Machine Learning to enhance reporting and predictive analytics. Data Storage & Processing Azure Data Lake: Knowledge of Azure Data Lake for efficient storage and retrieval of large datasets. Azure Synapse Analytics (Familiarity): Familiarity with Azure Synapse More ❯

Enterprise Data Architect - Hybrid Working out of Southampton or London - £150,000+ package - FS brand This position provides strategic technology leadership, focusing on the development, maintenance, communication, and governance of the organisation's technology strategy, architecture, and roadmaps. The role emphasises balancing business objectives, industry trends, innovation, and … Azure-hosted data and digital capabilities. Its data platform is built on a Lakehouse architecture using Azure Data Lake and Microsoft-based data services. This platform supports reporting, analytics, and insights and is evolving to deliver advanced business intelligence. Experience and … Skills Data Warehousing and Data Lakes (e.g., Azure Data Lake) Reporting and analytics tools (e.g., Power BI) Analytics, Data Mining, and Data Science Data integration, migration, and ETL processes Master and reference data management Data More ❯

and quality of work differentiates us. We always support our people and customers to achieve shared, agreed goals. Role Description As a Principle Data Architect, you will work collaboratively across all aspects of project delivery and client engagement, from pre-sales and project scope definition, to project delivery … and hypercare. You will lead the conversation with HSO's customers and define the vision for better use of data across their organisation. You will own the technical design and manage the delivery of data & analytics solutions to HSO's customers. You will be highly experienced … data modelling Exposure and experience of Azure data and analytics products and services (SQL and NOSQL databases, data lake, data factory, synapse, data bricks, PowerBI, Fabric, MDM, Purview, Profisee.) Experience of working at a senior level with technology stakeholders More ❯

The AI Engineer is a key role in the Data Platform Portfolio team, building the data platform, driving value from data across the business. With strong technical skills and business acumen to help turn millions of potential data points into actionable insights … our customer retention rates, and drive operating efficiencies across the business. The primary goals of the team are: To build and run a data platform which can create and deliver analytics to colleagues and deliver regulatory reporting Ingest and transform data from multiple systems, modelling data … or outliers. Proficient in designing and implementing ELT pipelines using tools like dbt, with strong knowledge of data warehousing, data lake concepts, and data pipeline optimization. Skilled in SQL for data manipulation, analysis, query optimisation, and database design. Artificial Intelligence and More ❯

The AI Engineer is a key role in the Data Platform Portfolio team, building the data platform, driving value from data across the business. With strong technical skills and business acumen to help turn millions of potential data points into actionable insights … our customer retention rates, and drive operating efficiencies across the business. The primary goals of the team are: To build and run a data platform which can create and deliver analytics to colleagues and deliver regulatory reporting. Ingest and transform data from multiple systems, modelling data … or outliers. Proficient in designing and implementing ELT pipelines using tools like dbt, with strong knowledge of data warehousing, data lake concepts, and data pipeline optimization. Skilled in SQL for data manipulation, analysis, query optimisation, and database design. Artificial Intelligence and More ❯

services we help our clients connect and communicate better with their customers. As we continue to grow, we are seeking a talented Martech Data Engineer to join our team, focusing on implementing and optimizing a fully integrated Martech stack for an international client. In this role, you'll … ll work closely with their marketing, analytics, and product teams to build and optimize a scalable architecture, including managing an Azure Data Lake Gen2, Azure Data Factory, Snowflake warehouse, and RudderStack for customer data flows. Your responsibilities will include designing and maintaining data … experience you will bring: Experience: 3+ years in data engineering or martech engineering roles. Technical Proficiency: Expertise with Azure Data Lake Gen2, Azure Data Factory and Snowflake. Experience with Looker Studio for visualization. Proficiency with RudderStack or similar customer data platforms. More ❯

Head of Data – ERP Implementation Head of Data – ERP Implementation The location of the role is London (hybrid working) . The duration of the contract is 12 months . The pay rate on offer is £1000 - £1200 per day (inside IR35) . The client is a … multinational high-street retailer. Role Summary The Head of Data for the ERP Program is responsible for leading and delivering the data strategy across all phases of the ERP implementation. This role ensures the effective governance, cleansing, migration, security, and archiving of data. The incumbent will … collaborate with business and technical teams to ensure data integrity, compliance, and alignment with organizational objectives. Key Responsibilities: 1. Data Strategy & Leadership Define and execute the data strategy for the ERP program, ensuring alignment with business objectives. Provide strategic leadership on data More ❯

Head of Data – ERP Implementation Head of Data – ERP Implementation The location of the role is London (hybrid working) . The duration of the contract is 12 months . The pay rate on offer is £1000 - £1200 per day (inside IR35) . The client is a … multinational high-street retailer. Role Summary The Head of Data for the ERP Program is responsible for leading and delivering the data strategy across all phases of the ERP implementation. This role ensures the effective governance, cleansing, migration, security, and archiving of data. The incumbent will … collaborate with business and technical teams to ensure data integrity, compliance, and alignment with organizational objectives. Key Responsibilities: 1. Data Strategy & Leadership Define and execute the data strategy for the ERP program, ensuring alignment with business objectives. Provide strategic leadership on data More ❯

an opportunity as a Space Domain Awareness (SDA) Software Integration Engineer/Architect supporting the US Space Force, Space Systems Command, Global Mission Data Dominance Branch (USSF SSC/BCTD) in Colorado Springs, CO. The Global Mission Dominance Branch executes activities in support of the alignment of key … space data initiatives. The portfolio includes data as service and data platform initiatives to meet evolving Space Domain Awareness (SDA) user data needs and objectives. The mission includes the execution of system acquisition, modernization, and sustainment for ground- and space-based SDA … agile DevOps, and SecDevOps processes. Knowledge of cyber-security activities relative to data platforms a plus. Fundamental knowledge of data lake architectures in cloud and hybrid cloud environments. Able to brief and interact comfortably and professionally with senior leadership. Ability to communicate clearly, concisely, and More ❯

Join our Cardiff Bay team as a Data Warehouse Developer within the Cardiff office. You are expected, if successful, to work 50% of the week in the office. WHO ARE WE? Privately owned and independently minded, Creditsafe operates with the singular vision of powering business decisions. We do … business information accessible to all. Twenty-five years later, we've not only realised this dream, changed the market for the better, made data intelligence accessible to all businesses big and small but most importantly, opened up new avenues of data intelligence for businesses with machine … quality, consistency, and performance across the warehouse. Work with Azure Data Services (Synapse, Data Factory, Data Lake, SQL DB, etc.) to build scalable solutions. Implement data governance, security, and best practices for the warehouse. Develop and maintain documentation on More ❯

Senior Data Architect (Azure) Insurance/ReInsurance Location: London Hybrid:3 Days a week Position Overview: As a Senior Data Architect, you will be responsible for designing, implementing, and optimising our data architecture/data lakehouse to support cloud-based ETL processes … and digital transformation projects. Key Responsibilities: Design and develop scalable data architectures for cloud-based environments. Lead the implementation of ETL processes to ensure efficient data extraction, transformation, and loading. Collaborate with stakeholders to understand business requirements and translate them into technical solutions. Ensure data quality, integrity, and security across all data platforms. Optimize data storage and retrieval processes to enhance performance and scalability. Provide technical guidance and mentorship to junior data engineers and developers. Stay up-to-date with emerging technologies and industry trends to drive More ❯

Senior Data Architect (Azure) Insurance/ReInsurance Location: London Hybrid:3 Days a week Position Overview: As a Senior Data Architect, you will be responsible for designing, implementing, and optimising our data architecture/data lakehouse to support cloud-based ETL processes … and digital transformation projects. Key Responsibilities: Design and develop scalable data architectures for cloud-based environments. Lead the implementation of ETL processes to ensure efficient data extraction, transformation, and loading. Collaborate with stakeholders to understand business requirements and translate them into technical solutions. Ensure data quality, integrity, and security across all data platforms. Optimize data storage and retrieval processes to enhance performance and scalability. Provide technical guidance and mentorship to junior data engineers and developers. Stay up-to-date with emerging technologies and industry trends to drive More ❯

Data Engineer London (hybrid) Salary up to £80,000 per annum An exciting opportunity has arisen to join a well established organisation in the insurance space, in a challenging Data Engineer role. There will be a lot of stakeholder engagement … so the ideal candidate will have both hands on and business facing experience. Preferably in the insurance sector. Key responsibilities: Design Data Lake and Data Warehouse solutions. Design Data Models using Data Vault and Dimensional modelling methods Implement automated, reusable and … efficient batch data pipelines and streaming data pipelines Work closely with Governance and Quality teams to ensure metadata, catalogue, lineage and known solutions to data issues are optimised Work closely with other data specialists and technicians in the organisation, such as Actuarial More ❯

Data Engineer London (hybrid) Salary up to £80,000 per annum An exciting opportunity has arisen to join a well established organisation in the insurance space, in a challenging Data Engineer role. There will be a lot of stakeholder engagement … so the ideal candidate will have both hands on and business facing experience. Preferably in the insurance sector. Key responsibilities: Design Data Lake and Data Warehouse solutions. Design Data Models using Data Vault and Dimensional modelling methods Implement automated, reusable and … efficient batch data pipelines and streaming data pipelines Work closely with Governance and Quality teams to ensure metadata, catalogue, lineage and known solutions to data issues are optimised Work closely with other data specialists and technicians in the organisation, such as Actuarial More ❯

Farringdon, London hybrid working available Are you passionate about transforming data into high-quality, actionable insights? At Southern Housing, our data ecosystem is built on four robust pillarsData Governance, Data Quality & Improvement, Data Architecture, and Business Intelligencethat empower us to drive operational … data remains a strategic asset. Your keen eye for detail will drive improvements across our systems, from supporting the Data Lake implementation to enhancing data collection and storage protocols in collaboration with our database developers and data analysts. Working with cutting … Azure Analysis Services, MS Power BI, MS Azure products, Azure Data Factory, MS SQL, Data management tools, data lake tools, SQL Server Closing date: Sunday 4 th May 2025 at 23.59pm. About us At Southern Housing, our residents are at the heart of More ❯

.video-wrapper svg top:40%; U.S. - Work-life flexibility By playing this video you consent to Google/YouTube processing your data and using cookies Learn more . Position Description: CGI Federal is seeking a motivated and customer-oriented Data Analyst to support a large federal … in data analysis and the identification and documentation of data characteristics and entity relationships. Familiarity with Azure Data Lake Storage (ADLS) and experience with data ingestion, transformation, and management within Azure. Knowledge of Azure Data Factory (ADF) for orchestrating … warehouses, data sharing, and clustering. Proficiency in Apache Spark and Databricks for big data processing and analytics. Familiarity with Delta Lake for managing large-scale data in a lake-house architecture. Strong skills in PowerShell, PowerBI, Python, Scala, or R for data More ❯

Senior Data Technology Consultant Position Description Challenge yourself, change lives and help shape the UK's digital revolution. We look to our Business Consultants, to drive change, inspire trust with clients, and take responsibility for some of the world's most ambitious transformation projects. As a Senior Data … of consulting colleagues, will take a central role in providing support to our clients with a focus on driving their business outcomes using data and technology. You will also support the growth of the wider evolving business consulting function. A key focus of the role will be to … presenting technical concepts in simple, accessible language. • Leverage your deep understanding of legacy and cloud-based data technologies, including Data Lake, Data Warehouse, and Lakehouse concepts. • Bring broad technical knowledge of Azure data products, with subject matter expertise in areas like More ❯

this is done on a rota basis. Job Purpose The BI Lead will be responsible for shaping and maintaining the Enterprise BI and Data warehouse estate. You'll be working with both on-prem and cloud technologies, predominantly focussed on the Microsoft stack (SQL/Azure SQL databases … Data Factory, Synapse, Power BI, Power Platform) You will play a critical role in designing, developing, implementing and maintaining robust data solutions on the Azure and Power BI platforms. You will collaborate closely with cross-functional teams to gather requirements, understand business objectives, and translate them … including performance, pastoral, training and coaching Technical Skills: Strong experience of Azure services such as Azure Data Factory, Azure Data Lake Storage, Azure SQL Database, and Azure Synapse Analytics, Logic Apps Strong SQL programming skills Strong experience with Power BI data modelling and More ❯

AWS Data Engineer S3 Data Centre of Excellence AWS Data Engineer S3 Data Centre of Excellence Country: United Kingdom Interested in part-time, job-share or flexible working? We want to talk to you! Join our community. We have an exciting opportunity … to join our Data Centre of Excellence as an AWS Data Engineer. The AWS Data Engineer will work within a team of analysts to create the data and insights which support the functional areas of the bank. You'll use a variety … perfect opportunity to develop your career. The difference you'll make: Designing, building, and maintaining our AWS Data Estate. This includes S3 lake formation, Iceburg and extends to our Snowflake platform. Designing AWS-based services and capabilities adopting appropriate modelling techniques following agreed architectures, design standards, patterns More ❯