26 to 50 of 560 Data Lake Jobs

management technical knowledge so as to be able to work across full data cycle. - Proven Experience working with AWS data technologies (S3, Redshift, Glue, Lambda, Lake formation, Cloud Formation), GitHub, CI/CD - Coding experience in Apache Spark, Iceberg or Python (Pandas) - Experience in change and release management. - Experience in Database Warehouse design and data … ETL/ELT development in AWS preferred with experience in the following: - Strong experience in some of the AWS services like Redshift, Lambda,S3,Step Functions, Batch, Cloud formation, Lake Formation, Code Build, CI/CD, GitHub, IAM, SQS, SNS, Aurora DB - Good experience with DBT, Apache Iceberg, Docker, Microsoft BI stack (nice to have) - Experience in data warehouse design (Kimball and lake house, medallion and data vault) is a definite preference as is knowledge of other data tools and programming languages such as Python & Spark and Strong SQL experience. - Experience is building Data lake and building CI/CD data pipelines - A candidate is expected More ❯

The Job As Principle Data Engineer, your responsibilities will include designing, developing, and implementing high-performance data … pipelines using Azure Data Factory, Databricks, and other Azure data services. You will architect and manage data solutions using Azure Data Lake Storage, Databricks, Databricks DLT and Streaming and Event Based Architectures. This role will see you collaborating with data scientists, analysts and other engineers to translate data … You You are a Data Engineer with extensive experience using Azure data platform services: Azure Databricks, Azure Data Factory, Azure Data Lake Storage, Azure SQL Database and/or Azure Synapse Analytics. You will have strong SQL and excellent programming skills in Python (Scala is a strong advantage) as well as More ❯

The Job As Principle Data Engineer, your responsibilities will include designing, developing, and implementing high-performance data … pipelines using Azure Data Factory, Databricks, and other Azure data services. You will architect and manage data solutions using Azure Data Lake Storage, Databricks, Databricks DLT and Streaming and Event Based Architectures. This role will see you collaborating with data scientists, analysts and other engineers to translate data … You You are a Data Engineer with extensive experience using Azure data platform services: Azure Databricks, Azure Data Factory, Azure Data Lake Storage, Azure SQL Database and/or Azure Synapse Analytics. You will have strong SQL and excellent programming skills in Python (Scala is a strong advantage) as well as More ❯

Role – Technology Lead Technology – Snowflake, SQL Server, PostgreSQL, Data Warehousing, Data Lake, Medallion, Data Vault, Data Fabric, Semantic modelling Location – UK Business Unit – DNAINS Compensation – Competitive (including bonus) Job Description We are seeking an experienced Data Modeler who can analyse and understand the existing customer data and … analytics models on SQL Server, and design efficient data models for Snowflake. This individual will work closely with multiple Business Analysts to gather requirements and translate them into optimized data structures, ensuring scalability and compliance with industry standards. A strong understanding of Insurance domain concepts—including Specialized Insurance, London Market, and Regulatory Data—is … essential for success in this role. Your role In the role of a Data Modelling Lead, you will be responsible for leading the design and transformation of enterprise data models to support scalable, high-performance analytics and reporting solutions. You will analyse existing data models built on SQL Server and guide the development of More ❯

Role – Technology Lead Technology – Snowflake, SQL Server, PostgreSQL, Data Warehousing, Data Lake, Medallion, Data Vault, Data Fabric, Semantic modelling Location – UK Business Unit – DNAINS Compensation – Competitive (including bonus) Job Description We are seeking an experienced Data Modeler who can analyse and understand the existing customer data and … analytics models on SQL Server, and design efficient data models for Snowflake. This individual will work closely with multiple Business Analysts to gather requirements and translate them into optimized data structures, ensuring scalability and compliance with industry standards. A strong understanding of Insurance domain concepts—including Specialized Insurance, London Market, and Regulatory Data—is … essential for success in this role. Your role In the role of a Data Modelling Lead, you will be responsible for leading the design and transformation of enterprise data models to support scalable, high-performance analytics and reporting solutions. You will analyse existing data models built on SQL Server and guide the development of More ❯

Role – Technology Lead Technology – Snowflake, SQL Server, PostgreSQL, Data Warehousing, Data Lake, Medallion, Data Vault, Data Fabric, Semantic modelling Location – UK Business Unit – DNAINS Compensation – Competitive (including bonus) Job Description We are seeking an experienced Data Modeler who can analyse and understand the existing customer data and … analytics models on SQL Server, and design efficient data models for Snowflake. This individual will work closely with multiple Business Analysts to gather requirements and translate them into optimized data structures, ensuring scalability and compliance with industry standards. A strong understanding of Insurance domain concepts—including Specialized Insurance, London Market, and Regulatory Data—is … essential for success in this role. Your role In the role of a Data Modelling Lead, you will be responsible for leading the design and transformation of enterprise data models to support scalable, high-performance analytics and reporting solutions. You will analyse existing data models built on SQL Server and guide the development of More ❯

Role – Technology Lead Technology – Snowflake, SQL Server, PostgreSQL, Data Warehousing, Data Lake, Medallion, Data Vault, Data Fabric, Semantic modelling Location – UK Business Unit – DNAINS Compensation – Competitive (including bonus) Job Description We are seeking an experienced Data Modeler who can analyse and understand the existing customer data and … analytics models on SQL Server, and design efficient data models for Snowflake. This individual will work closely with multiple Business Analysts to gather requirements and translate them into optimized data structures, ensuring scalability and compliance with industry standards. A strong understanding of Insurance domain concepts—including Specialized Insurance, London Market, and Regulatory Data—is … essential for success in this role. Your role In the role of a Data Modelling Lead, you will be responsible for leading the design and transformation of enterprise data models to support scalable, high-performance analytics and reporting solutions. You will analyse existing data models built on SQL Server and guide the development of More ❯

Role – Technology Lead Technology – Snowflake, SQL Server, PostgreSQL, Data Warehousing, Data Lake, Medallion, Data Vault, Data Fabric, Semantic modelling Location – UK Business Unit – DNAINS Compensation – Competitive (including bonus) Job Description We are seeking an experienced Data Modeler who can analyse and understand the existing customer data and … analytics models on SQL Server, and design efficient data models for Snowflake. This individual will work closely with multiple Business Analysts to gather requirements and translate them into optimized data structures, ensuring scalability and compliance with industry standards. A strong understanding of Insurance domain concepts—including Specialized Insurance, London Market, and Regulatory Data—is … essential for success in this role. Your role In the role of a Data Modelling Lead, you will be responsible for leading the design and transformation of enterprise data models to support scalable, high-performance analytics and reporting solutions. You will analyse existing data models built on SQL Server and guide the development of More ❯

client's data and reporting infrastructure. You will be the strategic owner of the Azure Data Platform, overseeing services such as Azure Data Lake, Data Warehouse, Data Factory, Databricks, and Power BI. The technical focus is all Microsoft, primarily Azure so any Fabric experience would be very beneficial. Our … transformation being driven by technology. Skills & experience required: Experience leading a BI function Expertise in Azure BI architecture and Cloud services Hands-on experience with Azure Fabric, SQL warehousing, DataLakes, Databricks Track record in MI/BI product development using Agile and Waterfall methods Experience managing cross-functional teams and sprint activities Experience in leading a BI team and a … business through the development and transition to a Data Lake/Factory/Warehouse Technical BI background Benefits: Generous and achievable bonus scheme 4% Pension Life Insurance 3 x salary 25 days annual leave plus statutory - 1 x extra day every year for the first 3 years Blue Light Card Medicash - includes discounted gym memberships etc. If More ❯

Azure/Databricks Data Engineer x2 - UK Wide (Hybrid Working) £72,000-£80,000 Duties As a Databricks Data Engineer with an Azure focus, you will be an integral part of our team dedicated to building scalable and secure data platforms. You will leverage your expertise in Databricks, Apache Spark, and Azure to design …/Experience Design and build high-performance data pipelines: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services. Develop and maintain secure data warehouses and data lakehouses: Implement data models, data quality checks, and … Spark, and data pipeline development and strong understanding of data warehousing concepts and practices. Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage, Databricks and Azure Data Factory. Excellent problem-solving and analytical skills and strong communication and teamwork skills. Azure Data Engineer Associate and Databricks Certified More ❯

Azure/Databricks Data Engineer x2 - UK Wide (Hybrid Working) £72,000-£80,000 Duties As a Databricks Data Engineer with an Azure focus, you will be an integral part of our team dedicated to building scalable and secure data platforms. You will leverage your expertise in Databricks, Apache Spark, and Azure to design …/Experience Design and build high-performance data pipelines: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services. Develop and maintain secure data warehouses and data lakehouses: Implement data models, data quality checks, and … Spark, and data pipeline development and strong understanding of data warehousing concepts and practices. Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage, Databricks and Azure Data Factory. Excellent problem-solving and analytical skills and strong communication and teamwork skills. Azure Data Engineer Associate and Databricks Certified More ❯

Location - London, Bristol or Manchester (1 day a month onsite) Duration - 6 months Rate - £550 - £600pd (inside ir35) As a Data Engineer in the Cyber and Domains Protection Team you will: Work within an Agile team to support the development of dashboards and build automated reports to meet the needs of technical and non-technical users Work with … the data analyst and user researcher to update relevant data models to allow business intelligence data to meet the organisation's specific needs Develop business intelligence reports that can be automated, reused and shared with users directly Implement data flows to connect operational systems, data for analytics and business intelligence … like PostgreSQL, MySQL, or similar Cloud data ecosystem (AWS) : hands-on experience with core AWS data services. Key services include: S3 for data lake storage AWS Glue for ETL and data cataloging Amazon Redshift or Athena for data warehousing and analytics Lambda for event-driven data processing. More ❯

Location - London, Bristol or Manchester (1 day a month onsite) Duration - 6 months Rate - £550 - £600pd (inside ir35) As a Data Engineer in the Cyber and Domains Protection Team you will: Work within an Agile team to support the development of dashboards and build automated reports to meet the needs of technical and non-technical users Work with … the data analyst and user researcher to update relevant data models to allow business intelligence data to meet the organisation's specific needs Develop business intelligence reports that can be automated, reused and shared with users directly Implement data flows to connect operational systems, data for analytics and business intelligence … like PostgreSQL, MySQL, or similar Cloud data ecosystem (AWS) : hands-on experience with core AWS data services. Key services include: S3 for data lake storage AWS Glue for ETL and data cataloging Amazon Redshift or Athena for data warehousing and analytics Lambda for event-driven data processing. More ❯

Role Technology Lead Technology Snowflake, SQL Server, PostgreSQL, Data Warehousing, Data Lake, Medallion, Data Vault, Data Fabric, Semantic modelling Location UK Business Unit DNAINS Compensation Competitive (including bonus) Job Description We are seeking an experienced Data Modeler who can analyse and understand the existing customer data and … analytics models on SQL Server, and design efficient data models for Snowflake. This individual will work closely with multiple Business Analysts to gather requirements and translate them into optimized data structures, ensuring scalability and compliance with industry standards. A strong understanding of Insurance domain conceptsincluding Specialized Insurance, London Market, and Regulatory Datais essential for success in … this role. Your role In the role of a Data Modelling Lead, you will be responsible for leading the design and transformation of enterprise data models to support scalable, high-performance analytics and reporting solutions. You will analyse existing data models built on SQL Server and guide the development of optimized structures on Snowflake More ❯

Principal Data Architect (MDM) - Inside IR35 Contract Hybrid/Remote Working Day Rate up to £500 p/d with some flexibility We are seeking an experienced Data Architect to lead the design, implementation, and governance of enterprise data solutions. This role will emphasize operational data use cases — designing data … day-to-day business operations, core applications, and real-time services — while also ensuring robust analytical and reporting capabilities. The ideal candidate will have to be a senior data leader with proven experience in engaging senior data/business/IT stakeholders, strong background in enterprise architecture, data strategy, and cloud technologies, with the … ability to align both operational and analytical data initiatives with business objectives. Key responsibilities Define and implement enterprise data architecture, ensuring alignment with both operational and analytical business needs. Lead domain-driven data modeling efforts across conceptual, logical, and physical layers to ensure data designs reflect business domains and processes. Define and More ❯

Principal Data Architect (MDM) - Inside IR35 Contract Hybrid/Remote Working Day Rate up to £500 p/d with some flexibility We are seeking an experienced Data Architect to lead the design, implementation, and governance of enterprise data solutions. This role will emphasize operational data use cases — designing data … day-to-day business operations, core applications, and real-time services — while also ensuring robust analytical and reporting capabilities. The ideal candidate will have to be a senior data leader with proven experience in engaging senior data/business/IT stakeholders, strong background in enterprise architecture, data strategy, and cloud technologies, with the … ability to align both operational and analytical data initiatives with business objectives. Key responsibilities Define and implement enterprise data architecture, ensuring alignment with both operational and analytical business needs. Lead domain-driven data modeling efforts across conceptual, logical, and physical layers to ensure data designs reflect business domains and processes. Define and More ❯

Principal Data Architect (MDM) - Inside IR35 Contract Hybrid/Remote Working Day Rate up to £500 p/d with some flexibility We are seeking an experienced Data Architect to lead the design, implementation, and governance of enterprise data solutions. This role will emphasize operational data use cases — designing data … day-to-day business operations, core applications, and real-time services — while also ensuring robust analytical and reporting capabilities. The ideal candidate will have to be a senior data leader with proven experience in engaging senior data/business/IT stakeholders, strong background in enterprise architecture, data strategy, and cloud technologies, with the … ability to align both operational and analytical data initiatives with business objectives. Key responsibilities Define and implement enterprise data architecture, ensuring alignment with both operational and analytical business needs. Lead domain-driven data modeling efforts across conceptual, logical, and physical layers to ensure data designs reflect business domains and processes. Define and More ❯

Principal Data Architect (MDM) - Inside IR35 Contract Hybrid/Remote Working Day Rate up to £500 p/d with some flexibility We are seeking an experienced Data Architect to lead the design, implementation, and governance of enterprise data solutions. This role will emphasize operational data use cases — designing data … day-to-day business operations, core applications, and real-time services — while also ensuring robust analytical and reporting capabilities. The ideal candidate will have to be a senior data leader with proven experience in engaging senior data/business/IT stakeholders, strong background in enterprise architecture, data strategy, and cloud technologies, with the … ability to align both operational and analytical data initiatives with business objectives. Key responsibilities Define and implement enterprise data architecture, ensuring alignment with both operational and analytical business needs. Lead domain-driven data modeling efforts across conceptual, logical, and physical layers to ensure data designs reflect business domains and processes. Define and More ❯

Principal Data Architect (MDM) - Inside IR35 Contract Hybrid/Remote Working Day Rate up to £500 p/d with some flexibility We are seeking an experienced Data Architect to lead the design, implementation, and governance of enterprise data solutions. This role will emphasize operational data use cases — designing data … day-to-day business operations, core applications, and real-time services — while also ensuring robust analytical and reporting capabilities. The ideal candidate will have to be a senior data leader with proven experience in engaging senior data/business/IT stakeholders, strong background in enterprise architecture, data strategy, and cloud technologies, with the … ability to align both operational and analytical data initiatives with business objectives. Key responsibilities Define and implement enterprise data architecture, ensuring alignment with both operational and analytical business needs. Lead domain-driven data modeling efforts across conceptual, logical, and physical layers to ensure data designs reflect business domains and processes. Define and More ❯

in their ongoing digital transformation. This position offers the chance to develop the initial data strategy, design scalable pipelines from scratch, and create a data lake that will be central to reporting initiatives. If you are experienced in managing AWS based data infrastructures and eager to drive innovative solutions, this role is perfect … automated data pipelines to ingest, process, and deliver quality data across internal systems. Lead the setup and ongoing evolution of a centralised data lake in AWS to unify data from various sources, supporting BI and analytics needs. Partner with product managers, analysts, software developers, and IT to ensure data integration and reporting capabilities support business goals. Manage and optimise AWS data warehousing and lake architectures to ensure high quality, accessible data for insights. Enable efficient data processing, transformation, and analysis through best in class AWS technologies and methodologies. Identify opportunities for workflow optimisation and automation to enhance performance. Stay current More ❯

in their ongoing digital transformation. This position offers the chance to develop the initial data strategy, design scalable pipelines from scratch, and create a data lake that will be central to reporting initiatives. If you are experienced in managing AWS based data infrastructures and eager to drive innovative solutions, this role is perfect … automated data pipelines to ingest, process, and deliver quality data across internal systems. Lead the setup and ongoing evolution of a centralised data lake in AWS to unify data from various sources, supporting BI and analytics needs. Partner with product managers, analysts, software developers, and IT to ensure data integration and reporting capabilities support business goals. Manage and optimise AWS data warehousing and lake architectures to ensure high quality, accessible data for insights. Enable efficient data processing, transformation, and analysis through best in class AWS technologies and methodologies. Identify opportunities for workflow optimisation and automation to enhance performance. Stay current More ❯

Role: Data Architect – Finance Transformation Location: Birmingham (Hybrid) Contract: 6-Months Rate: Competitive – (Outside IR35) About the Role Chapman Tate Associates is recruiting for a Data Architect to be part of an exciting data transformation journey, where you will be instrumental in shaping the foundations. This is a hands-on, technically driven role where … platform, responsible for designing and implementing the architecture that will become the organisation’s single source of truth. You’ll: Design and build the enterprise data lake using Azure Data Lake Gen2 with a Bronze/Silver/Gold layer model. Develop robust ETL/ELT pipelines in Azure Data Factory … someone who thrives in designing and building cloud-based data ecosystems from the ground up. You’ll bring: Hands-on experience with Microsoft Azure Data Lake Gen2, Azure Data Factory, and Azure Active Directory. Expert-level SQL and data modelling skills (conceptual, logical, physical). Proven ability to build scalable ETL More ❯

Role: Data Architect Finance Transformation Are you the right applicant for this opportunity Find out by reading through the role overview below. Location: Birmingham (Hybrid) Contract: 6-Months Rate: Competitive (Outside IR35) About the Role Chapman Tate Associates is recruiting for a Data Architect to be part of an exciting data transformation journey, where … platform, responsible for designing and implementing the architecture that will become the organisation s single source of truth. You ll: Design and build the enterprise data lake using Azure Data Lake Gen2 with a Bronze/Silver/Gold layer model. Develop robust ETL/ELT pipelines in Azure Data Factory … someone who thrives in designing and building cloud-based data ecosystems from the ground up. You ll bring: Hands-on experience with Microsoft Azure Data Lake Gen2, Azure Data Factory, and Azure Active Directory. Expert-level SQL and data modelling skills (conceptual, logical, physical). Proven ability to build scalable ETL More ❯

Databricks Data Architectx2 UK Wide Hybrid Working £80,000-£90,000 As a Solution Architect with an Azure and Databrick focus, you will be an integral part of our team dedicated to building scalable and secure data platforms. You will leverage your expertise in Databricks, Apache Spark, and Azure to design, develop, and implement data … operations. Duties Design and build high-performance data platforms: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services. Design and oversee the delivery of secure data warehouses and data lakehouses: Implement data models, data … Spark, and data platforms with a strong understanding of data warehousing concepts and practices. Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage, Databricks, and Azure Data Factory. Excellent problem-solving and analytical skills and strong communication and teamwork skills. Passion for data and a thirst for More ❯

Databricks Data Architectx2 UK Wide Hybrid Working £80,000-£90,000 As a Solution Architect with an Azure and Databrick focus, you will be an integral part of our team dedicated to building scalable and secure data platforms. You will leverage your expertise in Databricks, Apache Spark, and Azure to design, develop, and implement data … operations. Duties Design and build high-performance data platforms: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services. Design and oversee the delivery of secure data warehouses and data lakehouses: Implement data models, data … Spark, and data platforms with a strong understanding of data warehousing concepts and practices. Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage, Databricks, and Azure Data Factory. Excellent problem-solving and analytical skills and strong communication and teamwork skills. Passion for data and a thirst for More ❯