26 to 50 of 261 Data Lake Jobs in the UK

be a developer in the Client Reporting Product Team within Distribution Technology. The Client Reporting Product team partners with Marketing, Reporting Operations and Data Management teams in Technology to build data integration solutions for the automation of a wide variety and high volume of reports. This … software development skills and can pick up new technologies and assist in all aspects of the team’s work such as development using data warehouse and master data vendor platform tools. You will not only need excellent problem-solving skills, but you should also be able … Informatica or similar ETL/ELT platforms, as well as knowledge of data warehousing, data mart, and data lake concepts and processes Work within the team as directed to automate and improve existing data designs and data models, including more »

Job summary It is said that in today's modern world data is a richer resource than oil. As Healthcare becomes more complex, there is an ever growing need to understand and interpret large data sets to provide insight and support decision makers, ensuring we serve … as performance and demand reporting to all business areas. At the heart of this strategy is the development of an Azure Data Lake and structured Data Warehouse. The Data Engineers will support the Head of Data Engineering and the Senior Data … Engineering and wider BI team in the design, development expansion and maintenance of the ICB 'data warehouse', Azure Data Lake and Business Intelligence (BI) systems, acting as a deputy where required. To assist in developing the data assets and capabilities of the more »

Role: Senior Data Engineer Job Type: Permanent Location: London (Hybrid) Ready to utilize your experience in Data Engineering, Solution designing and Cloud Computing? Are you passionate about Azure Cloud and Python? Are you keen to build your career with a dynamic global IT Consultancy implementing cutting … data transformations, aggregations, and analysis on large datasets. Architect data storage solutions using Azure SQL Database, Azure Data Lake Storage, and other Azure services, ensuring scalability, reliability, and performance. Collaborate with cross-functional teams including data scientists, analysts, and software engineers … Data Engineering, Solution designing and Cloud Computing. in Azure cloud services, particularly Databricks, Synapse, Azure SQL Database, and Azure Data Lake Storage. programming skills in Python, with experience developing data processing applications using PySpark. Solid understanding of SQL for data manipulation more »

Role: Senior Data Engineer Job Type: Permanent Location: London (Hybrid) Ready to utilize your experience in Data Engineering, Solution designing and Cloud Computing? Are you passionate about Azure Cloud and Python? Are you keen to build your career with a dynamic global IT Consultancy implementing cutting … data transformations, aggregations, and analysis on large datasets. Architect data storage solutions using Azure SQL Database, Azure Data Lake Storage, and other Azure services, ensuring scalability, reliability, and performance. Collaborate with cross-functional teams including data scientists, analysts, and software engineers … Data Engineering, Solution designing and Cloud Computing. in Azure cloud services, particularly Databricks, Synapse, Azure SQL Database, and Azure Data Lake Storage. programming skills in Python, with experience developing data processing applications using PySpark. Solid understanding of SQL for data manipulation more »

A fantastic opportunity has a risen with our Financial Services client, for a Head of Data Engineering to join the team. The Head of Data Engineering will be responsible leading a team of data engineers to architect, build, and maintain a new data … requirements. The Head of Data Engineering will be involved from the very beginning of the project and will have experience of Azure Datalake and Databricks. Key responsibilities for the Head of Data Engineering Define and drive the data engineering strategy and technical roadmap in … successful digital transformation initiatives involving data engineering and analytics. Significant hands-on Microsoft Azure stack experience is a must: Data Lake, Data Factory, Synapse, Databricks, Power BI Strong in delivering solutions at scale, on time and within budget. Strong background in data more »

Role: Data Engineer (Azure) Location: Bristol (hybrid on-site/remote) Salary: Up to £55,000 + package DOE Requirements: Active and Current UK SC Clearance Skills: Azure stack, Python, Java, ETL Company: Join a dynamic IT transformation consultancy at the forefront of innovation, delivering cutting-edge solutions … for this role, you will need to be a sole British national, eligible to work on secure client sites. We're seeking a Data Engineer with a … focus on Azure, showcasing proficiency in: Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. Utilizing Azure data and analytics services, including but not limited to Azure Data Factory more »

As the Data Architect, you'll lead data architecture initiatives, establishing standards and practices essential for effective data management. Your focus will be on designing and implementing robust data and information systems, ensuring they meet stringent criteria for modelling, flow, lineage, quality … and security. Working closely with stakeholders and data governance teams, you'll drive adherence to established standards, facilitating data-driven decision-making processes across the organisation. This role encompasses: Developing and maintaining a comprehensive Data Architecture Framework and maturity roadmap. Enforcing best data … Azure stacks, including data pipelines, security and networking Expertise with data warehousing, data lakes and data lake houses Experience with master data management software and technologies Experience with ETL technologies including SQL Server, SSIS, Azure Data Factory more »

As the Data Architect, you'll lead data architecture initiatives, establishing standards and practices essential for effective data management. Your focus will be on designing and implementing robust data and information systems, ensuring they meet stringent criteria for modelling, flow, lineage, quality … and security. Working closely with stakeholders and data governance teams, you'll drive adherence to established standards, facilitating data-driven decision-making processes across the organisation. This role encompasses: Developing and maintaining a comprehensive Data Architecture Framework and maturity roadmap. Enforcing best data … Azure stacks, including data pipelines, security and networking Expertise with data warehousing, data lakes and data lake houses Experience with master data management software and technologies Experience with ETL technologies including SQL Server, SSIS, Azure Data Factory more »

Job Title: Azure Data Engineer (Contract) Duration: 3 months Rate: £400 per day Location: Remote Skills: Databricks/Azure Data Lake/Kubernetes IR35 Determination: Outside IR35 Company Overview: We are seeking a skilled and experienced Azure Data Engineer to join our team … on a contract basis. This is an exciting opportunity to contribute to our data infrastructure and play a key role in ensuring the reliability, efficiency, and performance of our data solutions on the Azure platform. Responsibilities: Design, develop, and implement data solutions using Azure … services, including Azure Databricks, Azure Data Lakes, and other cloud-native technologies. Work closely with cross-functional teams to understand data requirements and translate them into technical specifications. Build and maintain data pipelines, ETL processes, and data warehouses on Azure, leveraging technologies more »

Job Title: Azure Data Engineer (Contract) Duration: 3 months Rate: £400 per day Location: Remote Skills: Databricks/Azure Data Lake/Kubernetes IR35 Determination: Outside IR35 Company Overview: We are seeking a skilled and experienced Azure Data Engineer to join our team … on a contract basis. This is an exciting opportunity to contribute to our data infrastructure and play a key role in ensuring the reliability, efficiency, and performance of our data solutions on the Azure platform. Responsibilities: Design, develop, and implement data solutions using Azure … services, including Azure Databricks, Azure Data Lakes, and other cloud-native technologies. Work closely with cross-functional teams to understand data requirements and translate them into technical specifications. Build and maintain data pipelines, ETL processes, and data warehouses on Azure, leveraging technologies more »

Lead Azure Data Engineer | PySpark (Python) & Synapse | Tech for Good/Charity Rate: £500-650 per day Duration: 6-12 months IR35: Outside Location: Remote with occasional travel to London (Once every two months max) Essential skills required: Azure – solid experience required of the Azure Data … ESSENTIAL as PySpark is used heavily. You will be tested on PySpark Azure Synapse - ESSENTIAL as is used heavily Spark Azure Data Lake/Data Bricks/Data Factory Be happy to act as a lead and mentor to the other permanent Azure … This is an urgent contract, so if you are interested apply ASAP. Lead Azure Data Engineer | PySpark (Python), Synapse, Data Lake | Tech for Good/Charity more »

Lead Azure Data Engineer | PySpark (Python) & Synapse | Tech for Good/Charity Rate: £500-650 per day Duration: 6-12 months IR35: Outside Location: Remote with occasional travel to London (Once every two months max) Essential skills required: Azure – solid experience required of the Azure Data … ESSENTIAL as PySpark is used heavily. You will be tested on PySpark Azure Synapse - ESSENTIAL as is used heavily Spark Azure Data Lake/Data Bricks/Data Factory Be happy to act as a lead and mentor to the other permanent Azure … This is an urgent contract, so if you are interested apply ASAP. Lead Azure Data Engineer | PySpark (Python), Synapse, Data Lake | Tech for Good/Charity more »

Job Title: AWS Data Architect Location: United Kingdom (U.K.) - Hybrid The Company: At Amber Labs, we are a cutting-edge UK and European technology consultancy dedicated to delivering exceptional value to our clients in the public sector. Our company culture promotes collaboration, autonomy, and rapid learning, empowering our … work environment focused on deliverable outcomes, along with a range of benefits to support our employees’ well-being and professional development. Key Responsibilities: Data Architecture Design: Collaborate with stakeholders to understand data requirements and design scalable and secure data architectures on AWS. Develop data models, data flow diagrams, and architectural documentation to support financial applications. Cloud Data Management: Design, implement, and manage cloud-based data solutions on AWS, including data lakes, data warehouses, and analytics platforms. Ensure the scalability, performance, and cost more »

Job Title: AWS Data Architect Location: United Kingdom (U.K.) - Hybrid The Company: At Amber Labs, we are a cutting-edge UK and European technology consultancy dedicated to delivering exceptional value to our clients in the public sector. Our company culture promotes collaboration, autonomy, and rapid learning, empowering our … work environment focused on deliverable outcomes, along with a range of benefits to support our employees’ well-being and professional development. Key Responsibilities: Data Architecture Design: Collaborate with stakeholders to understand data requirements and design scalable and secure data architectures on AWS. Develop data models, data flow diagrams, and architectural documentation to support financial applications. Cloud Data Management: Design, implement, and manage cloud-based data solutions on AWS, including data lakes, data warehouses, and analytics platforms. Ensure the scalability, performance, and cost more »

Role: Data Modelling Job Type: Permanent Location: London (Hybrid) Ready to utilize your Data analysis and Investigatory skills ? Are you passionate about RDBMS systems and converting data requirements into logical models and physical solutions? We have an exciting role for you as a Data … the future of technology. with some of the brightest global minds in the industry. access to endless learning opportunities. The Role As a Data Modeler, you will utilise your analytical skills to design, implement and create conceptual, logical, and physical data models. Key responsibilities: modelling standards … to convert data requirements into logical models and physical solutions. with data warehousing solutions (e.g. Snowflake) and data lake architecture, Azure Databricks/Pyspark & ADF. retail data model standards - ADRM. communication skills, organisational and time management skills. to innovate, support change more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … consecutive years Have practical experience designing and delivering using AWS or Azure such as: Azure SQL Data Warehouse, Azure Data Lake, AWS S3,AWS RDS,AWS Lambda or similar Have experience with Open Source big data products i.e. Hadoop Hive, Pig, Impala or … scripting languages such as Python, Java or similar Have expertise in data modelling, data warehouse design and data lake concepts and practices. Additional Information This role can be delivered in a hybrid nature from one of these offices: Belfast, Birmingham, Edinburgh, London, Manchester more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … consecutive years Have practical experience designing and delivering using AWS or Azure such as: Azure SQL Data Warehouse, Azure Data Lake, AWS S3,AWS RDS,AWS Lambda or similar Have experience with Open Source big data products i.e. Hadoop Hive, Pig, Impala or … scripting languages such as Python, Java or similar Have expertise in data modelling, data warehouse design and data lake concepts and practices. Additional Information This role can be delivered in a hybrid nature from one of these offices: Belfast, Birmingham, Edinburgh, London, Manchester more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … consecutive years Have practical experience designing and delivering using AWS or Azure such as:Azure SQL Data Warehouse, Azure Data Lake,AWS S3,AWS RDS,AWS Lambda or similar Have experience with Open Source big data products i.e.Hadoop Hive, Pig, Impala or similar … scripting languages such as Python, Java or similar Have expertise in data modelling, data warehouse design and data lake concepts and practices. Additional Information This role can be delivered in a hybrid nature from one of these offices: Belfast, Birmingham, Edinburgh, London, Manchester more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … consecutive years Have practical experience designing and delivering using AWS or Azure such as:Azure SQL Data Warehouse, Azure Data Lake,AWS S3,AWS RDS,AWS Lambda or similar Have experience with Open Source big data products i.e.Hadoop Hive, Pig, Impala or similar … scripting languages such as Python, Java or similar Have expertise in data modelling, data warehouse design and data lake concepts and practices. Additional Information This role can be delivered in a hybrid nature from one of these offices: Belfast, Birmingham, Edinburgh, London, Manchester more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … consecutive years Have practical experience designing and delivering using AWS or Azure such as:Azure SQL Data Warehouse, Azure Data Lake,AWS S3,AWS RDS,AWS Lambda or similar Have experience with Open Source big data products i.e.Hadoop Hive, Pig, Impala or similar … scripting languages such as Python, Java or similar Have expertise in data modelling, data warehouse design and data lake concepts and practices. Additional Information This role can be delivered in a hybrid nature from one of these offices: Belfast, Birmingham, Edinburgh, London, Manchester more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … consecutive years Have practical experience designing and delivering using AWS or Azure such as:Azure SQL Data Warehouse, Azure Data Lake,AWS S3,AWS RDS,AWS Lambda or similar Have experience with Open Source big data products i.e.Hadoop Hive, Pig, Impala or similar … scripting languages such as Python, Java or similar Have expertise in data modelling, data warehouse design and data lake concepts and practices. Additional Information This role can be delivered in a hybrid nature from one of these offices: Belfast, Birmingham, Edinburgh, London, Manchester more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … consecutive years Have practical experience designing and delivering using AWS or Azure such as:Azure SQL Data Warehouse, Azure Data Lake,AWS S3,AWS RDS,AWS Lambda or similar Have experience with Open Source big data products i.e.Hadoop Hive, Pig, Impala or similar … scripting languages such as Python, Java or similar Have expertise in data modelling, data warehouse design and data lake concepts and practices. Additional Information This role can be delivered in a hybrid nature from one of these offices: Belfast, Birmingham, Edinburgh, London, Manchester more »

detail-oriented Business Intelligence Consultant to join this growing team. In this critical role, you will play a key role in transforming raw data into actionable insights that empower our business users to make data-driven decisions. Responsibilities: Utilise Power Query to extract, transform, and load … Design and develop robust and efficient data models within the Microsoft Data Fabric architecture (experience with Azure Data Lake Storage a plus). Perform thorough data validation to guarantee the integrity and reliability of information. Test and compare new reports against … audiences. Ability to work independently and manage multiple projects simultaneously. Preferred Skills: Experience with Microsoft Data Fabric architecture (Azure Data Lake Storage, Azure Data Factory, etc.). Experience with data migration methodologies. Experience with SQL queries for data manipulation. more »

unparalleled educational experience. By attracting and retaining the finest educators worldwide, our client ensures an environment where excellence thrives. Job Purpose As the Data Platform Engineer overseeing the Data Warehouse and analytics infrastructure, you will shape the backbone of our client's business analysis and reporting … capabilities, both now and into the future. They are seeking a visionary with a proven track record of architecting enterprise-level data ecosystems, someone who thrives on pushing the boundaries of what's possible in data manipulation. Your expertise will ensure data is not … Remarkable experience with Development and maintenance of data pipeline and ETL processes using Azure data Factory, Azure Data Lake and Azure Databricks. Exceptional experience developing codes, testing for quality assurance, administering Azure Databricks platform and exposure to Unity Catalog. Exposure of Performance Tuning more »

Are you passionate about leveraging cutting-edge data technologies to drive business success? Do you thrive in dynamic environments where innovation and collaboration are valued? If so, we have an exciting opportunity for you! Position: Lead Data Engineer Responsibilities: Lead Data Management and Architecture … Spearhead the design and implementation of robust data solutions across the organization, ensuring scalability and efficiency. Next Gen Data Platform Leadership: Act as the primary data engineer supporting the development of our next-generation data platform, collaborating closely with third-party vendors … Skills and Experience: Proficiency in Microsoft Azure Data Services, including Azure SQL Database, Azure Data Factory, Azure Data Lake Storage, and Azure HDInsight. Advanced skills in SQL programming, with the ability to design, optimize, and maintain complex queries and databases. Strong experience in more »