1 to 25 of 63 Data Lake Jobs in Yorkshire

to technology, delivering bespoke software solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science and AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles, with openings at senior or lead level to suit your experience. You may be … or solving tough engineering challenges. You'd also be expected to spend some time on-site with clients in the London area on an ad-hoc basis. Our data engineers combine a strong software engineering approach with solid data fundamentals and experience with modern tools. We’re technology agnostic, and we’re open minded when it More ❯

Job Title Data Engineering Manager - Commercial & Supply Location Asda House Employment Type Full time Contract Type Permanent Hours Per Week 37.5 Salary Competitive salary plus benefits Category Data Science Closing Date 27 June 2025 The role requires on-site presence at Asda House in Leeds for at least three days per week. We’re really looking … forward to having you around! Are you ready to shape the future of data in a fast-paced, high-impact domain? We’re looking for a Data Engineering Manager to lead our data engineering capabilities within the Commercial & Supply domain. In this role, you’ll be responsible for the technical delivery of high-quality … data products, leading agile engineering squads consisting of data & visualisation engineers, while fostering a collaborative, high-performing team environment. You’ll be at the forefront of shaping scalable, reliable data solutions that meet Asda business needs and follow our data strategy, governance principals and security standards. Your combined skills in people management More ❯

Data Science Team Lead Competitive + Bonus + Benefits Manchester, Slough or Leeds (Hybrid) Permanent full time We are seeking an experienced Data Scientist to lead a growing team as the Data Science Team Lead at IRIS Software Group. The ideal candidate wouldcoordinate the planning, development and design of Data Engineering in … a customer facing data warehousing product. The product will drive the analytics required for both the State and Commercial sector. To be successful in this role you will work with the product and engineering team to identify valuable data sources and analyse trends in the data for our customers. This is a hands on … seeking Experienced Lead Data Engineer Strong Data Engineer Language Skills (Python, SQL, Javascript) Experience of Azure, AWS or GCP cloud platforms and Data Lake/Warehousing Platforms such as Snowflake, Iceberg etc Experience of various ETL and Streaming Tools (fiveTran, Flink, Spark) Experience of a variety of data mining techniques (APIs More ❯

Senior Azure Data Engineer Remote Working - UK Home-based with occasional travel into the office £39,784 - £49,477 (National) £45,456- £55,149 (London within the M25) Additional allowance for exceptional candidates - Max Salary - £62,000 (National) and £67,000 (London within the M25) Homeworking allowance of £581 per annum Job Ref: J12964 A Senior Azure Data Engineer is required to design, build, test and maintain data on the enterprise data platform, allowing accessibility of the data that meets business and end user needs. The successful individual will be responsible for maximising the automations, scalability, reliability and security of data services, focusing on opportunities for re-use … adaptation and efficient engineering. Additionally you will support the team but knowledge sharing and mentoring more junior members of the team. Accountabilities: Design, build and test data pipelines and services, based on feeds from multiple systems using a range of different storage technologies and/or access methods provided by the Enterprise Data Platform, with a More ❯

allowance for exceptional candidates - Max Salary - £62,000 (National) and £67,000 (London within the M25) Homeworking allowance of £581 per annum Job Ref: J12964 A Senior Azure Data Engineer is required to design, build, test and maintain data on the enterprise data platform, allowing accessibility of the data that meets business … and end user needs. The successful individual will be responsible for maximising the automations, scalability, reliability and security of data services, focusing on opportunities for re-use, adaptation and efficient engineering. Additionally you will support the team but knowledge sharing and mentoring more junior members of the team. Accountabilities: Design, build and test data pipelines and … services, based on feeds from multiple systems using a range of different storage technologies and/or access methods provided by the Enterprise Data Platform, with a focus on creating repeatable and reusable components and products. Design, write and iterate code from prototype to production ready. Understand security, accessibility and version control. Use a range of coding tools More ❯

Senior Data Engineer A top Managed Services Provider are on the lookout for an Azure Data Engineer to join their expanding applications team. In this role, you'll support a crucial reporting project and play a key part in driving business transformation with the latest Microsoft cloud technologies. The ideal candidate will have extensive experience as … a data engineer within large organisations and enterprise platforms. This opportunity is ideal for someone who enjoys staying up-to-date with technology through active involvement in solution delivery and is keen to advance their career by enhancing their skills in digital transformation. Key Responsibilities: Collaborate on enterprise-level projects. Deliver hands-on … solutions to internal clients. Stay updated with technology trends and actively participate in solution delivery. Ideal Candidate: Technical Skills: Proficiency in Azure Data Platform (Data Lake, Synapse Analytics, SQL Database, Data Factory). Strong knowledge of Power BI and Microsoft reference architectures. Experience in Data Platform Design and Azure DevOps. Understanding More ❯

Senior Data Engineer Permanent Up to 75k Middlesbrough (Circa 3 times per week) Overview A leading organisation in the industrial services sector is seeking a talented and experienced Data Engineer to support and develop cutting-edge data solutions. This role focuses on data integration, modelling, transformation, and master data management … with a strong emphasis on Microsoft and Azure technologies. The company operates in a fast-paced environment using Agile methodologies and CI/CD processes to deliver data-driven insights across the business. Key Responsibilities Design, develop, and support scalable data solutions that integrate multiple systems and sources. Implement and manage master data solutions … maintain clear documentation. Technical Skills & Qualifications Proven experience in a Data Engineer role. Expertise in Microsoft and Azure technologies: SQL Server, ADF, Logic Apps, Data Lake, Power Query, Fabric, Function Apps, Power Automate, Spark, Databricks, SSIS. Strong understanding of data modelling techniques including Normalisation and Kimball methodologies. Proficient in SQL, and experience with More ❯

Senior Data Engineer Permanent Up to £75k Middlesbrough (Circa 3 times per week) Overview A leading organisation in the industrial services sector is seeking a talented and experienced Data Engineer to support and develop cutting-edge data solutions. This role focuses on data integration, modelling, transformation, and master data management … with a strong emphasis on Microsoft and Azure technologies. The company operates in a fast-paced environment using Agile methodologies and CI/CD processes to deliver data-driven insights across the business. Key Responsibilities Design, develop, and support scalable data solutions that integrate multiple systems and sources. Implement and manage master data solutions … maintain clear documentation. Technical Skills & Qualifications Proven experience in a Data Engineer role. Expertise in Microsoft and Azure technologies: SQL Server, ADF, Logic Apps, Data Lake, Power Query, Fabric, Function Apps, Power Automate, Spark, Databricks, SSIS. Strong understanding of data modelling techniques including Normalisation and Kimball methodologies. Proficient in SQL, and experience with More ❯

AI-powered advice on this job and more exclusive features. Direct message the job poster from psd group. About the Company - Our client is seeking a Head of Data and Analytics to drive the organisation's data and analytics strategy, fostering a data-driven culture, and delivering actionable insights to support business growth and … innovation. About the Role - This role oversees the data engineering, data analytics, and data governance teams, ensuring the organisation leverages its data assets effectively while maintaining data governance, security, and compliance. Responsibilities Developing and delivering a data & analytics strategy, prioritising data initiatives in conjunction with the … business. Leading a team of data professionals including engineers, analysts and developers. Oversee the development and support of a scalable and secure data platform, including data lakes, data warehouses and pipelines. Define and drive data governance for the organisation. Drive the adoption of advanced analytics, AI and Machine Learning for More ❯

Total Care, this rental model allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also support other areas of the business with their data needs as well as … optimization. Experience with Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and other Azure data services. Familiarity with Azure Blob Storage, Azure Data Lake, and data lake architectures. Experience working with data modelling, normalization, and star schema design for data warehouses. Proficient in scripting languages such More ❯

Total Care, this rental model allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also support other areas of the business with their data needs as well as … optimization. Experience with Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and other Azure data services. Familiarity with Azure Blob Storage, Azure Data Lake, and data lake architectures. Experience working with data modelling, normalization, and star schema design for data warehouses. Proficient in scripting languages such More ❯

Total Care, this rental model allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also support other areas of the business with their data needs as well as … optimization. Experience with Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and other Azure data services. Familiarity with Azure Blob Storage, Azure Data Lake, and data lake architectures. Experience working with data modelling, normalization, and star schema design for data warehouses. Proficient in scripting languages such More ❯

Total Care, this rental model allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also support other areas of the business with their data needs as well as … optimization. Experience with Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and other Azure data services. Familiarity with Azure Blob Storage, Azure Data Lake, and data lake architectures. Experience working with data modelling, normalization, and star schema design for data warehouses. Proficient in scripting languages such More ❯

Total Care, this rental model allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also support other areas of the business with their data needs as well as … optimization. Experience with Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and other Azure data services. Familiarity with Azure Blob Storage, Azure Data Lake, and data lake architectures. Experience working with data modelling, normalization, and star schema design for data warehouses. Proficient in scripting languages such More ❯

Build the future of the AI Data Cloud. Join the Snowflake team. We are looking for data experts who have a strong background in building data platforms and love to use their skills to supercharge data teams. Our team helps customers on their data journey with Snowflake, which is very … fast becoming the central data platform for companies big and small. That means you will work on some of the most challenging data projects you can find, in a post-sales capacity. We are hiring a range of seniority levels, though we do not currently hire people without relevant experience. During the interview process, we will … career levels. What we are offering: We help each other to stay on top of the game and up-to-date with the latest features in the Snowflake Data Cloud. Snowflake had the biggest software IPO of all times and we continue to grow at a rapid pace, which means there is ample opportunity to change the future More ❯

Job Title Data Engineer Location Asda House Employment Type Full time Contract Type Permanent Hours Per Week 37.5 Salary Competitive salary plus benefits. Category Data Science Closing Date 27 June 2025 This role requires on-site presence at Asda House in Leeds for at least three days per week. We’re really looking forward to having … you around! Are you passionate about turning data into powerful insights and scalable solutions? We’re looking for a Data Engineer to join our dynamic Data Team and help shape the future of data at Asda. In this hands-on role, you’ll be a key player within one of our Agile … data squads, working side-by-side with Product Managers, Visualisation Engineers, Data Analysts, and Data Architects. Together, you’ll design and deliver high-quality, reliable data products that fuel strategic decisions and drive real business impact. But this isn’t just about pipelines and platforms, it’s about people and progress. You More ❯

Join to apply for the Data Engineer - Python & Azure role at TieTalent About the Role Data Engineer - Python & Azure Contract type: Permanent Hours: 37.5 Salary: Circa £61,000, depending on experience Location: Leeds or Birmingham WFH policy: Employees are required to attend the office 2 days/week Travel: You will be required to travel to … the London office once a month (expenses paid) Flexible working: Various flexible work patterns, e.g., compressed 9-day fortnight, subject to line manager approval Reports to: Data Engineer Manager Role Summary As a Data Engineer, you will manage LCCC’s data ecosystems, collaborating with developers, solution architects, BAs, analysts, data scientists, and … engineering experience with data platforms and analytics support Hands-on experience with Azure Data ecosystem: Databricks, Data Factory, Data Lake, Synapse; certifications are a plus Proficiency in Python, with PySpark experience preferred Strong SQL skills Experience in building and maintaining data pipelines Managing DevOps pipelines Skills in More ❯

Warehousing and Enterprise Integration projects Development of ETL [Extract Transform & Load] by utilizing relevant technologies (e.g. Informatica, MS Azure Data Factory, Azure Data Lake, etc.). Develop Data Ingestion and Integration from data sources to Azure Data Warehouse, based on Data Pipeline Framework(s) established … by our Data Analytics and Information Technology teams as well as technical requirement specifications developed across all departments. Develop all necessary ad-hoc Data Ingestion/Integration processes into operational procedures for our Production Environment by adhering to agile, reliable, secure, high-performing, efficient, and effective methodology. Build and deploy Data Gathering/Integration … centralized reporting environment. Work with various business teams and departments to increase efficiency and accuracy of business processes through business process automation. Performance Tuning and Optimization of all Data Ingestion and Data Integration processes, including Data Platforms and databases. Support Data Analyst, Information Technology, and Business Stakeholder(s) in analyzing & resolving any More ❯

Job Title Lead Data Engineer Location Asda House Employment Type Full time Contract Type Permanent Hours Per Week 37.5 Salary Competitive salary plus benefits Category Business Intelligence Closing Date 27 June 2025 This role requires on-site presence at Asda House in Leeds for at least three days per week. We’re really looking forward to having you … around! Are you ready to lead from the front and make a real impact with data? We’re on the lookout for a Lead Data Engineer to join our high-performing Data Team. In this pivotal role, you won’t just write code, you’ll shape the direction of our data engineering … multiple squads. As the most senior engineer in the team, you’ll combine deep technical expertise with strategic leadership. You’ll mentor and inspire a talented group of data engineers, guiding them through complex challenges and helping them grow. Your work will directly influence the design and delivery of robust, scalable data products that power decision More ❯

maintaining and optimising our current data solution as well as advancing it to the next level. We have created an initial gem of a Data Lake and Lakehouse (Azure Data Lake, ADF, Databricks, Airflow, DBT) to enable Business Intelligence and Data Analytics (Superset, RStudio Connect). Our Data Lake is fully metadata driven, cost efficient, documented, and reproducible. We need our one-source-of-truth to be reliable and of high quality for both internal and external reporting and insight generation. But it is just the start – we will need best practice solutions around how we share data and insight back to our … innovation in your solutions as we grow. Main responsibilities: Take ownership of the centralisation of different data sources into our Lakehouse (Databricks on Azure Data Lake) and its architecture. Be responsible for the reliability and quality of data in the Data Lake (including anomaly detection, data quality checks More ❯

Join our Data & Insight team to architect Movera's data ecosystem on Azure. You'll develop data pipelines, manage the data lake, and transform data for high-performance Power BI reporting. Collaborate with stakeholders to deliver the Data roadmap, ensuring a single source of truth and robust … the Head of Data & Insight, and other members of the team to ensure clarity on the backlog for data requirements into the data lake Have a full understanding of the various business units and business objectives, and how these are reflected in the Business Hierarches, Business Metrics and reporting architecture. Strong working knowledge … of business processes and all relevant current Systems/Data sources, to understand, shape and validate the feed of data into the data lake Support in maintaining both a robust production and a parallel development environment Full documentation of all processes to feed both the data lake and power BI More ❯

Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £60,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital transformation and building a cloud-first, data-led approach to support major environmental goals. Think scalable pipelines, secure platforms, and data systems that … directly contribute to a greener future. As a Senior Data Engineer, you'll play a key role in designing and delivering robust, cloud-based data infrastructure. You'll work with large datasets, build scalable pipelines, and help ensure data is high quality, secure, and accessible, while mentoring more junior engineers and working closely with … Cloud data platform development and deployment. Expertise across data warehouse and ETL/ELT development in AWS preferred Experience is building a Data Lake as well as building CI/CD data pipelines Excellent communication and problem-solving skills. What's on Offer: Salary to £60,000 + benefits Hybrid working More ❯

pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range Direct message the job poster from Fruition Group Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £60,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital … transformation and building a cloud-first, data-led approach to support major environmental goals. Think scalable pipelines, secure platforms, and data systems that directly contribute to a greener future. As a Senior Data Engineer, you'll play a key role in designing and delivering robust, cloud-based data infrastructure. You'll work … Cloud data platform development and deployment. Expertise across data warehouse and ETL/ELT development in AWS preferred Experience is building a Data Lake as well as building CI/CD data pipelines Excellent communication and problem-solving skills. What's on Offer: Salary to £60,000 + benefits Hybrid working More ❯

Search by ‘Skills’ or ‘Keywords’ or 'Requisition ID’ Search by Location Select how often (in days) to receive an alert: Work with us Title: Data and Analytics Architect - L1 Requisition ID: 72555 Country/Region: GB Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that … engineering with tools such as Spark, Databricks,scala/Pyspark or SQL Strong understanding of ETL/ELT pipelines, distributed data processing and data lake architecture. Having exposure to ETL tools such as Informatica, Datastage or talend is added advantage Experience with Unity catalog, Delta lake and modern data lakehouse concepts … enterprise technology environment for data architecture management a. Develop, maintain and implement standard patterns for data layers, data stores, data hub & lake and data management processes b. Evaluate all the implemented systems to determine their viability in terms of cost effectiveness c. Collect all the structural and non-structural More ❯

Social network you want to login/join with: Senior Data Engineer (SC Cleared), Leeds, West Yorkshire Client: CALIO Consulting Group (CCG) Location: Leeds, West Yorkshire, United Kingdom Job Category: Other EU work permit required: Yes Job Views: 3 Posted: 10.06.2025 Expiry Date: 25.07.2025 Job Description: Key Responsibilities Lead the technical delivery of complex data engineering … projects, ensuring solutions are scalable, secure, and aligned with our delivery framework and client goals. Design and build high-quality data pipelines and integration workflows, setting the technical direction and ensuring engineering best practices are followed throughout the development lifecycle. Collaborate with multidisciplinary teams, including a wide range of other roles, to shape solutions that meet both technical … sense of ownership and accountability. Technologies, Methodologies and Frameworks: Direct delivery experience using cloud-native data services, specifically in Microsoft Azure, Fabric, Dataverse, Synapse, Data Lake, Purview. Deep expertise in data engineering tools and practices, including Python, SQL, and modern ETL/ELT frameworks (e.g., Azure Data Factory, Talend, dbt). More ❯