1 to 25 of 30 Data Lake Jobs in the North West

Lead Data Engineer - Manchester - Hybrid - £75k - £85k This is an excellent opportunity for a highly experienced data engineer to join a growing tech consultancy and contribute to the leadership of their data engineering practice. If you are an experienced and capable data engineer with a history of using Microsoft products and working … of clients to gather requirements and deliver solutions. Be willing to engage and assist in pre-sales activities, bids, proposals etc. Use key techniques such as Governance, Architecture, Data Modelling, ETL/ELT, Data Lakes, Data Warehousing, Master Data, and BI. Consistently utilise key processes in the engineering delivery cycle including Agile … and DevOps, Git, APIs, Containers, Microservices and Data Pipelines. Assist in building out, developing, and training the data engineering function. What do I need to apply Strong MS data engineering expertise (Fabric, ADF, ADL, Synapse, SQL) Expert use of Databricks Strong Python experience Consultancy experience Leadership experience My client are looking to book in More ❯

A Manchester based FMCG is seeking a highly skilled Senior/LeadData Engineer to join their growing data team. This role will be instrumental in designing, building, and maintaining a modern data warehouse and data infrastructure to support advanced analytics and reporting needs for a fast-growing organisation. Key Responsibilities: Design … develop, and maintain scalable data pipelines using SQL and Python (PySpark) . Ingest, transform, and curate data from multiple sources into Azure Data Lake and Delta Lake formats. Build and optimize datasets for performance and reliability in Azure Databricks . Collaborate with analysts and business stakeholders to translate data requirements … in SQL for data transformation and performance tuning. Solid experience with Python , ideally using PySpark in Azure Databricks . Hands-on experience with Azure Data Lake Storage Gen2 . Understanding of data warehouse concepts , dimensional modelling , and data architecture . Experience working with Delta Lake and large-scale data More ❯

UK Head Office - Manchester Hybrid/PERMANENT/SALARY: COMPETITIVE Job Purpose The Data Lead is responsible for leading and growing MPM's data capabilities. Managing the data team, overseeing the design, delivery, and governance of data infrastructure, pipelines, and analytics solutions. The Data Lead is also responsible for setting … and executing the vision for data within the organisation, enabling accurate, timely, and actionable insights through data practices, collaboration, and strong leadership. This role deals with a wide variety of tasks including, but not limited to the following: Manage, mentor, and grow the newly formed Data Team to deliver high-quality solutions that meet … evolving business objectives. Define and maintain the roadmap for data infrastructure, tools, and quality standards. Lead a data-first culture across the organisation, championing data literacy and self-service capabilities. Represent the Data Team in leadership discussions and ensure alignment with business priorities. Continuously improve data operations, governance, and platform More ❯

Data Engineer - Leading Pharmaceutical Company - Manchester (Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies) About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge … technologies and contribute to exciting projects in a collaborative environment. About the Role: Our client is seeking an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone … agile team. Experience working in a highly regulated industry and with highly sensitive data. Exposure to large data solutions like Snowflake, Trino, Synapse, Azure Data Lake, and Databricks. Experience in data science using R, Stata, or Python. Familiarity with Atlassian tools such as JIRA, Confluence, and BitBucket. Understanding of clinical trials, GCP, and More ❯

Data Engineering Consultant (all levels) We’re working with a globally recognised consultancy that delivers cutting-edge digital, data, and analytics solutions to some of the most complex infrastructure projects across the UK and beyond. With a strong commitment to technical excellence, inclusion, and client impact, they partner with high-profile organisations to help them unlock … the full potential of their data assets. Due to continued growth and demand for their data services, they are expanding their specialist engineering team and seeking talented Data Engineering Consultants at various seniority levels — from experienced engineers to those ready to step into leadership roles. The Role As a Data Engineering Consultant … and contribute to internal knowledge repositories and best practice libraries Key Skills & Experience Strong hands-on experience with Azure tooling, including: Databricks, Data Factory, Data Lake, and Synapse (or similar data warehouse tools) Azure Analysis Services or comparable BI tooling Solid programming capability in: SQL, Python, Spark, and ideally DAX Familiarity with CI More ❯

Prestigious opportunity for a Data Platform Engineer within a pioneering technology team based in Manchester. Following a period of significant growth, investment and a cloud transformation, we are inviting you to join our success story! As our Azure Data Platform Engineer, you will be responsible for:- Designing, building, and maintaining scalable data solutions on … Microsoft Azure. Designing and implementing scalable data pipelines using Azure Data Factory, Databricks, Synapse Analytics, and other Azure services. Leading technical workstreams and supporting project delivery. Acting as the subject-matter expert for cloud-based data engineering. Ensure data governance, security, and compliance standards are met. Monitoring and troubleshooting data … you possess a combination of some of the following skills, then LETS TALK! Proven experience with Azure data services (SQL, Data Factory, Data Lake, Synapse, Databricks, Azure SQL and Cosmos DB). Strong proficiency in designing and operating scalable data solutions and pipelines. Familiar with Cloud security, performance optimisation and monitoring More ❯

Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Company: Royal London Group Job Title: Data Engineer Contract Type: Permanent Location: Edinburgh or Glasgow or Alderley Edge Working style: Hybrid 50% home/office based We have a fantastic opportunity for a Data Engineer to join Royal … London. The successful candidate will be responsible for identifying, defining, managing, and delivering data, tools, and other technical assets to enable analytics, data science, and machine learning projects. These initiatives aim to generate insights, address key business questions, solve business problems, and support decision-making at all levels of the organisation. In addition to these responsibilities … the Data Engineer will assist junior team members, promoting engineering best practices and maintaining technical standards. The role also involves supporting the delivery of multiple projects across the team, being involved in data, tooling, and technical practices related to data engineering for business intelligence, analytics, data science, and machine learning. About the More ❯

Year FTC role Job Summary: We are looking for an experienced Data Governance Lead to drive enterprise-wide data governance initiatives with a focus on modern cloud data platforms, specifically Databricks and Microsoft Azure. This role will define and enforce data policies, standards, and best practices that ensure high data … business objectives and compliance requirements. Collaborate with data engineering and platform teams to integrate data governance within Databricks and Azure environments, including Data Lake, Synapse, and Purview. Define and enforce data classification, access management, and lineage tracking using Azure-native and third-party tools. Lead the Data Governance Council … governance, data management, or data architecture. Hands-on experience with Databricks and/or Microsoft Azure data services (e.g., Data Lake Storage, Synapse, Purview, Azure Data Factory). Strong understanding of data governance frameworks such as DAMA-DMBOK. Familiarity with data privacy, security, and More ❯

looking for a specialist to come in and oversee the reporting and analytics of the implementation. Candidates need to be proficient in Power BI, Synapse Link, and modern data warehousing … techniques. Daily Tasks Develop and maintain Power BI dashboards and reports based on D365 F&O data. Integrate D365 data with Azure Synapse Analytics, Data Lake, and Data Factory to build scalable reporting pipelines. Support and optimise the Entity Store and/or Bring Your Own Database (BYOD) setup for reporting. Design and … implement data models and data warehouses aligned with business KPIs and reporting requirements. Collaborate with business stakeholders to gather requirements, define metrics, and deliver meaningful insights. Ensure data quality, governance, and security within all reporting layers. Assist in knowledge transfer and documentation for internal teams. Required Skills Proven experience with Microsoft Dynamics 365 Finance More ❯

Are you a passionate Data Engineering Manager ready to unlock the power of data? Our client is a leading UK-based consultancy seeking a skilled professional to shape data strategies, mentor dynamic teams, and deliver cutting-edge solutions. With hands-on expertise in Spark, SQL, and cloud platforms like Azure, you’ll lead end … to-end projects, drive innovation, and collaborate with clients across industries. What You’ll Do: Lead complex data engineering solutions with technical excellence. Mentor teams and foster a culture of growth and quality. Showcase your expertise in pre-sales and client workshops. Design data pipelines, lakes, and warehouses with best practices. Skills They're Looking For … Proven Data Engineering experience (5+ years). Consultancy experience is a must. Leadership and multi-project environments experience. Expertise in ETL, data modelling, and Azure Data Services. Experience in designing and implementing data pipelines, data lakes, and data warehouses. Hands-on experience with Apache Spark and bonus points More ❯

Azure Data Engineer Manchester Up to £65k On behalf of our industry-leading client, we are recruiting for a talented Azure Data Engineer. As Azure Data Engineer, you will be working closely with Data Engineering, Business Services, and Technical Partners to create and integrate Azure Data Engineering pipelines transforming core … systems data into knowledge. The Azure Data Engineer will be responsible for: Working with other members of the Data Engineering team, you will actively participate in the design and development of processes and technologies that support secure and efficient data ETL, connecting to a variety of on- and off-premises data … efficiently tested, deployed, updated, maintained, and managed The Azure Data Engineer will have the following: Experienceworkingin an Agile environment Advanced SQL coding skills Azure Data Lake (Gen 1 and 2) Azure Analysis Services Azure SQL Data Warehouse (Synapse Analytics) Azure Data Factory Experience working with large JSON documents Strong data More ❯

Data Solution Architect - Circa £110K - Hybrid working from London An established organisation is seeking a delivery-focused Data Solutions Architect to provide architectural leadership and guidance in the development of enterprise data solutions. The role involves contributing to strategic data initiatives such as enterprise data lakes, governance platforms, and asset … data programmes. The successful candidate will work closely with cross-functional teams including security, infrastructure, and enterprise architecture to ensure consistency and alignment across the data landscape. Key Responsibilities Data Design: Lead enterprise data design efforts. Support data modelling and recommend best practices and tools to meet business and technical … objectives. Establish standards for modelling methodologies. Solution Architecture: Provide architectural expertise for evaluating and recommending scalable data solutions. Ensure design patterns support both transactional performance and analytics needs. Support for Digital Programmes: Collaborate with stakeholders to define and document data requirements. Evaluate technology options for strategic fit and ensure successful implementation. Work closely with engineering teams More ❯

provide a range of exciting challenges including cloud computing, AI, consolidation, migration, integrations and simplification. Solutions typically involve changes to, or creation of, business processes, operating model, application, data flows, infrastructure, and integration of third-party services. You have a solid grasp of the concepts of business goals, objectives and business outcomes, business capabilities, value-streams and business … business needs and align with target/transition states, and architectural governance and standards. Hands-on experience in modelling languages such as C4 and ArchiMate. Robust understanding of data and application migration technologies like Azure Data Factory. Knowledge of core policy platforms like Bravura Sonata, TCS BaNCS, FNZ and bespoke legacy systems Skills to modernise architectural … technologies Cloud migration frameworks (Azure functions, Logic Apps, App Services) Java or Microsoft technologies, Azure platform and .Net ecosystem Database technologies and platforms like SQL, NoSQL, Data Lake, Snowflake, Databricks, MongoDB, Oracle Observability platforms like Splunk, Dynatrace, Datadog, Grafana About Royal London We're the UK's largest mutual life, pensions and investment company, offering protection, long More ❯

Job Title: Data Engineer Location: Nelson, Lancashire + Flexible Hybrid WFH 4 days a week Salary: Up to £60,000 + Strong Benefits Package We're looking for a Data Engineer to join our client growing Data Science team and help them shape the future of their internal and external data infrastructure. … What You'll Do Design, build, and maintain scalable cloud based ETL pipelines to ingest and transform data from various sources Work with large datasets to ensure data integrity, quality, and availability across platforms Optimize and manage data workflows in AWS (S3, Redshift, Glue, Lambda, etc.) Write clean, efficient SQL for complex data … version control (e.g., Git) Strong problem-solving skills and a collaborative mindset Desirable Experience Experience with orchestration tools like Airflow or AWS Step Functions Familiarity with data lake and data mesh architectures Exposure to containerization (Docker) and CI/CD practices Contact: To find out more or to apply, please reach out to Laurence Powell More ❯

Data Engineer Warrington - Hybrid £50,000 - £60,000 - Depending on experience Focus 5 Recruitment are working with an exciting software business to help recruit a Data Engineer. The company have just been awarded 2 large contracts with international Mobile Network Operators. Appointed to help them source a Data Engineer, we’re looking for an … experienced Data Engineer to design and optimize our client’s data pipelines and storage solutions. This is an amazing opportunity to work with a growing and ambitious software business who have contracts with some of the world’s leading mobile network companies. They are looking for candidates who can come in at a key point in … their growth and develop their career as they grow. Key responsibilities for the Data Engineer – Design and build high-performance, low-latency data pipelines capable of processing large volumes of data at high speed. Develop and enhance real-time and batch data processing architectures. Manage both structured and unstructured data More ❯

Data Engineer Warrington - Hybrid £50,000 - £60,000 - Depending on experience Focus 5 Recruitment are working with an exciting software business to help recruit a Data Engineer. The company have just been awarded 2 large contracts with international Mobile Network Operators. Appointed to help them source a Data Engineer, were looking for an experienced … Data Engineerto design and optimize our clients data pipelines and storage solutions. This is an amazing opportunity to work with a growing and ambitious software business who have contracts with some of the worlds leading mobile network companies. They are looking for candidates who can come in at a key point in their growth and develop … their career as they grow. Key responsibilities for the Data Engineer Design and build high-performance, low-latency data pipelines capable of processing large volumes of data at high speed. Develop and enhance real-time and batch data processing architectures. Manage both structured and unstructured data, ensuring efficient ingestion, transformation More ❯

provide a range of exciting challenges including cloud computing, AI, consolidation, migration, integrations and simplification. Solutions typically involve changes to, or creation of, business processes, operating model, application, data flows, infrastructure, and integration of third-party services. You have a solid grasp of the concepts of business goals, objectives and business outcomes, business capabilities, value-streams and business … business needs and align with target/transition states, and architectural governance and standards. Hands-on experience in modelling languages such as C4 and ArchiMate. Robust understanding of data and application migration technologies like Azure Data Factory. Knowledge of core policy platforms like Bravura Sonata, TCS BaNCS, FNZ and bespoke legacy systems. Skills to modernise architectural … like RESTful APIs, Kafka, API Management Cloud migration frameworks (Azure functions, Logic Apps, App Services) Java frameworks and technologies Database technologies and platforms like SQL, NoSQL, Data Lake, Snowflake, Databricks, MongoDB, Oracle Observability platforms like Splunk, Dynatrace, Datadog, Grafana About Royal London We're the UK's largest mutual life, pensions and investment company, offering protection, long More ❯

The Data Analyst will play a key role, working with the business teams to plan and deliver these new reporting capabilities. This will include gathering requirements, working with the teams to understand and access the date, building, testing and improving reports. Additionally, the Data Analyst will support other colleagues. Role Support the IT Manager in planning … and execution of the new data/reporting strategy and improvement initiatives. Responsible for the delivery of new reports and dashboards across the Credit Union. Develop and implement databases, data collection systems and data engineering solutions that optimise reporting efficiency and clarity. Acquire data from primary or secondary data sources … and maintain databases/data lakes. Interpret data, analyse results using statistical techniques and provide ongoing reports. Identify, analyse, and interpret trends or patterns in complex data sets. Filter and “clean” data by reviewing raw data, reports, and performance indicators to locate and correct code problems. Work with management to More ❯

Lead Backend Engineers (Platform Experience & Data Warehousing teams) Location: UK, Ireland, Poland, Lithuania, Spain, Portugal, Finland numi are proud to have partnered with a front runner in data integration technology providing fantastic experience for their clients (who are some of the biggest names in the space)! We are looking for experienced Lead Backend Engineers (PHP) to … join either Platform Experience or Data Warehousing teams. The Platform Experience team focuses on optimising end-to-end platform journeys and building impactful customer experiences. They are currently developing a data visualisation tool (dashboards) and build features primarily from scratch. … The Data Warehousing team is responsible for data storage and transfer solutions, helping users streamline data transfers to data warehouses/datalakes and improving internal storage. This involves scaling, refactoring, and enhancing a complex data transfer system handling large data volumes. As a Lead Backend Engineer, you will More ❯

Lead Backend Engineers (Platform Experience & Data Warehousing teams) Location: UK, Ireland, Poland, Lithuania, Spain, Portugal, Finland numi are proud to have partnered with a front runner in data integration technology providing fantastic experience for their clients (who are some of the biggest names in the space)! We are looking for experienced Lead Backend Engineers (PHP) to … join either Platform Experience or Data Warehousing teams. The Platform Experience team focuses on optimising end-to-end platform journeys and building impactful customer experiences. They are currently developing a data visualisation tool (dashboards) and build features primarily from scratch. … The Data Warehousing team is responsible for data storage and transfer solutions, helping users streamline data transfers to data warehouses/datalakes and improving internal storage. This involves scaling, refactoring, and enhancing a complex data transfer system handling large data volumes. As a Lead Backend Engineer, you will More ❯

Lead Backend Engineers (Platform Experience & Data Warehousing teams) Location: UK, Ireland, Poland, Lithuania, Spain, Portugal, Finland numi are proud to have partnered with a front runner in data integration technology providing fantastic experience for their clients (who are some of the biggest names in the space)! We are looking for experienced Lead Backend Engineers (PHP) to … join either Platform Experience or Data Warehousing teams. The Platform Experience team focuses on optimising end-to-end platform journeys and building impactful customer experiences. They are currently developing a data visualisation tool (dashboards) and build features primarily from scratch. … The Data Warehousing team is responsible for data storage and transfer solutions, helping users streamline data transfers to data warehouses/datalakes and improving internal storage. This involves scaling, refactoring, and enhancing a complex data transfer system handling large data volumes. As a Lead Backend Engineer, you will More ❯

Lead Backend Engineers (Platform Experience & Data Warehousing teams) Location: UK, Ireland, Poland, Lithuania, Spain, Portugal, Finland numi are proud to have partnered with a front runner in data integration technology providing fantastic experience for their clients (who are some of the biggest names in the space)! We are looking for experienced Lead Backend Engineers (PHP) to … join either Platform Experience or Data Warehousing teams. The Platform Experience team focuses on optimising end-to-end platform journeys and building impactful customer experiences. They are currently developing a data visualisation tool (dashboards) and build features primarily from scratch. … The Data Warehousing team is responsible for data storage and transfer solutions, helping users streamline data transfers to data warehouses/datalakes and improving internal storage. This involves scaling, refactoring, and enhancing a complex data transfer system handling large data volumes. As a Lead Backend Engineer, you will More ❯

Lead Backend Engineers (Platform Experience & Data Warehousing teams) Location: UK, Ireland, Poland, Lithuania, Spain, Portugal, Finland numi are proud to have partnered with a front runner in data integration technology providing fantastic experience for their clients (who are some of the biggest names in the space)! We are looking for experienced Lead Backend Engineers (PHP) to … join either Platform Experience or Data Warehousing teams. The Platform Experience team focuses on optimising end-to-end platform journeys and building impactful customer experiences. They are currently developing a data visualisation tool (dashboards) and build features primarily from scratch. … The Data Warehousing team is responsible for data storage and transfer solutions, helping users streamline data transfers to data warehouses/datalakes and improving internal storage. This involves scaling, refactoring, and enhancing a complex data transfer system handling large data volumes. As a Lead Backend Engineer, you will More ❯

Lead Backend Engineers (Platform Experience & Data Warehousing teams) Location: UK, Ireland, Poland, Lithuania, Spain, Portugal, Finland numi are proud to have partnered with a front runner in data integration technology providing fantastic experience for their clients (who are some of the biggest names in the space)! We are looking for experienced Lead Backend Engineers (PHP) to … join either Platform Experience or Data Warehousing teams. The Platform Experience team focuses on optimising end-to-end platform journeys and building impactful customer experiences. They are currently developing a data visualisation tool (dashboards) and build features primarily from scratch. … The Data Warehousing team is responsible for data storage and transfer solutions, helping users streamline data transfers to data warehouses/datalakes and improving internal storage. This involves scaling, refactoring, and enhancing a complex data transfer system handling large data volumes. As a Lead Backend Engineer, you will More ❯

Lead Backend Engineers (Platform Experience & Data Warehousing teams) Location: UK, Ireland, Poland, Lithuania, Spain, Portugal, Finland numi are proud to have partnered with a front runner in data integration technology providing fantastic experience for their clients (who are some of the biggest names in the space)! We are looking for experienced Lead Backend Engineers (PHP) to … join either Platform Experience or Data Warehousing teams. The Platform Experience team focuses on optimising end-to-end platform journeys and building impactful customer experiences. They are currently developing a data visualisation tool (dashboards) and build features primarily from scratch. … The Data Warehousing team is responsible for data storage and transfer solutions, helping users streamline data transfers to data warehouses/datalakes and improving internal storage. This involves scaling, refactoring, and enhancing a complex data transfer system handling large data volumes. As a Lead Backend Engineer, you will More ❯