24 of 24 Data Lake Jobs in Manchester

FDM is a global business and technology consultancy seeking a Senior Data Engineer to work for our client within the transport sector. This is initially a 6-month contract with the potential to extend and will be a hybrid role based in Manchester. Our client is looking for an experienced Senior Data Engineer with a strong … the design, build, and optimisation of enterprise-grade data solutions. The role requires hands-on expertise in developing advanced data pipelines, architecting data lake structures, aligning governance frameworks, and enabling robust reporting capabilities. The ideal candidate will be someone who can take end-to-end ownership of data engineering initiatives and … and regulatory requirements Requirements Minimum of 5 years’ experience as a Senior Data Engineer in Azure cloud environments Strong hands-on skills with ADF, Data Lake, Power BI, and Azure DevOps Demonstrated ability to architect scalable, secure, and governed data platforms Solid understanding of data governance and Data Fabric More ❯

health and life sciences, and transport. The Data Engineer will have experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. You will join the business at a period of huge growth. WE ALSO HAVE OPENINGS IN THE FOLLOWING AREAS – BRISTOL, LONDON. … growing capability, and we are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. What you … requirements You thrive in problem-solving and analytical thinking You enjoy collaborating with multiple stakeholders in a fast-paced environment Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing scripts, extracting data More ❯

health and life sciences, and transport. The Data Engineer will have experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. You will join the business at a period of huge growth. WE ALSO HAVE OPENINGS IN THE FOLLOWING AREAS – BRISTOL, LONDON. … growing capability, and we are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. What you … requirements You thrive in problem-solving and analytical thinking You enjoy collaborating with multiple stakeholders in a fast-paced environment Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing scripts, extracting data More ❯

Senior Data Engineer, Databricks, £ 60000 - 65000 + benefits. Strong Performant SQL and Databricks required. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks and Performant SQL is required for this role. Knowledge of testing, the finance sector or energy sector is a distinct advantage. Expanding SaaS product company are looking … for a number of Senior Data Engineers as they continue to grow. In these hands-on roles you will be part of the team responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing … technical solutions. Excellent knowledge of the SDLC, including testing and delivery in an agile environment. Excellent knowledge of ETL Experience of data warehousing and data lake solutions. Experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand its data team. In More ❯

Data Engineer to join a growing data team. Youll work across servers and their central data lake, developing and maintaining pipelines that support reporting, analytics, and AI-driven initiatives. Key Responsibilities Build and maintain scalable data pipelines into the central data lake. Work with tools such as Alteryx to … automate and optimise workflows. Write efficient SQL queries for data extraction, transformation, and reporting. Develop in Python , including exposure to AI/ML libraries where appropriate. Collaborate with colleagues to improve data quality, governance, and availability. Support delivery of data to business users in a secure and efficient way. Requirements Strong experience with SQL … interest in AI/ML. Hands-on experience with Alteryx or similar workflow/ETL tools. Experience with servers and managing data in a data lake environment. Good communication skills and ability to work with both technical and business users. Working Pattern Based at Whitefield office . Hybrid working available otherwise open minded depending on More ❯

Remote Data Architect sought by a well-established company in their industry; our client is seeking an adept professional to spearhead strategic leadership and technical expertise within their data solutions landscape, focussed on cloud data platforms, but including IoT analytics, data integration, and migration projects. This unique opportunity is offered on a … remote-first basis, but with an open invitation to their headquarters any time. Role Responsibilities: The Data Architect will be pivotal in shaping the approach to designing and developing data solutions using cloud technologies such as AWS and Azure. This position involves: - Leading the design and implementation of innovative cloud data platforms. - Setting standards … business intelligence roles. - Proficiency in ETL and data pipeline design, with a technology-agnostic approach. - A solid understanding of data warehouse and data lake principles. - Expert SQL skills and demonstrable data modelling capabilities. About the Company: Our client is a well-established organisation in their field, known for innovation and excellence. More ❯

Remote Data Architect sought by a well-established company in their industry; our client is seeking an adept professional to spearhead strategic leadership and technical expertise within their data solutions landscape, focussed on cloud data platforms, but including IoT analytics, data integration, and migration projects. This unique opportunity is offered on a … remote-first basis, but with an open invitation to their headquarters any time. Role Responsibilities: The Data Architect will be pivotal in shaping the approach to designing and developing data solutions using cloud technologies such as AWS and Azure. This position involves: - Leading the design and implementation of innovative cloud data platforms. - Setting standards … business intelligence roles. - Proficiency in ETL and data pipeline design, with a technology-agnostic approach. - A solid understanding of data warehouse and data lake principles. - Expert SQL skills and demonstrable data modelling capabilities. About the Company: Our client is a well-established organisation in their field, known for innovation and excellence. More ❯

Test Engineer Data Platforms (FTC-6months Hybrid | London or Manchester) My client is looking for an experienced Test Engineer to take ownership of testing across modern data platforms. This is a hands-on role where you’ll design, implement, and execute test strategies for data pipelines, models, and reporting solutions built on Azure technologies. … Key Responsibilities Define and own the overall testing strategy for data pipelines, data models, and BI solutions. Develop and implement automated testing frameworks integrated with CI/CD pipelines. Design and execute test cases across … data ingestion, transformation, storage, and presentation layers. Validate data accuracy, performance, and usability within Azure Databricks, Azure Data Factory, Azure Data Lake Storage, and Power BI. Establish and monitor data quality checks, reconciliation, and compliance processes. Collaborate closely with data engineers, BI developers, architects, and product owners More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to … consider candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design … Experience designing and developing ETL/ELT processes using the Azure platform - Azure Synapse, Data Factory, Databricks or Fabric Knowledge of data lakes and medallion lake house design Working knowledge of Power BI or similar is desirable Strong communication, stakeholder management and problem-solving skills Microsoft Certifications are desirable but not essential Benefits: Salary of More ❯

private and public sectors. Driven by innovation and quality, they combine strategic thinking with deep technical capability to deliver transformational technology solutions. How youll spend your day Building data pipelines using Azure data factory for data ingestion Looking after the data integration, data conformity, data integrity and ensure … the data structures are designed for future business needs and enhancements Ensure that data transformations are well recorded and follow best practices so that it is easily understood by developers and analysts Work directly with the business to support various projects and solutions Using problem solving skills as challenges arise Process mining to scope and deliver … and with strong communication skills Strong business-to-technology translation skills for identifying ways to apply solutions to help customers improve performance Strong verbal and written communication Azure Data Factory/Data Lakes/Databricks SQL server experience (SSIS, SSMS) Experience with Data Warehouse solutions Desirable but not essential Python is also desirable Understanding More ❯

This role involves designing, developing, and maintaining robust data pipelines to support analytics within the industrial and manufacturing sector. The successful candidate will be heavily involved in supporting our cloud migration transition. Client Details Based in Manchester City Centre, we are a leader in our field in the UK and Ireland We are a testing, inspection, certification, and … We serve over 35,000 customers with services like electrical testing, asset management, non-destructive testing (NDT), and inspections for infrastructure, manufacturing, and healthcare facilities. Description The Successful Data Engineer will be responsible for but not limited to: Development and implement data … and reporting solutions from our Dynamics, in-house and 3rd party sources, using the latest Microsoft technologies: Azure Synapse Analytics & Azure Data Factory, Azure Data Lake, Azure SQL Database, Support older Microsoft Technologies whilst we are in transition: SSIS and SSRS. Supporting change and migration efforts. Work with other members of the team or directly More ❯

This role involves designing, developing, and maintaining robust data pipelines to support analytics within the industrial and manufacturing sector. The successful candidate will be heavily involved in supporting our cloud migration transition. Client Details Based in Manchester City Centre, we are a leader in our field in the UK and Ireland We are a testing, inspection, certification, and … We serve over 35,000 customers with services like electrical testing, asset management, non-destructive testing (NDT), and inspections for infrastructure, manufacturing, and healthcare facilities. Description The Successful Data Engineer will be responsible for but not limited to: Development and implement data … and reporting solutions from our Dynamics, in-house and 3rd party sources, using the latest Microsoft technologies: Azure Synapse Analytics & Azure Data Factory, Azure Data Lake, Azure SQL Database, Support older Microsoft Technologies whilst we are in transition: SSIS and SSRS. Supporting change and migration efforts. Work with other members of the team or directly More ❯

Contract Data Engineer - Azure, Databricks, SQL, Python 6 Weeks Outside IR35 £500-£600 per day Remote (occasional travel to Manchester or Glasgow) My client is delivering a high-impact data migration programme and is looking for a Data Engineer to join on a 6-week contract. This role will suit someone who thrives in … fast-moving delivery environments and has hands-on experience with modern data engineering tools. The Role Join a focused delivery team to execute a business-critical data migration Build, optimise and maintain data pipelines using Azure and Databricks Translate business requirements into technical solutions that ensure data accuracy, integrity and security Deliver … data engineering and automation Proven experience of data migration projects, ideally at enterprise scale Experience with Databricks and the wider Azure stack (Data Lake, Synapse, ADF) Solid understanding of data integration, transformation, and validation If you are an experienced Data Engineer who can hit the ground running and deliver More ❯

The Senior Data Engineer will play a pivotal role in developing and optimising data pipelines, ensuring the seamless flow of information across the organisation. The successful candidate will also be heavily involved in supporting our cloud migration project. Client Details Based in Manchester City Centre, we are a leader in our field in the UK and … serve over 35,000 customers with services like electrical testing, asset management, non-destructive testing (NDT), and inspections for infrastructure, manufacturing, and healthcare facilities. Description The Successful Senior Data Engineer will be responsible for but not limited to: · Development and implement data … and reporting solutions from our Dynamics, in-house and 3rd party sources, using the latest Microsoft technologies: Azure Synapse Analytics & Azure Data Factory, Azure Data Lake, Azure SQL Database Support older Microsoft Technologies whilst we are in transition: SSIS and SSRS. Supporting change and migration efforts. Work with other members of the team or directly More ❯

The Senior Data Engineer will play a pivotal role in developing and optimising data pipelines, ensuring the seamless flow of information across the organisation. The successful candidate will also be heavily involved in supporting our cloud migration project. Client Details Based in Manchester City Centre, we are a leader in our field in the UK and … serve over 35,000 customers with services like electrical testing, asset management, non-destructive testing (NDT), and inspections for infrastructure, manufacturing, and healthcare facilities. Description The Successful Senior Data Engineer will be responsible for but not limited to: · Development and implement data … and reporting solutions from our Dynamics, in-house and 3rd party sources, using the latest Microsoft technologies: Azure Synapse Analytics & Azure Data Factory, Azure Data Lake, Azure SQL Database Support older Microsoft Technologies whilst we are in transition: SSIS and SSRS. Supporting change and migration efforts. Work with other members of the team or directly More ❯

As the world of data engineering becomes increasingly pivotal in driving modern digital ecosystems, The Coventry is looking to welcome a Senior DataOps Engineer who can inspire and coach our existing Data Engineering teams. This is more than just a technical role, were looking to build a culture of innovation, ownership, and continuous improvement. Working alongside … domain-oriented, multi-disciplinary data product teams to design, develop, and test high-quality data solutions that serve as the backbone of our decision-making and digital services. What You'll Be Doing Drive automation and CI/CD practices across data pipelines and infrastructure Build robust, scalable, and secure infrastructure that supports our … data platform strategy Lead and mentor data engineers, fostering a high-performance, collaborative environment Play a central role in designing and developing a new cloud-based Data Ecosystem Work closely with stakeholders to analyse requirements, design test strategies, and ensure data quality and integrity through comprehensive testing Collaborate in an agile environment More ❯

As the world of data engineering becomes increasingly pivotal in driving modern digital ecosystems, The Coventry is looking to welcome a Senior DataOps Engineer who can inspire and coach our existing Data Engineering teams. This is more than just a technical role, were looking to build a culture of innovation, ownership, and continuous improvement. Working alongside … domain-oriented, multi-disciplinary data product teams to design, develop, and test high-quality data solutions that serve as the backbone of our decision-making and digital services. What You'll Be Doing Drive automation and CI/CD practices across data pipelines and infrastructure Build robust, scalable, and secure infrastructure that supports our … data platform strategy Lead and mentor data engineers, fostering a high-performance, collaborative environment Play a central role in designing and developing a new cloud-based Data Ecosystem Work closely with stakeholders to analyse requirements, design test strategies, and ensure data quality and integrity through comprehensive testing Collaborate in an agile environment More ❯

A small and highly successful organisation in the sustainability space are seeking a Data Engineer with some Power Platform experience to join their team. They have an office space in London, though this role is remote and is therefore open to candidates across the UK. They are on a mission to help businesses to reduce their carbon emissions … Responsibilities include: Use Azure Data Factory to ingest, transform, and expose data across the platform Help centralise data into a Data Lake, ensuring it's clean, structured, and accessible Build data pipelines for LLMs and integrate tools like GPT to drive intelligent outputs Develop user-facing applications using Power … It's a broad role with lots to get involved in! We're not expecting you to have experience with everything mentioned above - the core skills are Azure Data Factory, and having a self-starter mentality with an enthusiasm to learn new things! Benefits include: Salary up to £70,000 depending on experience 25 days annual leave plus More ❯

A small and highly successful organisation in the sustainability space are seeking a Data Engineer with some Power Platform experience to join their team. They have an office space in London, though this role is remote and is therefore open to candidates across the UK. They are on a mission to help businesses to reduce their carbon emissions … Responsibilities include: Use Azure Data Factory to ingest, transform, and expose data across the platform Help centralise data into a Data Lake, ensuring it's clean, structured, and accessible Build data pipelines for LLMs and integrate tools like GPT to drive intelligent outputs Develop user-facing applications using Power … It's a broad role with lots to get involved in! We're not expecting you to have experience with everything mentioned above - the core skills are Azure Data Factory, and having a self-starter mentality with an enthusiasm to learn new things! Benefits include: Salary up to £70,000 depending on experience 25 days annual leave plus More ❯

A small and highly successful organisation in the sustainability space are seeking a Data Engineer with some Power Platform experience to join their team. They have an office space in London, though this role is remote and is therefore open to candidates across the UK. They are on a mission to help businesses to reduce their carbon emissions … Responsibilities include: Use Azure Data Factory to ingest, transform, and expose data across the platform Help centralise data into a Data Lake, ensuring it's clean, structured, and accessible Build data pipelines for LLMs and integrate tools like GPT to drive intelligent outputs Develop user-facing applications using Power … It's a broad role with lots to get involved in! We're not expecting you to have experience with everything mentioned above - the core skills are Azure Data Factory, and having a self-starter mentality with an enthusiasm to learn new things! Benefits include: Salary up to £70,000 depending on experience 25 days annual leave plus More ❯

A small and highly successful organisation in the sustainability space are seeking a Data Engineer with some Power Platform experience to join their team. They have an office space in London, though this role is remote and is therefore open to candidates across the UK. They are on a mission to help businesses to reduce their carbon emissions … Responsibilities include: Use Azure Data Factory to ingest, transform, and expose data across the platform Help centralise data into a Data Lake, ensuring it's clean, structured, and accessible Build data pipelines for LLMs and integrate tools like GPT to drive intelligent outputs Develop user-facing applications using Power … It's a broad role with lots to get involved in! We're not expecting you to have experience with everything mentioned above - the core skills are Azure Data Factory, and having a self-starter mentality with an enthusiasm to learn new things! Benefits include: Salary up to £70,000 depending on experience 25 days annual leave plus More ❯

days on-site) £40,000 £50,000 + benefits Were partnered with a fast-growing technology business that is undergoing a major transformation programme to modernise its data and analytics capabilities. Theyre looking for a Business Intelligence Developer who can play a key role in shaping the way data is used across the organisation. This is … an opportunity to get involved in a large-scale, complex data environment and make a tangible impact on how insights drive decision-making at a global level. What youll be doing Designing and developing Power BI dashboards and reports that provide meaningful insight and data storytelling for senior stakeholders. Working with large, complex datasets from multiple … sources, ensuring they are queried, modelled, and optimised for reporting. Collaborating with engineers and analysts to develop data pipelines and models that feed enterprise-level reporting solutions. Supporting the ongoing transformation programme , helping to break down legacy reporting structures and introduce modern BI practices. Partnering closely with commercial, finance, and operational teams to ensure reporting is aligned with More ❯

ll join the Platform & AI Enablement team within our GPTO Engineering organization, reporting to the Sr. Director Engineering API. The team is responsible for building and supporting the data and AI platforms that underpin our industry-leading Business Planning Software solutions. This is a highly hands-on role focused on designing, building, and operating scalable systems that integrate … event-driven, batch & streaming data flows, and AI capabilities into the platform. Your Impact Build and maintain core platform capabilities that support high-throughput batch, streaming, and AI-powered workloads. Develop resilient, observable, and scalable systems using Apache Kafka, Flink, Pulsar, and cloud-native tools. Collaborate with AI/ML engineers to operationalize models and enable generative AI … use cases such as prompt-based insights or automation. Deliver reliable integrations with data lakes, event stores, and analytics systems, ensuring data flows efficiently across the business planning ecosystem. Contribute full-stack code where needed, including React-based frontends and backend services in Java and Python. Write clean, maintainable, well-tested code with an emphasis on More ❯

Description As part of the Platform & AI Enablement team under GPTO Engineering, you'll report to the Sr. Director Engineering API. This team is accountable for shaping enterprise data architecture, enabling high-performance AI-driven workloads, and acting as a technical bridge between engineering and architecture. This is a hands-on role for a deeply experienced engineer who … thrives on solving complex problems and scaling robust platforms. Your Impact Influence the design and implementation of platform capabilities for data processing, AI enablement, and developer acceleration across batch, streaming, and real-time systems. Collaborate with the architecture function to represent engineering needs and help translate architectural direction into practical implementation patterns. Guide teams in integrating AI/… strategy discussions. Help teams balance speed and sustainability-delivering under tight deadlines without compromising quality. Your Qualifications 12+ years of software engineering experience, ideally in platform, infrastructure, or data-centric product development. Expertise in Apache Kafka, Apache Flink, and/or Apache Pulsar. Deep understanding of event-driven architectures, data lakes, and streaming pipelines. Strong experience More ❯