The Poundstretcher store in Blackwood is being demolished following a blaze in the early hours of Wednesday morning.
South Wales Fire and Rescue Service say the cause of the fire was bins being set alight.
Fire crews were called out at around 2 o'clock this morning.
Officers say refuse bins were on fire and this had spread to the store room at the back of the shop.
Due to safety concerns the High Street was closed and the electricity supply to a number of shops was cut. Structural engineers were called out to assess the safety of the building.
More top news
Western areas will see the wet and windy stuff continue overnight! And then tomorrow - i'm very sorry to say - there is more of it to come!
Dolaucothi Gold Mines is among five locations battling it out to be crowned Wales' best place in this year's Special Places competition.
It's the latest in a series of incidents, despite safety measures being put in place after the death of an off-duty police officer in March.