The Government has already invested billions in Britain's housing and has the "fastest rate of affordable house building in two decades," the Housing Minister said.
Refuting accusations by Shelter, Mr Prisk argued "affordability" for first time buyers was at its most "favourable" in a decade.
Mark Prisk, the housing and local government minister, told the Daily Telegraph shop owners must do more if they are to win back customers who have turned to the internet.
The warning comes as the Department of Communities and Local Government today awarded seven towns a share of £1 million in return for successfully breathing new life into their high streets.
Mr Prisk said the Government is doing "all it could" to help shops survive, including reducing business rates and encouraging local councils to be more flexible with parking.
"We will keep providing support where it is needed, but it takes more than funding to make this work," he told the Daily Telegraph.
"As consumers, our behaviour has changed. High streets need to respond to that change if they are to prosper."