Immigration minister Damian Green said London Metropolitan University was "very, very deficient" sponsor because more than a quarter of students sampled were studying there when they did not have permission to stay in the country.
A "significant proportion" of students did not have a good standard of English and there was no proof that half of those sampled were turning up to lectures, he added.
"Any one of those breaches would be serious. We found all three of those breaches at London Metropolitan.
"I'm not chucking anyone out, we have actually set up a task force to make sure genuine students can stay in the country" he said.
More top news
Two women had to be rushed to hospital after the driver of a 'BMW' mounted the pavement in a hit-and-run crash.
The shocking moment a cyclist was threatened by a driver with a metal baseball has been captured on a video posted online.
Music festivals and big sporting venues put on on “high alert” - one of Britain's most senior anti-terror police officers has revealed.