Immigration minister Damian Green said London Metropolitan University was "very, very deficient" sponsor because more than a quarter of students sampled were studying there when they did not have permission to stay in the country.
A "significant proportion" of students did not have a good standard of English and there was no proof that half of those sampled were turning up to lectures, he added.
"Any one of those breaches would be serious. We found all three of those breaches at London Metropolitan.
"I'm not chucking anyone out, we have actually set up a task force to make sure genuine students can stay in the country" he said.
More top news
The Met Police says 143 firearms have been handed in at stations across the capital in just seven days, including two antique machine guns.
The pair filmed themselves clinging on as the train travelled from Essex to London at high speed.
Around 60 firefighters tackled the blaze at the four-storey building in Daleham Gardens, Hampstead, that broke out early on Tuesday.