The head of the Financial Conduct Authority, Martin Wheatley, said the regulator wanted to "take out" unscrupulous payday lenders.
He told Radio 4's Today programme.
Our concern has been that parts of this industry, not all, loan without doing any affordability checks and then loading costs onto people who simply cannot pay, and that's the part of the industry that we really want to take out, we want them to improve their standards or leave the industry.
More top news
Boris Johnson is expected to attack George Osborne's plan to cut tax credits when he addresses the Conservative Party conference on Tuesday.
Incursions by Russian jets into Turkish airspace have prompted a stern response from Nato's most powerful ally.
Councils have welcomed the prospect of greater autonomy on business rates, but this is not as generous an act as it first appears.