The Treasury said it was "important that people pay the tax they owe on time" after plans to allow the taxman to seize money from personal bank accounts were criticised by a group of MPs.
A spokesman said: "Although the vast majority do this, there is still a minority that chooses not to pay, despite being able.
"The proposed powers will give HMRC [HM Revenue and Customs] another tool to collect tax debt owed.
"The current consultation includes a range of safeguards to ensure the power is tightly targeted."
More top news
Matt Hancock believes the devices can have a “real impact” on pupils’ achievements.
Court of Appeal judges in London will review his 30-year jail term for sex offences against boys he coached between 1979 and 1991.
Brexit and security, cannabis law and children’s mobiles dominate the papers on Wednesday.