Debt as a percentage of gross domestic product (GDP) - a broad measure for the total economy - hit 65% in May, up from 61.3% last year.
April's borrowing figures were flattered by a one-off £28 billion lift from the value of assets transferred from the Royal Mail pension plan.
But excluding this one-off impact, total borrowing for the current financial year stands at £28.4 billion.
Earlier this month, the Chancellor and Governor of the Bank of England Sir Mervyn King unveiled a multibillion-pound lending scheme to stimulate economic growth - but ministers insisted the move was not a "Plan B".
More top news
A police officer who sparked a terror alert by making a hoax 999 call to his own force has had his "unduly lenient" jail term increased.
Autumn weather arrives for the early part of the weekend, brighter on Sunday.
The Prince and Princess are being treated to a petting zoo and a puppet show along with the children of local military families.