Debt as a percentage of gross domestic product (GDP) - a broad measure for the total economy - hit 65% in May, up from 61.3% last year.
April's borrowing figures were flattered by a one-off £28 billion lift from the value of assets transferred from the Royal Mail pension plan.
But excluding this one-off impact, total borrowing for the current financial year stands at £28.4 billion.
Earlier this month, the Chancellor and Governor of the Bank of England Sir Mervyn King unveiled a multibillion-pound lending scheme to stimulate economic growth - but ministers insisted the move was not a "Plan B".
More top news
Some dogs have been at the Battersea Dogs and Cats Home for more than a year. Can you make their Christmas and give them a new home?
Selfless Donna Wood from Staffordshire has left her husband and children at home so she can help save lives in Sierra Leone.
From Sierra Leone to Cyprus, 8,500 Christmas boxes were sent out to every serviceman and woman from the UK.