Debt as a percentage of gross domestic product (GDP) - a broad measure for the total economy - hit 65% in May, up from 61.3% last year.
April's borrowing figures were flattered by a one-off £28 billion lift from the value of assets transferred from the Royal Mail pension plan.
But excluding this one-off impact, total borrowing for the current financial year stands at £28.4 billion.
Earlier this month, the Chancellor and Governor of the Bank of England Sir Mervyn King unveiled a multibillion-pound lending scheme to stimulate economic growth - but ministers insisted the move was not a "Plan B".
More top news
Crowds of people gathered in Sandringham on Sunday to catch a glimpse of Princess Charlotte as she arrived for her official christening.
The Chancellor has "found" the £12bn of benefit cuts promised in the Tory election manifesto - here's what we know about the savings so far.
The pair, including a man in his 50s, were struck around midday on the Pen y Fan mountain range in Powys, mid-Wales.