Debt as a percentage of gross domestic product (GDP) - a broad measure for the total economy - hit 65% in May, up from 61.3% last year.
April's borrowing figures were flattered by a one-off £28 billion lift from the value of assets transferred from the Royal Mail pension plan.
But excluding this one-off impact, total borrowing for the current financial year stands at £28.4 billion.
Earlier this month, the Chancellor and Governor of the Bank of England Sir Mervyn King unveiled a multibillion-pound lending scheme to stimulate economic growth - but ministers insisted the move was not a "Plan B".
More top news
More than 100 Auschwitz survivors from at least 17 countries are expected to attend the main ceremony at the concentration camp.
The recovery is slowing continuing, but it is being driven by the service industry instead of manufacturing - keeping the wealth in London.
Will the 'potentially historic' snow storm hitting the US, find its way to the UK?