Immigration Minister Mark Harper has said the increase in the number of outstanding immigration and asylum cases raises "legitimate concerns".
In a statement, he said:
This report raises some legitimate concerns but we are taking robust action and it is working.
Every day it gets harder to live illegally in the UK - we are tracking people down and taking action against them.
We are restricting access to benefits, free healthcare and financial products, and businesses can be fined up to £10,000 for every illegal worker they employ.
We are winning more deportation cases in the courts, exceeding visa processing targets and have introduced interviews to test whether foreign students are genuine - all of which are praised in this report.
More top news
Blizzard-like conditions at times across central Scotland with up to 20cm of snow on the hills. Warning in force until 10pm this evening.
A former pole-dancer Natasha Gordon has been jailed for fours years at for encouraging the suicide of Matthew Birkinshaw from Walsall.
Love was in the air for two cabin attendants who were married by Pope Francis in an impromptu mid-flight ceremony.