Britain spends up to £1 billion a year dealing with foreign criminals living here, according to a report by the National Audit Office released today.
The study also found that around 9% fewer foreign criminals were deported from Britain since a peak of 5,613 in 2008.
Around 10,700 foreign nationals are currently in Britain's prisons - while another 4,200 have been released and are living freely in the country.
Another 760 - including 58 'high risk' criminals - are currently 'missing', the watchdog says.
The UK Independence Party's culture spokesman has expressed regret that former Radio 1 DJ Mike Read has withdrawn his Ukip Calypso record.
Peter Whittle said he did not believe anyone was offended by the song - which featured Read singing in a mock Caribbean accent - adding that it was "unfortunate" that Read had asked his record company to stop selling the record.
"There are professional offence takers and those people this time have won the day," Whittle told ITV News.
Moira Jones was brutally murdered by a Latvian convict in 2008. Her mother wants action to stop dangerous convicts at the border.Read the full story ›
Labour have said the Government is falling far short of the numbers of people it said would be moved on to the new Universal Credit scheme.
Chris Bryant, shadow welfare reform minister, said: "Iain Duncan Smith has repeatedly broken his promises on Universal Credit. He promised a million people would be claiming Universal Credit by April 2014, but the latest figures show fewer than 15,000 people are claiming the new benefit.
"Today Iain Duncan Smith promised 100,000 people will be on Universal Credit by May 2015. But that's only around 1% of the total number of people who are expected to claim the new benefit."
A new government report suggest trials of the Universal Credit welfare reform show it is on track to help people into work.
The study from the Department for Work and Pensions found those on the scheme were working more over a six-month period, while two-thirds said it offered better incentives to work.
The department says the scheme will deliver £35bn in economic benefits over 10 years after it is fully implemented.
The new credit is still in its early stages and will be available in over 90 job centres by this Christmas.
Work and Pensions Secretary Iain Duncan Smith said: : "Universal Credit will help people into work more quickly and help them to earn more, giving people the confidence that work always pays, along with the economic security of a regular pay packet."
The Home Secretary has hit back at Labour criticisms over foreign national criminals, saying the Government "have a plan and that plan is working"
Addressing MPs, She pointed to today's National Audit Office report, which said the number of removals of foreign national offenders (FNOs) had risen 12% in the last two years.
The report stated that this was "largely because of a change in the department's approach to deportation", Ms May added.
She also accused Labour themselves of failing to address the issue when in government, telling Shadow Home Secretary Yvette Cooper:
This is a long-standing problem. Her party didn't face up to it when they were in power and [the report] also makes clear that, unlike the party opposite, we have a plan to deal with it and that plan is working.
The Shadow Home Secretary has accused Theresa May of endangering the UK's border security by "faffing around" over co-operating with other European nations.
Yvette Cooper said the Government had delayed putting in place proper controls on foreign criminals by opting out of a shared European information system.
She also rejected Ms May's contention that problems with deporting foreign criminals had beset successive governments, saying:
She has been Home Secretary for four and a half years, the system is still failing on her watch and fewer foreign criminals are beign deported than when she started.
The tough talk is simply not enough. When will she start putting up the real fight we need to get more and not fewer foreign criminals deported back home.
David Cameron has said the "buck stops with me" when it comes to the "difficult issue" of deporting foreign criminals.
The Prime Minister was responding to a report from the National Audit Office (NAO) that said one in six foreign offenders in the UK could not be traced by the authorities.
He told MPs at Prime Minister's Questions that the NAO had highlighted the "obstacles" that human rights legislation presents when trying to deport foreign nationals.
Mr Cameron also pointed to changes the Government had made to improve the system, saying:
What you've seen from the Government is that we're now able to deport people first and they can appeal once they've gone back to their country of origin and we're reducing the number of appeal routes from 17 routes which were there under Labour to just four.
So, we're making progress, the buck stops with me but I wouldn't mind a bit of cross-party support for the actions we need to take.
Home Office errors are to blame for at least a third of failed removals of foreign criminals, the National Audit Office (NAO) says.
In a report, the organisation found that one in six foreign criminals living in the UK have absconded.
Louise Bladen, director of the NAO, said legal restrictions and delays in the process were also to blame for the number of criminals going missing.
Ukip have hit out after Mike Read withdrew his 'Ukip Calypso' song from sale.
A party spokesman said the DJ had been the victim of the "'right on' media" and the song was "just a bit of fun".
This is Mike's song and it is obviously his decision what to do with it. We do think it is a shame that he has been treated so harshly by many in the 'right on' media, but we respect his decision. We thought it was just a bit of fun, as did thousands of people, evidenced by how well it has been selling.
Were it not for the synthetic outrage, the song would have generated a lot of money for charity, as profits were to be split with the Red Cross for their Ebola Outreach programme. It's a pity those so concerned with political correctness have trodden all over this."