Labour leader Ed Miliband has promised an independent review into the way HMRC investigates tax evasion.
Speaking to delegates at the Welsh Labour Party Conference, he said:
Ed Balls and I are today announcing an independent, root and branch review of the culture and practice of HMRC when it comes to tax evasion and aggressive tax avoidance. While this government has had five years of inaction, we will begin from the first days we are in government and it will report within three months. It will shine a light on parts of our tax system that have been shrouded in secrecy under this government.
Labour leader Ed Miliband has accused the Government of "shrugging its shoulders on tax avoidance".
He said there was "one rule for the rich and powerful and another rule for everyone else" and criticised the "hugely complex ... tax schemes often based offshore" that he says has cost the nation's finances £34 billion.
Nearly 360,000 people have filed self-assessment tax returns in a last-minute rush to meet the deadline.
HM Revenue & Customs (HMRC) said the forms were received between midnight and 9pm on Saturday and almost 10.2 million had been filed in total.
The deadline for submitting an online self-assessment tax return and paying any tax due was midnight on Saturday 31st January.
Those in self-assessment who fail to meet this face an initial fixed penalty of £100, even if there is no tax to pay, plus interest on any tax not paid by the due date.
All tax returns which are still outstanding must be submitted online, as the deadline for filing paper returns passed on 31st October last year.
On last year's deadline day, 557,000 people scrambled to get their returns in online.
Business leaders have called on the Government to merge or scrap taxes raising less than £5 billion for the Treasury.
The Institute of Directors (IoD) said taxes such as stamp duty on shares, air passenger duty, and capital gains and inheritance tax could be simplified or reduced.
Stephen Herring, head of taxation at the IoD, said: "The basic principles here are that taxes should be focused purely upon the fiscal revenues collected and their wider economic impact. They should not be confiscatory, punishing or unduly complex."
He added: "We continue to support the priority given to reducing the UK's annual fiscal deficit and recognise that this is no easy task. We also support reforms that have improved the UK's competitive ranking as a business friendly country.
"However, we have been disappointed with the pace of tax reform under the Coalition, and a more radical agenda for tax reforms is now needed."
The National Audit Office examined 10 tax breaks in detail to see whether the government was monitoring them properly.
It found data was not always held on the cost of reliefs to the public purse, even when it was thought to be in the order of hundreds of millions of pounds.
HMRC rarely assessed if tax breaks were having the desired effects on behaviour, or whether they were being widely abused.
Of 46 high-value reliefs with economic or social objectives, 11 had increased by at least a quarter in real terms since 2007.
Although the department had theories as to why the costs may have shifted, "it tended to seek the most obvious explanation and did not try to definitively rule out abuse", the report said.
A spending watchdog has said that billions of pounds in tax could have been dodged because the government is failing to track abuse of reliefs.
The National Audit Office (NAO) found HM Revenue & Customs (HMRC) had done little to investigate why Entrepreneurs' Relief introduced in 2008 was costing the public purse £2 billion a year more than expected.
Claims for share loss relief soared by more than 300% to £1.2 billion in 2006/07 after a number of aggressive avoidance schemes appeared - but the taxman did not identify the scale of the increase until 2013.
Tax evaders are being pursued at "unacceptably slow" levels by HM Revenue and Customs, putting millions of pounds due for Treasury coffers at risk, according to a critical report by MPs.
The agency has also overstated the success of its attempts to crackdown on the practise because its targets were set too low, the Public Accounts Committee found.
MPs warned that up £10 million of the total £400 million tax at stake may not be recoverable because HMRC failed to start inquiries into 30 cases within the legal deadline.
Public accounts committee chair Margaret Hodge said: "HMRC must do more, faster. It should report on the progress it has achieved by using new powers granted by Parliament to tackle tax avoidance and show that it is using its existing powers with sufficient urgency.
"HMRC does not do enough to tackle companies which exploit international tax structures to minimise UK tax liabilities."
David Cameron said he feels a "moral duty" to cut taxes and claimed the average worker will save £3,800 by 2020 under a future Conservative government.
Writing in The Times, the Prime Minister issued a reminder of his promise of tax cuts worth £7.2 billion to 30 million voters.
He has pledged to raise the threshold at which workers pay the higher 40p rate of income tax to £50,000, while increasing the personal allowance below which no tax is payable to £12,500.
It is morally right that the rich pay their fair share in tax; and right that those who are able to contribute to our public services and safety nets do so.
Taking aim at Labour spending he said "we must be mindful of who picks up the bill" but the Opposition accused him of failing to explain how reductions would be paid for and ignoring the impact of benefit cuts on low-paid families.
Shadow Treasury chief secretary Chris Leslie said: "David Cameron will be judged on his actions, not his words. He's raised taxes 24 times.
"While millionaires have been given a huge tax cut, ordinary working people are paying more because he raised VAT and cut tax credits."
A spokesman for the Driver and Vehicle Licensing Agency has said that changes to the rules of tax discs will not affect the agency's ability to enforce the law:
There is absolutely no basis to these figures and it is nonsense to suggest that getting rid of the tax disc will lead to an increase in vehicle tax evasion.
We have a proven track record in making vehicle tax easy to pay but hard to avoid, with over 99% of all vehicles taxed. Given the systems now in place we take enforcement action direct from our electronic records rather than requiring a tax disc.
The chief engineer for RAC has said that a survey shows there is "clearly concern among motorists about forthcoming changes to tax disc rules:
There is clearly concern among motorists over the issue of enforcement. Most of the changes make sense and will benefit the motorist, but too many motorists are unaware of the detail.
The big question has to be whether enforcement using only cameras and automatic number plate recognition will be sufficiently effective.