A criminal investigation has been opened into government electronic tagging contracts held with Serco, as well as G4S, the Serious Fraud Office (SFO) said.
An audit by accountancy firm PricewaterhouseCoopers, launched in May, alleged that overcharging began at least as far back as the start of the current contracts in 2005 but could have dated back to 1999.
Justice Secretary Chris Grayling told the two firms that an independent forensic audit was required to look at internal email trails between executives to establish what happened. While Serco agreed to take part, G4S refused.
Serco allowed a further forensic audit to take place but G4S refused to co-operate and were reported to the SFO.
More top news
Jeremy Corbyn's economic policies would harm the poor and leave the Tories in power for a decade, Chris Leslie has warned.
Landlords have been warned they could face up to five years in prison if they fail to remove illegal immigrants from properties.
A picture of Cecil the lion - the animal killed by an American dentist in Zimbabwe - has been projected on to the Empire State Building.