A criminal investigation has been opened into government electronic tagging contracts held with Serco, as well as G4S, the Serious Fraud Office (SFO) said.
An audit by accountancy firm PricewaterhouseCoopers, launched in May, alleged that overcharging began at least as far back as the start of the current contracts in 2005 but could have dated back to 1999.
Justice Secretary Chris Grayling told the two firms that an independent forensic audit was required to look at internal email trails between executives to establish what happened. While Serco agreed to take part, G4S refused.
Serco allowed a further forensic audit to take place but G4S refused to co-operate and were reported to the SFO.
More top news
Firms that fail to address the pay gap between male and female employees with be listed in new league tables.
John Kerry says US and Russian diplomats have agreed to implement a "cessation of hostilities" in Syria
A young man dramatically rescued by the Turkish coastguard from a sinking boat has spoken of his ordeal.