The Government has rejected an offer from security firm G4S to repay the £24m it owes for overcharging in credit notes.
Officials turned down the settlement and say they will "pursue all possible avenues" to recoup more taxpayers' money.
A Ministry of Justice spokesman said it was still working with the firms and the independent auditors to work out "what the final sum will be".
"The Secretary of State has been clear: we are determined to secure a refund for the taxpayer.
"We have taken appropriate legal advice and will pursue all possible avenues."
More top news
Rebecca Wooller and Blake Green will marry in front of shoppers at their local branch of the store in Cambourne, Cambridgeshire.
Fans have been given the first look at the new 007 film starring Daniel Craig as the secret agent and directed by Sam Mendes.
Nicola Sturgeon will today pledge that her party will work with others to bring about "positive change" for ordinary people across the UK.