Defence Secretary Philip Hammond told ITV News it was not for him to judge whether Sgt Danny Nightingale should have been sent to prison.
He added that the Court of Appeal "acted swiftly" in this case which showed the system was "robust".
More top news
Ed Miliband would rather discuss working families and the NHS, but the question of English 'home rule' looms large over Labour's conference.
A British scientist says the age women may be able to conceive children could soon be significantly extended.
Simon Cowell admitted he was "so embarrassed" after his shirt burst open during an X Factor audition.