Lord Justice Pitchford and Mr Justice Simon ruled the anonymity order must be discharged.
The judge said that the course used by David McGreavy's legal advisers when applying for anonymity was "wrong".
The ruling was a victory for the Justice Secretary and national newspaper publishers who all worked together last month, after the Press Association alerted them, to say that the order was legally flawed and was wrong to stop the public from knowing all the facts in the case.
Counsel Guy Vassall-Adams had told the judges that even "the nature of the victims" could not be revealed.
More top news
The family of former Leicester West MP Lord Janner will apply to take part in the independent inquiry into child sexual abuse.
The heads of three of Birmingham's biggest student unions have urged Theresa May to listen to students' concerns when it comes to Brexit.
Lincoln City are through to the fourth round of the FA Cup after a dramatic injury time win over Ipswich.