Sussex Police said a 67-year-old man, believed to be retired Reverend Vickery House, was also released.
The 67-year-old man arrested at his home address near Haywards Heath on suspicion of two separate sexual offences against two boys, aged 17 and 18 at the time, in East Sussex between 1981 and 1983, was interviewed in Sussex and released on police bail late this afternoon while enquiries continue.
The arrests result from a review and subsequent investigation over the past six months.
More top news
Low pressure remaining in control gives more unsettled weather for the UK this weekend.
Charlie Gard, the baby boy whose fight for life captured the attention of the world has died, his family has confirmed.
A Royal Marine who lived a "dangerous double life" as a terrorist bomb-maker claims he faked Irish Republican sympathies out of fear.