Sussex Police said a 67-year-old man, believed to be retired Reverend Vickery House, was also released.
The 67-year-old man arrested at his home address near Haywards Heath on suspicion of two separate sexual offences against two boys, aged 17 and 18 at the time, in East Sussex between 1981 and 1983, was interviewed in Sussex and released on police bail late this afternoon while enquiries continue.
The arrests result from a review and subsequent investigation over the past six months.
More top news
Two doctors have been charged after a 30-year-old woman died while having an emergency caesarean.
Janet Faal was left badly injured after leaving the house for only the third time in ten years.
More than 100 small business owners say they support Ukip's policies to help small traders in a letter published in the Daily Express.