Sussex Police said a 67-year-old man, believed to be retired Reverend Vickery House, was also released.
The 67-year-old man arrested at his home address near Haywards Heath on suspicion of two separate sexual offences against two boys, aged 17 and 18 at the time, in East Sussex between 1981 and 1983, was interviewed in Sussex and released on police bail late this afternoon while enquiries continue.
The arrests result from a review and subsequent investigation over the past six months.
More top news
Government minister Justine Greening has apparently opened up about her sexuality, as thousands took part in the London Pride parade.
Record crowds are at this year's Pride in London parade as people show their support for the LGBT community after the Orlando shooting
After a showery start to the day, parts of Northern Ireland, western Scotland and south-west England will see drier conditions.