Sussex Police said a 67-year-old man, believed to be retired Reverend Vickery House, was also released.
The 67-year-old man arrested at his home address near Haywards Heath on suspicion of two separate sexual offences against two boys, aged 17 and 18 at the time, in East Sussex between 1981 and 1983, was interviewed in Sussex and released on police bail late this afternoon while enquiries continue.
The arrests result from a review and subsequent investigation over the past six months.
More top news
MPs say there must be no way back for the former London mayor as he hints he could seek to rejoin the party.
President Donald Trump has requested that the Justice Department investigates whether the FBI infiltrated his campaign.
High pressure will help keep conditions relatively quiet through the course of this week.