Sussex Police said a 67-year-old man, believed to be retired Reverend Vickery House, was also released.
The 67-year-old man arrested at his home address near Haywards Heath on suspicion of two separate sexual offences against two boys, aged 17 and 18 at the time, in East Sussex between 1981 and 1983, was interviewed in Sussex and released on police bail late this afternoon while enquiries continue.
The arrests result from a review and subsequent investigation over the past six months.
More top news
The remains of Steven Cook, a British tourist who disappeared more than a decade ago while on holiday, have been found.
The company said it had "considered pricing changes very carefully" and "sought to minimise the impact on customers".
Chief Executive Ross McEwan told ITV News he was "pleased" with the bank's performance and would therefore accept his role-based allowance.