A Sussex Police spokesman said that the body had not yet been formally identified but it was believed to be that of Ms Stevens, of Baltimore Court, The Drive, Hove.
Detective Chief Inspector Ian Pollard, of Surrey and Sussex Major Crime Team who is leading the investigation, said:
"The 49-year-old man has today been released from custody on bail and our investigation into how Mrs Stevens died continues.
There are still a number of lines of inquiry we are following."
More top news
Thursday morning's weather for the east of the region
Thursday morning's weather for the west of the region
Prisons will be expected to reform prisoners as well as punish them under new proposals, set to be unveiled on Thursday.