A Sussex Police spokesman said that the body had not yet been formally identified but it was believed to be that of Ms Stevens, of Baltimore Court, The Drive, Hove.
Detective Chief Inspector Ian Pollard, of Surrey and Sussex Major Crime Team who is leading the investigation, said:
"The 49-year-old man has today been released from custody on bail and our investigation into how Mrs Stevens died continues.
There are still a number of lines of inquiry we are following."
More top news
Friday morning's forecast for the east of the region
Friday morning's forecast for the west of the region
A group of women who've fought and overcome postnatal depression speak candidly about their experiences.