North Yorkshire Police were called by the Yorkshire Ambulance Service, which had attended a serious assault at an address in Eastborough on Wednesday night.
Despite the efforts of paramedics a man in his 30s was pronounced dead at the scene.
Four men were arrested a short time later at an address on Queen’s Terrace, Scarborough. They are being questioned by detectives.
More top news
Kerrie Gosney brings you Saturday night's forecast
Showers becoming heavy and thundery Saturday afternoon. Drier for a large part of Sunday
Robert Hodgson, from Stanley, County Durham, committed the offences on the girls, aged as young as five or six, up to the age of 13.