He said: "That the stigma, that the branding together of the residents, all 10,000 needs to be removed and should have been removed long before this and I'm really sorry that that never happened, and I regret that never happened.
"I'm sorry that this release of pressure and understanding of so many of those women was not done before this, because they were branded as being the fallen women, as they were referred to in this state."
More top news
Aidan McAteer, 23, pleaded guilty via video link as Violet-Grace's mother wept in the public gallery.
The wife of a man who filmed himself killing their baby in Facebook videos, said she is not angry at the site or those who shared the posts.
Moyes told the BBC reporter she "might get a slap" following a post-match interview when Sunderland drew 0-0 with Burnley.