Ashley Foster, who is from High Green, and Jonathan Bowling, who is from the Fox Hill area of north Sheffield, were both arrested earlier this week.
They will remain in police custody until they appear in court in the morning.
Grandfather Mr Greaves, 68, was a lay preacher and his death shocked the community where he lived.
He lived just a few hundred yards from where he was attacked.
After the incident he was taken to hospital with severe injuries to his head but did not survive.
More than 50 police officers were drafted into the inquiry and detectives made a series of appeals for help from the community.
More top news
Drying up across eastern parts this afternoon with showers continuing across Ireland.
Gordon Brown has said forced child migration schemes that continued until the 1970s amounted to "government-induced trafficking".
200 UK officers already working on the case are sifting through 15 tonnes of debris on each of the building's 24 floors.