It should be the responsibility of care providers to report neglect of older people to social services, Stephen Lowe of Age UK has told ITV News.
"It's down to services to make people feel confident that they won't face reprisals," he said.
Reacting to new data published by Charity Age UK showing a rise in the number of reports of suspected abuse of vulnerable older people, a Department of Health (DH) spokesman said:
Three fifths of the 112,000 cases referred by English councils were for abuse against vulnerable adults - described in the report as people who are or may be in need of community care services because they are elderly or suffer mental illness, a disability or another ailment - aged 65 or over.
Physical abuse and neglect were the most common types of abuse reported, the HSCIC experimental figures show.
Care workers and family were the most likely alleged abusers, according to the report.
New findings suggest care workers and family are the most likely alleged abusers of elderly people.
Findings from Age UK have revealed a rise in the number of reports of suspected abuse of elderly people.
There has been a "disturbing" rise in the number of reports of suspected abuse of vulnerable older people, a charity has warned.
The charity made its comments after analysis of data from the Health and Social Care Information Centre (HSCIC) showed that there was a four per cent rise in the number of cases of alleged abuse referred for investigation in the past year.
English councils referred 112,000 cases of alleged abuse against vulnerable adults for investigation in 2012/13, up from 108,000 during the previous year.
Age UK has told Daybreak that the number of falls taken by elderly people can be prevented by eye tests, and taking regular exercise.
"It doesn't have to be this way, you can prevent a number of falls", Michelle Mitchell said, "often by taking a number of really simple steps."
Today Age UK will launch its Falls Awareness Week as around 350,000 people over the age of of 60 are being treated in hospital as the result of a fall.
Figures from the Health and Social Care Information Centre have revealed that between 2012 and 2013 more than 410,000 people of all ages were admitted to hospitals across England as a result of a fall.
The figure was almost a 15% reduction from the previous year, the HSCIC said, with almost three-quarters of females admitted over the age of 65, compared to around half of men.
A charity has warned that the impact of falling over can be life-changing for an older person, causing them to feel isolated and reluctant to leave home.
Charity director general Michelle Mitchell said:
Around 350,000 people over the age of of 60 are treated in hospital because they have fallen over, a charity has warned.
It is a "real concern" the number of elderly people who are admitted to hospital in England from the result of a fall, Age UK said.
The charity, which launches its Falls Awareness Week today, said around 9,000 older people die every year because they have fallen.
It added that falling over is one of the leading causes of death for over-75s.