Jimmy Savile's victims at Leeds General Infirmary (LGI) ranged from five-years-old to pensioners and included men, women, boys and girls.
Investigators at the hospital found that staff were told about some of the incidents but no allegations reached senior managers.
The inquiry into his activities at LGI after he started his association in 1960 included the testimonies of 60 people who gave accounts of their experiences with Savile to investigators - 33 of these were patients.
Three of these incidents were rapes, the investigators said.
The Leeds team said 19 of those who came forward were under 16-years-old and the age range was five to 75. They said the majority were teenagers but 19 victims were hospital staff - all women.
The inquiry panel said that he started working on the hospital radio service and he then became a regular visitor to the hospital, as a celebrity, a fundraiser and, from 1968, a volunteer porter.
It said Savile enjoyed unrestricted access to the hospital as he raised £3.5 million through his charity activities. This gave him the opportunities he needed to indulge in abusive and inappropriate contact with patients and staff.
He had access to keys to various departments, had a series of offices in the hospital and even had access to the mortuary, the panel said.
The independent investigation interviewed more than 200 people and reviewed more than 1,300 documents covering the 50 years Savile was associated with LGI, which is now run by the Leeds Teaching Hospitals NHS Trust.
It found that the first case of abuse reported to the team happened in 1962 when Savile was 36. The most recent was in 2009 when he was 82.
The investigation panel found that incidents ranged from lewd remarks and inappropriate touching to sexual assault and, in three cases, rape.
Forty three of the encounters took place in public areas such as wards, corridors and offices.
The investigators found that nine victims told a member of staff about what happened either directly or through their parents at the time of the abuse. But they said none of these allegations were subsequently communicated to people in more senior positions.
Reporting their findings, the panel said: "It is clear from witness interviews that had senior managers at the hospital been made aware of Savile's abusive behaviour, they would have acted to stop it happening."