Children taught by staff who aren't their usual teachers make less progress in lessons, according to a joint report by the school's inspectorate Estyn and the Wales Audit office.
The report says that supply teaching is often less effective because staff don't know enough about the needs of the pupils they teach.
It added that the pace of lessons can also be slow and expectations too low.
Authors have recommend that supply teachers gain better access to the national training programmes that are available to permanently-employed teachers
The Welsh Government says it will consider the report's recommendations and respond in due course.
More top news
Cold, breezy and generally cloudy at first with further wintry outbreaks on the hills
All primary and secondary schools in Wales have been categorised in a new colour-coded system. Is your school green or red?
A yellow warning for snow and ice on Thursday night and Friday has been issued.