Jon Glenn from the Amateur Swimming Association said "parents have a role to play as well" as the schools, when encouraging children to learn to swim.
He said: "If families do not swim, it is unlikely that you will take your families swimming as well because you feel uncomfortable, nervous in and around the water, so starting at an early age is really important.
"Once they've learnt those basic skills once you get to school and you have those lessons you can really pick up the strokes a lot quicker."
More top news
Heavy rain and wind for Scotland and northern parts this weekend with an amber weather warning issued and travel disruption expected.
Heavy rain continues to affect Western Scotland and Northern Ireland
A surgeon linked to two deaths and a series of botched surgeries is to return to work despite an ongoing investigation, ITV News understands