Jon Glenn from the Amateur Swimming Association said "parents have a role to play as well" as the schools, when encouraging children to learn to swim.
He said: "If families do not swim, it is unlikely that you will take your families swimming as well because you feel uncomfortable, nervous in and around the water, so starting at an early age is really important.
"Once they've learnt those basic skills once you get to school and you have those lessons you can really pick up the strokes a lot quicker."
More top news
Actor Bill Murray has offered to pay for the mobile phones of two fans he allegedly threw from bar after they tried to take photos of him.
Inadequate pain medication means cancer patients who want to die at home have no choice but to go to hospital, charity says.
Nearly three quarters do not get paid for the extra work they do, including teaching lessons, according to survey.