Southampton captain Lallana also saw a volley smash against the post and record signing Dani Osvaldo had a close-range effort saved by John Ruddy - missed opportunities the visitors were made to pay for.
Despite Robert Snodgrass being refused a stoppage-time penalty, Redmond's solo effort proved enough to secure Norwich a first league win of the season, ending the visitors' unbeaten start to the campaign.
Ward-Prowse's floated free-kick was only cleared as far as Lallana and the Southampton captain's venomous left-footed volley struck the post.
Mauricio Pochettino's side returned for the second half strongly and Ruddy had to be at his best to deny Osvaldo.
More top news
Dry and sunny tomorrow and feeling warm.
Mild tonight with warm sunny spells and light winds tomorrow.
A section of the M3 has been closed and bomb disposal units are at the scene after reports of "potential hazardous material in the road".