New research has revealed the average person will pay an extra £440 a year for goods and services, compared to those who use the internet.
In parts of Wales, one in five people have never been online.
Now, a campaign is being launched to protect consumers' rights to choose how they are contacted by banks, utility companies and other service providers.
The Keep Me Posted campaign says it is unfair to discriminate against those who can't go online, and is calling for customers to be given the choice to keep paper bills without charge.
"In my daily life I hear many concerns about the move to paperless bills and statements, but even more concerns about the right to choose being taken away from consumers.
"There is no doubt that many businesses, in their drive for greater efficiency and cost savings, have forgotten to take their customers with them on that journey."
The campaign found 41% of people would be worried about missing a payment if they weren't receiving physical reminders in the post.
More top news
A warm and muggy night with showers, occasionally thundery in the south. These will gradually clear eastwards through the early hours
The world record for the largest scrum was broken in Cardiff today after 1,297 rugby players from across the globe took part.
Chris Coleman: Wales position 'something very special and close to my heart'.