New research has revealed the average person will pay an extra £440 a year for goods and services, compared to those who use the internet.
In parts of Wales, one in five people have never been online.
Now, a campaign is being launched to protect consumers' rights to choose how they are contacted by banks, utility companies and other service providers.
The Keep Me Posted campaign says it is unfair to discriminate against those who can't go online, and is calling for customers to be given the choice to keep paper bills without charge.
"In my daily life I hear many concerns about the move to paperless bills and statements, but even more concerns about the right to choose being taken away from consumers.
"There is no doubt that many businesses, in their drive for greater efficiency and cost savings, have forgotten to take their customers with them on that journey."
The campaign found 41% of people would be worried about missing a payment if they weren't receiving physical reminders in the post.
More top news
A wealthy couple claimed more than £43,000 in benefits while having a small fortune in the bank, Cardiff Crown Court has heard.
Michelle Smith was found guilty in 2012 of murdering her six-week old daughter Amy, by dosing her with adult painkillers.
Welsh family beaten unconscious by gang in Thai tourist resort. The grandparents and their son were punched and kicked unconscious.