New research has revealed the average person will pay an extra £440 a year for goods and services, compared to those who use the internet.
In parts of Wales, one in five people have never been online.
Now, a campaign is being launched to protect consumers' rights to choose how they are contacted by banks, utility companies and other service providers.
The Keep Me Posted campaign says it is unfair to discriminate against those who can't go online, and is calling for customers to be given the choice to keep paper bills without charge.
"In my daily life I hear many concerns about the move to paperless bills and statements, but even more concerns about the right to choose being taken away from consumers.
"There is no doubt that many businesses, in their drive for greater efficiency and cost savings, have forgotten to take their customers with them on that journey."
The campaign found 41% of people would be worried about missing a payment if they weren't receiving physical reminders in the post.
More top news
A mother of two has told ITV Wales she's saving money to buy life extending cancer drugs as she anticipates the NHS won't fund them.
The man and woman found dead on Cardiff's Queen Street have been named as Lee Simmons and Zoe Morgan.
The man and woman who were found dead this morning on a Cardiff street were stabbed. Warning: Graphic content.