A spokesperson for Lloyds Banking Group has said the IT problems encountered earlier are now resolved.
Online and telephone banking were unaffected by the problems.
The CEO of TSB has tweeted that the cause of the banking problems are now fixed but added that it will take a while to clear the backlog.
A Lloyds Banking Group spokesperson has told ITV News that two out of seven of the banking group's servers have gone down, which has led to customers being unable to withdraw cash or use their debit cards.
Ursula Lyons found the card problem "annoying and embarrassing", after experiencing issues at a cash point and accessing her online banking account.
But Tracy Pomphrey said: "Myself and my mum had our TSB cards declined in Asda, it was extremely embarrassing. Although we could go out to the cash machine outside and withdraw the cash!"
Hayley Jane said: "People saying they are glad they're with other banks, but they have all had this problem at some stage - Natwest had this problem last year for ages!!"
TSB CEO Paul Pester has tweeted his apologies to customers experiencing problems withdrawing money and paying with debit cards:
Lloyds Banking Group say it is "working hard" to resolve the issues customers are experiencing with ATMs and debit cards.
TSB has apologised for the issues the bank is experiencing with its ATMs and debit cards. They added that the technical issues have impacted on all Lloyds Banking Group brands:
TSB customers have taken to Twitter to express their frustrations after having their debit cards declined in stores. The bank has apologised on Twitter for the inconvenience after reporting issues with its ATMs and debit cards:
TSB has apologised on Twitter following issues with ATMs and debit cards: