"We were in there having a prayer meeting on Tuesday, and had the gates open" explained minister Ralph Upton.
"Obviously, people stole it while we were having the prayer meeting".
"It just seemed like a pointless action" says Irene Pearce, a local councillor.
"People have been sad and asking why people would do that. It just doesn't make sense"
More top news
Wales Captain Sam Warburton says his team are raring to go as they kick off their Six Nations campaign in Dublin tomorrow.
Liberal Democrat leader Tim Farron has criticised Labour at the party's spring conference in Cardiff.
A Royal Gun Salute was held at Cardiff Castle earlier today to mark the 64th anniversary of the Queen's accession to the throne.