It's over recent Census results, which showed a decline in the number of Welsh speakers.
The Welsh Government say the building remains open to staff and visitors as usual.
Cymdeithas are holding a peaceful protest at one of the entrances at the Welsh Government offices in Cardiff. The main reception remains open as usual to all staff and visitors.
More top news
A postman was on his rounds when he noticed a man inside a pensioner's house - police found Neil Williams hiding in the attic.
Susan Wellings suffers from severe pain caused by gallstones but has been left waiting for surgery after doctors refused to operate.
Owain Vaughan, 14, took the drug and was rushed to hospital after suffering severe fits, burst blood vessels and being violently sick.