It's over recent Census results, which showed a decline in the number of Welsh speakers.
The Welsh Government say the building remains open to staff and visitors as usual.
Cymdeithas are holding a peaceful protest at one of the entrances at the Welsh Government offices in Cardiff. The main reception remains open as usual to all staff and visitors.
More top news
The morning sunshine will soon work it's magic!
But clear skies remain in the south and west
Joshua Davies says he was running away from a gang when he fell from the fifty-foot bridge.