It's over recent Census results, which showed a decline in the number of Welsh speakers.
The Welsh Government say the building remains open to staff and visitors as usual.
Cymdeithas are holding a peaceful protest at one of the entrances at the Welsh Government offices in Cardiff. The main reception remains open as usual to all staff and visitors.
More top news
Eight people were left stranded on a ride at Cardiff's Winter Wonderland for 40 minutes yesterday after a mechanical malfunction.
The woman who was raped by Ched Evans has been forced to move house five times since being identified on Twitter, her father has said.
It will be a frosty start with a risk of ice. The rest of the day will be dry with variable cloud and sunny spells.