It's over recent Census results, which showed a decline in the number of Welsh speakers.
The Welsh Government say the building remains open to staff and visitors as usual.
Cymdeithas are holding a peaceful protest at one of the entrances at the Welsh Government offices in Cardiff. The main reception remains open as usual to all staff and visitors.
More top news
How a little boy from Magor inspired his village to become "Autism Aware"
Nath talks to ITV News about being diagnosed with a form of autism at 16 and how he is aspiring to be a musician.
The head of Glamorgan CCC hopes Cardiff will be awarded one of the new city-based teams in a new 20/20 competition to rival the IPL.