It's over recent Census results, which showed a decline in the number of Welsh speakers.
The Welsh Government say the building remains open to staff and visitors as usual.
Cymdeithas are holding a peaceful protest at one of the entrances at the Welsh Government offices in Cardiff. The main reception remains open as usual to all staff and visitors.
More top news
Wrexham man Christopher Matthew Griffiths has been jailed for cutting his dog's ears off. Traces of cocaine were found in the dog's urine.
Stephen 'Beano' Pike stabbed his neighbour Clint Simms on his doorstep in Ely, Cardiff. He was jailed for life at Cardiff Crown Court today.
Police appeal after a man sexually assaulted a teenage girl sat beside him on an Arriva train to between Cardiff and Pontypridd.