It's over recent Census results, which showed a decline in the number of Welsh speakers.
The Welsh Government say the building remains open to staff and visitors as usual.
Cymdeithas are holding a peaceful protest at one of the entrances at the Welsh Government offices in Cardiff. The main reception remains open as usual to all staff and visitors.
More top news
You could be forgiven for wondering where summer has got to over the next few days! Sunshine, showers and disappointing temperatures!
Stephen Kinnock has led a delegation of campaigners calling for a posthumous pardon for Dic Penderyn.
The latest figures show skin cancer numbers for people over 55 have almost tripled in the last 20 years.