It's over recent Census results, which showed a decline in the number of Welsh speakers.
The Welsh Government say the building remains open to staff and visitors as usual.
Cymdeithas are holding a peaceful protest at one of the entrances at the Welsh Government offices in Cardiff. The main reception remains open as usual to all staff and visitors.
More top news
The peer will attack Prime Minister Theresa May for failing to represent the 48% who voted in favour of Remain.
Paul Flynn, MP for Newport West, will open the debate in Westminster Hall.
It will represent another boost to the region, after the announcement Deca Sealand was chosen for a repair hub for defence aircraft.