GUI image button only checking display condition when Gui is reset

I have a GUI trait system, like project Zomboid, I made it so the (turned off) toggleable trait (image button) would disappear showing another (turned on) image button (it is behind it in layers, so when the first one disappears, the second one shows behind it. The first image button will disappear instantly after pressing, showing the active one, but when the active one is pressed again, it will not make the first one return until the GUI is reset. (image shows the two buttons separated for understanding)

https://ibb.co/237xjBjc