You need a DPDT (Double Pole Double Throw) relay with a 24 Vdc coil. The relay contacts must be rated for more than 24 V, and the current rating for the contacts should be at least twice the power supply output current that is being interrupted.
Connect the power supply output to the relay armature connections, and the downstream circuit/device) that previously was connected to the supply) to the relay NO (Normally Open) contacts. Be sure to observe the supply polarities, so the + output of the supply is connected to the same contact pair as the + input of whatever is downstream.
Also, the relay should have a rectifier diode across its coil connections to reduce generated interference and help preserve the switch contacts.
Traveling today, so no schematic. Someone else probably will create one.
ak