I would also have both connected at the same time. When you want to use the speakers, take your headphones off, and select that input on the stereo or turn the volume up. When you want to use the headphones, turn the stereo volume down or select an unused input, and put the headphones on.