In the command palete there is a Mute button. Assign that to your keyboard and that will toggle audio channels on and off. For example if you have 1 & 2 on and 3 & 4 off , it will reverse that.
Unfortunately it does this to both the source and record sides. Can be very handy.