Whispers of Doom broken - unable to assign to weapon set 2

Whispers of Doom passive is broken. I'm not able to assign to weapon set 2, seems only way is assigning to both (main skill pt use). I don't see any description or googling any info that states this passive requires both weapon sets assigned.

you cant use weapon set passives for key stone.