Walking Calamity turns off in offhand even if it's a talisman

Walking Calamity doesn't work when set to weapon set 2 (offhand set) even if weapon set 2 is a talisman. You can turn it on but nothing happens when you switch to weapon set 1 or use an ability that automatically switches to weapon set 1. Same thing happens vice versa.