I checked the info compiled in the 1.07 gossip thread, and it seems you are right!I've tested the Damage to Demons on off hand multiple times and it doesn't work.
Source
Dtd and dtu will not work on offhand while whirlwinding. But CtC amp definitely will!