My first guess would be purge but that seems unlikely if he isn't flagging you. A second guess could be player discord, lowering your skill thereby taking you out of form, but again, not sure if you can do that without flagging.
Are you always attended when this happens? Maybe you are flagging him first? Or maybe you have a hit area effect on your wep that flags him?