Indeed. It isn't as if these aren't fair considerations. But wandering from there to a presumed set of rules for what is and isn't abuse (or what is presumably not so bad) is missing the point. It feeds into this running narrative that Franken is the victim here. He isn't.
Losing trust, especially in a public forum, never comes down to a simple set of rules.
I also think it is unfortunate that his voice is going to be lost. But that has nothing to do with his abuse. As you say, it isn't the first time, and it certainly won't be the last.