Unable to untag myself

So I’m unable to untag myself when it incorrectly auto tags me as the speaker. I've finally got fed up with it enough that I created a speaker names “NOT ME!" so I can get by.