The only reason I can think of that the forum software uses leave instead of delete is that you get a choice: leave and don't accept new messages, or leave but do accept them. If you choose that second one, and someone restarts the conversation, I believe the whole thing will come back as if you'd never left.
But yeah, trips folks up all the time!