When masturbation looses its fun...

I sometimes get this paranoid feeling that men are masturbating while talking on the phone with me late at night. Am I just crazy or does this actually happen?