I would confront him and see what he has to say. You've got problems in bed and hickies on his neck -- that's enough to warrant talking to him about it. He can't accuse you of being overly suspicious or untrusting.