Because he portrayed the punisher in a way that you think wasn't in character, when in reality was closer than you realize
Well, if the uninitiated can't grasp the character, it's possible that it was written or portrayed badly. It's also possible that the uninitiated wasn't watching closely enough, but that they don't know better is no reason to disregard their point of view.
Bookmarks