I agree with Atomic. Assholes like that get away with shit because other people let them. They're bullies that never grew up. Of course he'll get pissy if you correct him or set limits on what you will and will not tolerate as bullies are always right too, but tough shit. It's your life and you decide what you will and will not deal with.

Let me tell you I'm not a violent guy but if some fuckshit looked at my sister like a piece of ass and then went on to insult my dad, my fist would be so far down his throat that I could grab his asshole and turn him inside out. Is keeping peace worth more to you than your family being treated with respect?