The homosexual community is often even more intolerant of interracial couples than the heterosexual community is. If you don't mind that, then go for.

Honestly, I don't think you should worry about it that much and not care as much what others think. I mean, as others have said, you're already gay, and you have to deal with the social stigma of that; being an interracial couple can't be much worse.