Well you don't really have to try to not have a guilty conscience. It's something that isn't within your control, and it's not your responsibility to get people to like each other. It's something that you can do if you feel like tackling that project, but you shouldn't feel the least bit obligated to it.

To answer your question though, the right thing is always the hardest thing to do because if it wasn't, it wouldn't carry the same feeling of accomplishment when you do it.