I think honesty is best policy.. If you just admit that you don't find him sexually attractive anymore then there's a chance you could still be friends. And if you make other excuses e.g 'I don't want a relationship right now' then it could have repercussions if you did meet somebody else.