If you don’t want to be friends with someone, tell them and don’t hang out with them.
You’re more of an asshole if you just keep someone around simply to have company because you’re “uncomfortable,” by yourself.
That’s just stupid.