The beauty of spending time with assholes is that they are very clear about the things that they like and dislike. It is part of why people think that they are assholes. But it also makes it very easy to figure out how to deal with them. How to push their buttons and how to make them happy.
The problem with spending time with other people is that you want them to be happy but it's really hard to figure out how to do that. And you want to do what makes you happy but not if it will mean that the other person is not. The Greek Guy used to describe this as "spoiling your pleasure." You want to be happy but if it makes the other person unhappy that will spoil your pleasure in what you are doing.