To be fair, outside of him being the GM, how else do you know the guy? It's not like you have a personal relationship with him, so virtually your entire opinion of him is based on his performance as a GM. So, if you don't like his moves, it's not like you can say "well I didn't like signing x, but I do like ______" because you (like everyone) have no other knowledge of him. He could be a complete jackass on a personal level, but nobody would know it
So, insofacto, his only relevance to your life is as the GM of the Red Sox, so if you don't like him in that light, you don't like him at all.