I wasn't watching the game either, but I think making that comment after five home runs to left field (no matter which particular HR he said it after) is more of a general comment than anything. Additionally, I was there, and the flags were blowing out to left field, so it was also a truthful comment.
However, without watching the broadcast it's hard for me to comment, and if it really was in defense of CC, I completely agree with you. But with the comment being said after five home runs to the same part of the park, and with the flags actually blowing out to left field, I think it was likely more of a general statement (and a fact) than anything else.