Part of the problem with NYY fandom is that a s*** ton of people who grow up in NYC as Yankees fans end up leaving NYC when they grow up. This migration happens in all cities but especially NYC. It's just how it goes. I'll probably be out of NYC within the next couple of years myself. We get replaced by people from all of over the country/world who don't know s*** about the team, but just become Yankees fans by default. I would say that explains the majority of fairweather fans who only sprout up when the team is doing well. And also how there are so many displaced Yankees fans around the country.
Brooklyn is a haven for hipsters, noobie fans, and the dreaded hipster Yankee fan. Enjoy your stay!