The teams that saw the biggest attendence decline were Miami and Philly, 600k and 500k respectively. Neither decline is attributable to the Yanks. In fact, excluding those two teams, MLB's attendence increased when compared to 2012.
Baltimore and KC both saw increased attendence in 2013. Tampa's decrease was less than 50k.