Ichiro was an atrocious move, I don't disagree with that for a second. They should've just stuck with someone like Chris Dickerson, who's much cheaper and likely would have put up better numbers than Ichiro, especially vs RHPing. But that wouldn't have made them substantially better, and people like Mike Axisa would still be complaining.
Swisher is a different story. A case could be made that they should have resigned him, but an equal, or better case could be made that they were right to let him go. It's not a slam dunk that giving a 32 year old outfielder four years and fourteen million per year is a good move. And we have no idea what the next 3.5 years will hold, nor do we know how he would have done in 2013 with the Yankees, but Swisher has not been good so far this year and that is worth noting.
And Stephen Drew? I mean, the moment someone starts criticizing the Yankees for not being more aggressive in going after Stephen Drew is the moment your argument has reached the point where you're just splitting hairs. Would Stephen Drew have made them better? It's possible, at least defensively. But is it a non-move worthy of excessive criticism? Absolutely not.