That's the whole point though. It doesn't have to be a dark day. What do the sox have to look forward to? A bunch of players that most other teams would love to have. The sox have, intelligently, not allowed there to be a severe bump in the road while waiting for talent to develop. You can be somewhat cynical, anti-Red Sox at times, but you have to admit that they have done a great job of creating a solid farm system that is only getting stronger.
They are drafting experienced college players with good eyes for the plate, and pitchers who throw hard. Bowden, Buchholz and Bard are all very strong pitchers. Papelbon and Lester are good too. Beckett and, hopefully, Matsuzaka to go along with Hansen and Delcarmen. 5 years from now, if the sox make no moves, I think I just listed 9 of the sox pitchers. I think that's one of many realistic possibilities.
Add to that the usual spending on bigger names and trades and whatnot and you already have a good core. And those guys are just the top tier pitchers. It didn't mention guys like Cox and Masterson, who have strong relief potential as well.
I have to respectfully take your "competitiveness" comments with a grain of salt. Afterall, I imagine it is frustrating to be competitive and not win the world series. Sure, you have to get all excited for those playoff games and then get disappointed when the team ultimately falls short.
But I swear to you, if the Yankees fell into the kind of pit that the sox did in '06 with the promise of more to come... you would stop watching. I know I did and I watch every Sox game I can. I just did something else with my 3 hours... I know, its a horrible bandwagon thing to do but they were godawful . This year they were HORRIBLE by the end of the season. Imagine having a team like that every year. Imagine being a Royals fan, or a D-Rays fan or a Mariners fan.
Personally, I enjoy the pennant chase and I don't think there has been any one quality that has defined the past 5 or so winners of the world series. In other words, there is no receipe for success. If there were the Yankees would have purchased and utiliezed it by now. Teams "compete" to get into the playoffs and then "compete" for the world series. Having a team that is "competitive" does not mean "only competitive"--as if it were not quite enough--competitive means "has a reasonable chance to win".
Now, if I have to choose between having a "reasonable chance to win" year after year, or winning one season for sure, I would choose the former (assuming I'm not coming off an 86 year drought, which we're not).
Remember, the Red Sox did not win in 2004 necessarily because they were the better team. I think they were the better team because of what they overcame, but it all came down to a foul-ball here, a called strike there, a stolen base, and seeing-eye single. If that's a ground out, four feet to the left, Roberts may not score and the sox lose and we have won ZERO WS. We won by a) being competitive and being lucky. That's all you can ever do.
How many times out of 100 do you think the Tigers pitchers can make accurate throws to a base? I would be its in the 90% range, if not higher. St. Louis was lucky to win. White Sox series against the Angels, a few calls for Chicago and they end up taking what should have been a competitive series rather easily.
You can't buy yourself a stolen base or a seeing eye single, but you may be able to buy and draft your way to the point where you can gamble on one of those things and hope its your year. The Yankees do that every single year and it just hasn't gone their way.