Ah yes, the true biggest myth in baseball.
"Relief pitchers are a crapshoot." No, the truth is "Crapshoot pitchers are relievers." If you keep your good relief pitchers in the bullpen, many of them will continue to pitch well. But if you continually fill the bullpen with volatile pitchers whose performance will vary, then you will continue to get a bullpen that is just not reliable.
Right now, the sox have two very good pitchers in the bullpen in Houck and Whitlock, and the consensus is "GET THEM OUTTA THE PEN!!" Why? I get that SP is in need of improvement, but bullpens are very important in today's game and when you have one that works, try not to tear it down to build up other aspects of the team that don't. The Sox probably need a 2B next year (Arroyo injured himself this year taking a throw at first - if that doesn't make you question his durability, what will?). Hey, we have extra outfielders!! Let's put Duran in CF and move Kike to 2B. It might not work out, but centerfielders are a crapshoot, right?