The awards have become much more respectable since they added the saber component several years ago. Glancing at the list of AL winners, there are a couple that I could dispute, but there's nothing really glaring, like Palmeiro or Jeter.
That said, my defensive award of choice is still the Fielding Bible Awards.
Mookie won that award as well as the Gold Glove. Pedroia also won the Fielding Bible Award. Remember that the Fielding Bible only gives out one award for both the AL and NL.
Mookie and Pedroia are definitely worthy of 'best defender' recognition.