No, he did need some more time in the minors to work on his defense. He wasn't quite ready yet.
I'm not advocating and have never advocated sending him back down to work on it this year, but ideally, he wouldn't have been called up as quickly as he was. Now that he's up, you are absolutely correct about having patience with him.