The O's pitching sucks, that's why they'll drop. 2005 comes to mind. They had a very similar start to this year, and were in first place as late as June, and finished 30 games out of first.
Careers don't lie, and most of that pitching staff has an established curriculum of suck that just can't be ignored.