They're 9-10 in August and they're 16-15 since the ASB. That's hardly "house of cards falling". Even if they continue to play .500 baseball, they'll still win 91 games.
For the Orioles to win 91 games, they have to go 24-13 the rest of the way, or .649 baseball (105 win pace). For the Yankees to win 91 games, they have to go 25-12 the rest of the way, or .676 win baseball (110 win pace), and they have Hughes, CC, and Pettitte starting 60% of those games.
Color me not worried. The only thing I'm concerned with is whether or not the Sox are going to be able to win the East.