Still, there's only so much "avoiding the sweet spot" will counteract.
There's a league average for BABIP, i'll give you that, meaning that both sucky and good pitchers are included.
However, anything under .250 is cheer luck, because in Pedro's 1999 season, he had a .270+ BABIP, and he was a hell of a pitcher, so yes, BABIP has quite a measure of luck to it, and it can make or break a pitcher's season if it doesn't even out.