You are dead on with your observation. I've been to Tropicana Field a whole bunch of times. I go to pretty much every Red Sox Rays game. I've also been to a whole bunch of other stadiums and quite frankly it doesn't feel like a ball game, at Tropicana Field. It feels like I'm watching baseball being played in my living room. The noise is weird the air-conditioning puts you to sleep and the stupid find the cow games distracts you from the actual action.
The problem is they can't build a new stadium. It might help building it in Tampa but who is going to take that risk when they don't draw. There has to be a sign of significant gain in order for someone to take a financial risk like building 1 billion dollar stadium. Hell look at the Marlins. They have this nice beautiful new stadium and their 15th in attendance. A new stadium alone should move your attendance up drastically. Never mind the fact that the Marlins are actually doing pretty well this year.
I say move the Rays somewhere else. The Florida experiment has failed.