A lot of those summer squaters do have homes though...
For the most part, I don't have a problem with the homeless population. I do have a problem with the lack of services provided towards the homeless as well as the aggressive panhandling of some homeless persons.
I have great memories from living in SF. It's a shame that the high cost of living is completely changing the city's culture.