I guess I'm on a roll with the 'perspective' thing because I just posted something on the same topic in another thread, but anyway...
Toughness is all about perspective and it comes in many sizes and shapes. Professional baseball players have to be tough both mentally and physically. Mentally because they face adversity on the field every day and physically because it's a long season and it's hard on the body.
OTOH, police and firemen deal with things every day that most of us have no interest (or maybe even the toughness) to deal with on a regular basis. I would think that a person would have to be tough to deal with death and loss of everything one has worked for, not to mention being mentally and physically tough enough to deal with hardened criminals with no sense of right or wrong. And that doesn't even begin to deal with the toughness of those people and their families knowing that every morning when they walk out the door that they may not come back again.
Of course there's the mental and physical toughness of those who have fought - and continue to fight - in conflicts where they also deal with death, and disfigurement, sometimes of their close friends. These people are both mentally and physically tough.
And then there are those whom cp mentioned above, some of whom live their quiet lives dealing with the pressure of making ends meet and keeping their families warm and well fed. That takes yet a different kind of toughness.
While I wouldn't diminish the toughness necessary to play sports professionally their 'toughness" pales when compared to what other people have going on in their lives. As Ryan Dempster said after he retired, "I've been treated like a king for all of my professional life. Now I have to learn now to live like a real person". (Of course, with - I hope - millions of dollars in the bank and doing his commentary gig occasionally he doesn't have to live like "a real person", but at least he has perspective).