Public-tranist social stigma?

In the Toronto transit vs Chicago transit thread, one Chicago visitor mentioned a certain kind of social stigma that he felt when riding transit. Is riding public transit for purposes other than the daily commute expected of only poorer people? Is there any shame in taking the bus instead of driving?>