I often wear sweatpants while commando.

I do wear boxer briefs underneath when I leave the house though because my erections are at a 45 degree angle (instead of pointing straight up) and so I've had no hope in hell of hiding one if I got one in a store and didn't have underwear to hold it in place.