wear the white shorts

Staying away from home all night, esp. due to casual sex at someone else's house. From Australian Football League away uniforms: the 'away' playing team always wears white shorts.

Jane walks in the door at 11am.

Jane's housemate: (sly look) "So, did you wear the white shorts, then?"
Jane: "Shut up!"