It's a term intended to make men insecure, or target a man's insecurities. It has no real meaning, but tends to offend people regardless.
"You seem like the type of person to have a shoe size 4. No offense."