It refers to the length of a very specific part of the male anatomy.
(Hint: It means you have a little dick)
Girl: Aww, so cute!
Guy: What are you talking about?
Girl: The widdle inch grinch!
Guy: You haven't seen anything yet...
Girl: I agree completely. I'm leaving.