Refers to a man in tight speedo-like swim trunks where the head of the penis is small and showing in front resembling a button.
When his trunks got wet his tiny penis was revealed front and center. He called him a button smuggler.