It basically means you're homosexual, instead of saying "Yes", "Ye" removes the s which stands for straight.
Bruce Jenner said, "Ye I like men".