The speaker “half doomed” and the other person “semi-sweet” insinuates that although separately they’re only halves of a whole, together they complete each other.
What a match, I'm half doomed and you're semi-sweet