sadversary

Someone who sees themselves as your rival or enemy, but is just too sad for you to bother with.

Art liked to think of himself as my nemesis, but he was just a sadversary.