The opposite of a guilty pleasure. A guilty displeasure is when you hate a thing that everyone else likes.
Person 1: hey dude, wanna watch Ed, Edd & Eddy? Person 2: Sorry dude, I hate that show, It's a guilty displeasure of mine...