Gwar, Prince and Def Leppard? Those aren't embarrassing. You should be proud of those.
I don't really think I have any in my collection that I'm embarrassed about… Maybe like Sum 41 or Theory of a Dead Man, you know one of those shitty Canadian bands that latches on to a popular sound to get themselves on the Market.