Weird/ problematic special interests causing guilt

Hello, I have been having a problem about feeling guilty for what my special interest is even though I can’t control that I like it. My special interest happens to be a certain rock band who has a very problematic singer. I love the band, the music, and the members. I keep getting made fun of and judged by neurotypical friends for having the band as my special interest since some of their music is problematic too and some of the fans are bad. How do I stop feeling ashamed for what I like, I know I can’t make myself not like the music? (Sorry for unorganized speech my English is not very good and I am stressed)