An odd relationship between hearing sounds vs. voices

I wondered if someone more knowledgeable could help me to understand why, with my incredibly sensitive hearing, I struggle to hear and interpret words and voices.

My hearing is, probably like many here, exceptionally sensitive. I can hear things that most people around me cannot. What other people seemingly allow to happen around them will often make me uncomfortable (tremendous volume to me). And yet, I often struggle to hear what someone has said to me, or near by to me. I am constantly turning the tv volume down to get away from loud music/ sound effects, but having to turn it up during dialogue. I now have the subtitles on constantly. 

Does anybody else experience this? Does anybody have any information or ideas on the matter. I’m wondering if it is to do with interpreting, processing and understanding spoken information, rather than simply recognising that a sound has occurred and trying to identify its source.