Phone in general

I'm noticing that people seem annoyed with me a lot. Sometimes when they're on the phone, they sigh as if I'm stressing them out or they want to end the conversation quickly. Has anyone else experienced this? I'm wondering if it's because I talk too much. I have autism, but I find it rude and annoying when people behave like this or they huff sometimes.