In need of some support or advice.

Somewhat recently, I was 'diagnosed' with Asperger's. My Mum and Stepdad and others don't seem to understand that some situations where I would need to interact with people I find terrifying. If it's something I need to do, such as talking to customers at my job I'll need to do it, since I can't just ignore them. However, when it's something like taking a calendar or hoover to a neighbour's house, I find it difficult to do, to the point where I will not physically do it. I struggle with people's expressions, tones and languages but what I see is perfectly fine, others don't. This leads to them getting angry at me which can sometimes mean they'll swear at me. 

I don't understand this and noone really explains clearly or just repeats the same words which I didn't understand in the first place. Is there any way I can get help for myself and also those around me to learn to understand me and the way my thought process works? I've tried talking to my Mum and Stepdad but they just don't understand and get annoyed.