Guilt and work

Put bluntly im struggling to cope. I am told its ok not to work but cant get past the guilt. People say its ok and to chill but i feel like ive wasted my life. My family say they love me and to be happy but i cant seem to accept not having lives the obligations of adulthood. Anyone here not work but is supported or partner to someone with asd who doesnt...how is it