Memories of being young?

Hello all,been doing a fair bit of talking to my dear wife just lately and keep coming up with lots of strange things that don't add up.

I can remember times that were not nice but very little happiness, I realise most people forget things about childhood especially when my age 54.

I had issues and when I got into my late teens I theorised I had dyslexic traits,it answered many questions but not all,it helped me go forward in life.fast forward 54 years and I find out about autism,it was a revelation in my life,it was my life.

I thought my dyslexia idea must be wrong but recently found that there can be a connection.

After talking about My recollections my wife says "are you sure as that doesn't make sense?" Things I never gave much credence too.

I was born in 1962 and things were different then.

For instance I do remember always being at home with mum or waiting for a bus to go shopping,nothing strange about that, but I had a younger sister and a brother who was only eighteen months older! So where were they? Why was I at home so often?

I was kept back at infant school and the kids I knew all left to go to big school, I was told it was because my birthday was early September. I was the oldest child from then on I also had a school full of strange new faces. I don't remember much about infant school,mostly teachers shouting at me,making me cry for not doing my work,being lazy or not concentrating,

I do remember some happy times but so few.being allowed to go collect our milk from the staff room with a sack truck.being in the big shed helping the caretaker clean out cages for hamsters rabbits etc,he was deaf and dumb but we got on ok.

I remember being in one class sat on the floor drawing around shapes,tins boxes but nothing free hand,the other kids were sat working with the teacher but I was not involved?

I also remember bits of a family meeting that ended with my whole family in tears,we stormed out and I was then told how it was all my fault? I wasn't upset until my siblings started saying I didn't care as I wasn't upset.

There are so many things that don't add up but I have a big question and hope I can word it so as not to upset anyone here.

Say for instance if I had been non verbal? Or just unable to function normally? Maybe in a world of my own? Back then labelled as retarded. There are a lot worse words which I don't want to put on here but back then there weren't any options.

So are there any adults here that basically knew nothing of the issues they had when young? It's as if I only woke up later in school. 

Could I have been so poor functioning and not known it?

A big for instance was when I went to big school, All the kids were getting excited and I asked"why are you all excited and packing everything away?" The reply was "it's Friday!" I asked what that was about? The response was "are you thick or what?we get the weekend off". I asked why was that,was it holiday time?. I was laughed at and ridiculed by the kids.

I had no recollection of weekends! I had no concept of time. Life was one big blur of hurt and no understanding.

I hope I haven't put something that causes hurt but I have tried to explain.

many thanks.