Driving

I gave up learning to drive when I was nineteen because I couldn't even pass the theory test. Now I've picked it up again and have been learning to drive for around a year. I can get from A to B just fine and my manoeuvres are okay, but I've failed the practical test three times. 

Anyone else find driving extremely challenging? I know a few other autistic people and as far as I'm aware none of them drive.