The only time I've had driving anxiety was after quite a bad crash some 12 years back... this is obviously quite normal for anyone.

It took some weeks to get over the shock of the accident, but eventually I got back in the car and started driving around VERY CAREFULLY, lol
Time was the healer for this incident.

I don't tend to think about breaking down in the middle of nowhere for a few reasons:

1/ I don't drive out into the middle of nowhere for starters. My driving patterns are pretty fixed.

2/ If I do wander... then I'll always have my phone, or there'll be help near by, like a phone box, house or whatever.

Funny isn't it... I fear having a heart attack, but I don't give a hoot about driving. Driving is as natural as walking, to me.