good news overall, nhe!
perhaps your proprioception needs more time to adjust to a new physical layout. I have been learning more about this idea in physio, since I did in my knee. I have to do exercises where I balance on one foot and look rapidly in different directions. it forces my body to use muscles rather than eyes to stay in position, while overall the rest of me has been slowly learning how to use a knee with a missing ligament.
I used to be a lot worse with proprioception and at one time it was quite clear that my eyes were a major player in how I positioned myself. the klenner protocol made a significant dent in my earlier, glaring problems.
these balance drills pointed up more subtle issues which made me realize why I had previously felt disoriented on ladders - look up, and there goes the frame of reference. I also noticed that the ladder problem faded with repetition. so interesting that yes, I did simply 'get used to' ladders, but it seems it would have been due to forcing my body to take a more active role in my balance overall.
I will ask my physio guy at my next appt if he thinks standing balance drills could help you too.
bahaha world without zinc https://www.youtube.com/watch?v=U1iCZpFMYd0