I guess I'm just looking for some reassurance that at least (for the time being) I'm not being irrational that this could be MS.
Some or all of your symptoms *could* be from MS (and I agree the pituitary guess sounds pretty unlikely), but MS isn't the only thing that messes with nerves and
you shouldn't assume you only have one cause. I wouldn't skip the MRI & neuro visit, but it sounds to me like you should see at least two more doctors as well.
Try to see a spine specialist about the non-visual symptoms (preferably a physiatrist: they really understand nerves). I've had all kinds of pain & numbness from herniated discs and a cyst, including most of what you described.
You should also try to get to an ophthalmologist. Neuros aren't usually qualified to definitively diagnose (dx) Optic Neuritis, the most common MS visual problem. On the self-dx side, I believe ON usually causes eye pain as well as visual effects. So if you have no eye pain it's probably not an MS symptom...
Best of luck,