Finally, if a large tumor grows in the pituitary, it may press on the optic nerves, which connect the eye to the brain, since the pituitary gland's position at the base of the skull is just beneath the optic nerves. This can cause vision problems.