Up/Down Map question

If you live at a lower elevation than a friend but she lives at a lower latitude, do you exclaim, "Hang on sweetheart, I'll be down to see you!" Or, "Hang on sweetheart, I'll be up to see you"?