Technically, you can. It just takes twice as long to get there. About four hours of flying for every day on foot.

[He tries to break this as gently as possible, keeping his tone neutral. Still, he figures this news'll put a damper on her mood, so he'll add:]

If it's any consolation, I didn't know that my first time around. It's why I went through that cave in the first place.