Well. You can definitely make it ride up the mountain. That's exactly what Skyrim Horses are for. Yep. The best and easiest mountain-climbing of all Skyrim, is on a horse. How they scale nearly sheer surfaces like that, the world will never know.