When you're at home click on the wrench and hammer button, animals, there should be an option called "take" if you don't see it you may have to train your horse with "mount" I believe.
Edit: it's ride not mount.
