Back at home you have the icon with tools at the top of the screen (The place where you upgrade your house). On that screen there is an icon for garden/animals. You can take the horse on the animal screen.
I'm going to work on the GUI at some point to make it look more intuitive.