That is fine, you take your time with what you are currently doing and when you are ready, you can start including scenes for them as well as them being able to visit the stables that have been built in the player's home and do other things with them.
I just found where i encountered Scar AKA the Cocky Guard, for the first time as well as the first horse scene in the human town.