omg you were right, while checking something else I realized that there is a bug that causes the kittens to always stay with the same toy. Oops!