After the update 2.0, you'll be able to give poisoned mice to most cats, though I'm not sure if it applies to all of them. In any case, as far as I know, if you give one to Cedarstar, she'll banish you from the Clan.
