When you forage mushrooms, theres a small chance for them to be Toadstools (poisonous) instead of Shiitakes (safe). I'd recommend using quicksaves in order to make the gathering process easier.
Make a quick save before entering a location with mushrooms, go in, forage the mushroom, and if you didnt get toadstools, reload the save and rinse and repeat until you do.