Apples take quite a bit longer to find than blueberries. Currently, whenever you switch the cooldown is reset, so if you keep switching back and forth you'll keep resetting and your foragers will never find anything :p
