Others have mentioned the wall colliders. I gave it a few tries and I couldn't get the fishes to get near even whilst pressing "s". Maybe adding a sprint button or "shoot" mechanic as you're kind of a spear just so you don't move at the same speed as the fish.