You can just walk back to the fertilizer spot and press space, when the "press space" thingy pops up.
