I'm guessing you can't harvest it because your inventory's full? Try and make an empty spot, it's probably not going away because there's no where for the potatoes to go since when you harvest a plant it gives you more than one (you get two I think)
