I encoutered this as well, but I didn't need to close the game. Just changing the boat a few times worked for me (usually the honey block worked best in getting rid of it)
