A super simple fix in unity is checking that if there is no input from the user then set the player's velocity to zero. There's a load of ways to move objects in unity and definitely something worth exploring.
