Multiplying everything by deltatime seems to have made everything more consistent, but we still don't really understand why. The only thing I've found is that the frame rates must be very different, but I don't know how that would happen.