I feel that this symptom is occurring when the bot is at the entrance.
That's right. The building has to wait until it's safe to move, so it waits until there are no bots accessing it.
