I just went to check that it was still happening and the monster I created stuck around, so whatever was causing the issue seems to have fixed itself. I did run a bunch of updates on things recently so maybe something there caused an issue. All good now!