So that's why you don't go adventuring alone... Learned a lot from this PSA
You can go alone, but you'll need a sword -- which you should bring yourself, in case the wizard doesn't show up in time :)