I probably should have gone for making a gun, yeah.
You can get a sword though! It's the wooden stick thing a little to the left of spawn, just walk over it and you should be able to pick it up :D