The art looks great but I think the game needs a little more instruction. Someone also commented locking movement and slowing down walk and I think that would be a great choice to make the game work more aesthetically!
All in all good for a first game jam and you probably learnt a lot and can make something even better next time :).
Perhaps enemies you have to dodge as the timer goes down? Or maybe you need to bring the coins back to feed the totem yourself but you can't go too far or else something bad happens?