You know, I literally dump everything in appearance and intellect and fuck my way through the entire game. Intellect allows me to make bombs for those enemies who resist lust. Only recently have I added to strength because appearance is now so high I 1/2-shot everything.
Oh, and there's also the fact that some stuff is locked behind certain stats. Some parts of the northern caves can only be unlocked with high enough perception and strength for example.