My feeling is that you'll lose a lot of time trying to do that, that you could instead put into getting skeletal animations working - that will let you do swappable parts/wearables more easily. Those are just my two cents of course, it's been a while since I did 3D :)