I think in this case it would be better to use a separate sprite as a collision box and don't have the 3D object do collisions.
The separate sprite can be thinner and rotated.
In general I think this is a good idea, use 3D for the visuals and use sprites, etc. for collision, etc.