Thanks for playing! Will try out Jolt next time, but the wall collider issue was due to auto generated trimeshes on models that were not very optimized. We fixed it by manually adding basic colliders to the building structures.
yea jolt should fix that. I use the automatic trimeshes all the time now no issue using it.