I think as long as the overall important things that need to be known are in english or obviously telegraphed, like things for progression or how to use controls it might be fine. At the very least its throughpoint can be understood even with your gimmick so we know how to judge it in full.