Really cool ! The idea is very cool ! But now the next step should be to have an interpretation of those loud facts, and to obtain a mechanistic interpretability analysis !