I apologize for not understanding the in-game explanation but how do you exactly remove crests? all I says in the in-game explanation is "it'll grow and shrink overtime depending on personality".
Those things aren't implemented yet. Currently they cannot be removed.
