That's for the more storied idea of gameplay, and it's what's inherited from Cyberborne specifically. It's true, just about every roll comes with an effect and there are few ttrpg systems out there with something similar.
However - it's a solo ttrpg. Feel free to play without those modifiers and view that portion in a way that works for you. Yeah, you'll lose the little bump on the 6, but it won't break the game. You can even think of it as "casual mode" so you can focus on the other aspects of gameplay.
I'm a big believer in bending the rules to keep it fun. So do so with my full blessing.