I didn't know Four-Sided Fantasy, but after checking I completely understand why you got this feeling
Also the cooldown duration was a bit of a debate with my friend, I initially wanted it twice longer since you can stack swaps by killing enemies (initially a bug that turned out being a good hidden mechanic for the speedrun)
But thanks for your opinion, I take everything in consideration