Yep, the timer just slowed cognitive processes in my head and added a bit of frustration at the begining. I believe your alcheny mechanic is good and complecated enough without the need for slowing it down. Different players have different pace of their playstyle.
Moreover, I guess that cooldowns have sence when those arer combined with other time-based mechanics.