Everything you've heard about game designers is also true about requirements engineers or business analysts in the wider software industry. If they just write a spec and then bugger off, things aren't gonna go well.
That doesn't mean they aren't "important", it means they have to be deeply integrated into the development process and iterate on their ideas together with team members from other disciplines (especially programmers) to deliver good work.