While it might be nice to have the option, full controller inputs would just be at a strong disadvantage as well as not working that well with diagonals.
It's hard to beat keyboard; I'll give you that much :D You're probably right, but I feel like I'm gonna be chewing on creative alternatives to this anyway