Thank you for the feedback! I think I really pushed the Godot AudioStreamGenerator to its limits with this project, and I couldn't really optimize it more without having to rewrite a lot of code in C++, and even then I'm not sure it would fix the issues.
Great point about controlling the pitch wheel with midi, I'll put that on the list of post-rating-period improvements! :)