I'm getting this same issue, it seems to scan the entire project and automatically add everything to it on ready, it definitely shouldn't do that.
Even on small projects that's alot of files being registered on the plugin being enabled.
Managed to get it working by removing the scan_folder() in the ready call inside ultimate_panel.gd