In your ComfyUI settings, go to server config at the bottom of the settings categories. In Network there's an option labeled "Enable CORS header: Use '*' for all origins or specify domain". Set this to "*" to get it to connect with CLM.
I had this happen to me today after it had been running fine, I think the new ComfyUI update added some new security check.