Ah it turns out I forgot to set the games package to "Shipping" instead of "Development" which means you must of triggered one of UE4 Debug tools.
Ah, it happens haha
