I tested it and you have nothing to do with the bad performances of this game. Unfortunatly, GPT2 unless finetuned is a bad model. GPT-3/GPT4/Falcon-7B or even Flan-T5-Large or XL would have been better alternatives ( but some would probably not run/take forever to load if run locally ) :)