I really like the idea of this game but am struggling to make it work. I've been trying to play the "black friday" scenario, but can't get past the first few prompts without running into issues. Sometimes the generated text cuts off in the middle of a sentence, sometimes it generates text that is nonsensical or inconsistent with the history, and sometimes it repeats itself within the first few sentences and gets into an endless loop.
I've tried playing around with the following options:
- models: gpt2-large, gpt-neo-2.7b, gpt-J-6B-adventure
- generation max length: 60-400
- randomness: 0.4-0.7
- max time: 60-120
- context max length: 1000-10000
- memory max length: 400-4000
- remove unfinished sentences: off/on
- offload model: off/on
System info:
Processor AMD Ryzen 5 5600 6-Core Processor, 3501 Mhz, 6 Core(s), 12 Logical Processor(s) Installed Physical Memory (RAM) 32.0 GB Name NVIDIA GeForce RTX 3080 OS Name Microsoft Windows 11 Home Version 10.0.22621 Build 22621
Can someone please recommend a setup (model and all settings) that have given good results? Thanks!