[Context Shifting: Erased 7 tokens at position 2]
Processing Prompt (10 / 10 tokens)
Generating (77 / 512 tokens)
(EOS token triggered! ID:128009)
[10:06:31] CtxLimit:3661/4096, Amt:77/512, Init:0.05s, Process:1.29s (129.4ms/T = 7.73T/s), Generate:14.34s (186.2ms/T = 5.37T/s), Total:15.63s (4.93T/s)
Output: <Generated Message>
Generate: The response could not be sent, maybe connection was terminated?
the connection getting terminated. i run local LLM with kobaldcpp as per the documentation of this game.
can you able to analyze what's going on here?
