I’ll give that a try. I’ve managed to kick one of my scenarios into ok shape, 50% of the time it’ll go thirty or forty iterations out before it decides on it’s three favorite paragraphs and writes them forever. I’ve got an upgraded account already so I might as well burn some requests. Thank you.
Good lord that’s a difference. I tried your suggestions and they are SO fast, but were lacking some of the initial pick-up-the-ball-and-run-with-it that the larger models seem to have so I just plugged in Roleplaying and 128k as my model prompts and then fluffed my account up to see what it costs for an evening of debugging my models.
mistralai/mistral-nemo did a fine job. Didn’t lecture too much about spicy content and was endlessly redirectable when it started to stray into wanting to restart the scenario or turn it into a PG hand-holding and imagining the future event. It did seem to like to do odd things with dialogue during explicit scenes, “ I-I-I-I-. . . oh-oh-oh-oh-oh” x20 at times, but was willing to go back to a more creative approach if kicked.
anthropic/claude-3.7-sonnet: EDIT: It was Claude-3.7-Sonnet that worked.. One of the sonnets, I think the 4.0 just flat out refused to play around with a relatively tame isolated-characters-fall-in-lust scenaro. 3.7 did work did an amazing job of being creative, including one long stretch that I’d have had to work on for days to get right, and I like to think that I’m an ok writer with caffeine and my ADD meds on board.
EDIT: Google: Gemini 2.0 Flash initially almost did as nicely as Claude 3.7, but even with a pretty clearly defined scenario it would crash into non sequiturs along with a disdain for english syntax and start creating it’s own sentence structure.
So, thank you for the suggestion to go back and try the models hosted elsewhere. 3 second pause while it queues up, then twenty paragraphs of good content, much much reduced context-locking and not nearly as much lecturing on sensitive topics as I’d expected. All three models I worked with did need a little prompting to get out of extensive thoughts bubbles on the topic of safe, sane and consensual, but once it knew that both characters were ok, they’d run for many narrative cycles before trying to “check in” again.
I likely ran my problematic (as far as overly convoluted prompt problems on my end) scenario for two hundred prompts and my more streamlined scenario for three hundred prompt cycles and it cost me. . . $3.50? I’ll still play with the locally hosted stuff just to see how far I can push it, but the cost/benefit for even the most capable role-play models online is well worth it to me.
Glad to help, I also played around with hosting locally for a long time, but my weak PC can't even come close to the models that openrouter offers. Now you just need to find a model that suits your taste, configure promt for it and that's it. I tried mistralai/mistral-nemo and anthropic/claude-3.7-sonnet too but I didn't like them. You can also go to the "rankings" tab on the openrouter and filter the models by the roleplay tag and try some of them