So I ended up getting fixing my issues for the most part though the data getting stuck still happens but doesn't seem to just be an issue for me from what I have heard from others.
The non descriptive responses from the AI was with single-paragraph mode turned on and turning that off helped but also I moved to a higher quant version of my AI and that helped a lot. Along with helping the data not get stuck as often though it still does happen, I think once the context fills up too much it starts happening.
In regard to getting the AI to respond outside the story, it just took some coaxing and rules for it to start replying.
Moved from Mistral-7B-Instruct-v0.3-abliterated.Q4_K_S to the same model Q5_K_M which still fit in my VRAM.