Suggestion: context limit progress bar

For those that don’t know, the context limit is the amount of tokens that an LLM will be able to “remember” as you go.

As of now, the limit on JanitorAI is around 6000, which is approximately 4500 words.

I think it would be helpful if somewhere on screen, you could see a “context limit bar” fill up as you reach that cutoff. This way, you could try to wrap up a session by the time the bot runs out of memory and starts losing crucial details.

(If there is a logistical reason this can’t happen lmk and I’ll shut up)