How to Flush Chat History

[mikeburton220]

How do I flush chat history while a script is running? I'm running into issues where my history is "too large" and I need to flush it during my loops. I'm not sure how to do this?

I see flushAll() in the chatHistoryInterface, but i'm not sure how to call it. Do I call it during my chat call? Agent::make()->chat(new UserMessage($message)

[ilvalerione]

It's an utility method to give you the ability to trigger a clean up of a thread or a user's chat if you need. You can call it from the agent instance, like this:

$agent = Agent::make();

$agent->resolveChatHistory()->flushAll();

[mikeburton220]

Thank you!

[mikeburton220]

Do you think it would be good to have the option to disable chat history when calling the agent?

[ilvalerione]

There's no reason I think. It will start with a volatile memory that has no impact.

[mikeburton220]

I keep getting this exception when running a loop. I called flushAll() before each chat() call.

NeuronAI\Exceptions\ChatHistoryException

No messages in the chat history. It may have been filled with too large a message.

at vendor/neuron-core/neuron-ai/src/Chat/History/AbstractChatHistory.php:65
61▕ {
62▕ $message = \end($this->history);
63▕
64▕ if ($message === false) {
➜ 65▕ throw new ChatHistoryException('No messages in the chat history. It may have been filled with too large a message.');
66▕ }
67▕
68▕ return $message;
69▕ }

  +2 vendor frames 

I'm sending very large prompts to the Google 2.5 Flash Model with has a million token context window.

[ilvalerione]

You need to configure the context window on the chat history instance accordingly:

https://docs.neuron-ai.dev/the-basics/chat-history-and-memory#inmemorychathistory

By default is 50K tokens, you might increase it as per your need.