Python: How to reset chat session?

[ShovingLeopard]

Issue you'd like to raise.

I have create a Gradio driven interface to GPT4All but I am having a problem trying to work out if it is possible to reset the chat session when the user hits "clear" - which resets the callback's history List argument to zero length.

I have a continuous history working using the Python with context as per the examples:

with model.chat_session():

  def get_chat_response(message: str, history: list) -> str:
    if (len(history) == 0):
      print("how do i remove the chat history here")
    result = ""
    if (streaming):
      for token in model.generate(prompt=message, 
                              temp=0, 
                              max_tokens=4000, 
                              streaming=True):
        result += token
        yield result
    else:
      return model.generate(prompt=message, 
                            temp=0, 
                            max_tokens=4000)

  if (streaming):
    gr.ChatInterface(get_chat_response, chatbot=gr.Chatbot(height=1000)).queue().launch()
  else:
    gr.ChatInterface(get_chat_response, chatbot=gr.Chatbot(height=1000)).launch()

If I put the 'with model.chat_session()' within the callback it of course resets the chat session every prompt which is not desired.
I have also tried running model.chat_session() without using the context and this just produces #s as output tokens as the result.

Suggestion:

Add a function to reset the chat history within a session.

[cebtenzzre]

If you from gpt4all.gpt4all import empty_chat_session you can do this when you want to reset the chat:

model.current_chat_session = empty_chat_session(model.config["systemPrompt"])

Is that a good enough solution?

[ShovingLeopard]

That is fantastic @cebtenzzre. Many thanks!

[niranjan-mohandas-hat]

Can you share the continuous integration of the chat-history you implemented with us @ShovingLeopard

[HaochongYANG]

If you from gpt4all.gpt4all import empty_chat_session you can do this when you want to reset the chat:

model.current_chat_session = empty_chat_session(model.config["systemPrompt"])

Is that a good enough solution?

Hi, I've been trying to import empty_chat_session from gpt4all.gpt4all, but it shows ImportError: cannot import name 'empty_chat_session' from 'gpt4all.gpt4all'. Did we removed this from the recent source code? Thanks:)

[cebtenzzre]

Hi, I've been trying to import empty_chat_session from gpt4all.gpt4all, but it shows ImportError: cannot import name 'empty_chat_session'

My previous answer was actually incorrect - writing to chat_session does nothing useful (it is only appended to, never read), so I made it a read-only property to better represent its actual meaning. See #1959 for the current issue tracking this feature request - it is currently not possible to do using the public interface of the GPT4All class.

[HaochongYANG]

Hi, I've been trying to import empty_chat_session from gpt4all.gpt4all, but it shows ImportError: cannot import name 'empty_chat_session'

My previous answer was actually incorrect - writing to chat_session does nothing useful (it is only appended to, never read), so I made it a read-only property to better represent its actual meaning. See #1959 for the current issue tracking this feature request - it is currently not possible to do using the public interface of the GPT4All class.

Thanks for the quick reply! Since the feature is being removed, is #1959 a replacement for it?

[cebtenzzre]

Since the feature is being removed, is #1959 a replacement for it?

The only "feature" that has been removed is the ability to set current_chat_session to a python list other than the actual current chat session - this did not affect the LLM's output. #1959 is a request for a feature that would allow you to actually modify the chat history seen by the LLM, other than calling .generate with a previous prompt, waiting patiently, and hoping that the reply is the same.

[brycepg]

I'd like to rewrite chatbot history on new text in the chatinterface. How would I do that?

Edit: I posted code in gradio-app/gradio#4444

[cebtenzzre]

I'd like to rewrite chatbot history on new text in the chatinterface. How would I do that?

This is possible as of #3225, although work on that PR is currently stalled due to other priorities. If you are comfortable building from source, you could try it and see if it works for you. See related discussion at #2360.