Access to chat memory in LlmRanker

[smilyanovr]

Hi!

I've been looking into Autonomy usage which internally will use the LlmRanker in order to decide which the best goal is based in user's input.

Let's assume the following scenario:

1. User ask a question
2. A goal is selected by the LlmRanker
3. Selected goal might end up with asking user for more context/information
4. Then user provides answer
5. Next call by LlmRanker will try to choose the next best goal only by the user input provided in 4) without information on what happened so far
6. Next goal selection might become a bit unreliable

I imagine that LlmRanker needs to have access to the previous messages (chat memory) in order to compute the next goal in the best possible way.

What do you think about this?

[johnsonr]

In Embabel, chat memory is not included by default. There is no conversation history unless the user chooses to use the Conversation interface, which is automatically used by a chatbot.

In the case of a chatbot, Autonomy is less necessary because you can have multiple actions to respond to UserMessage. See the guide and ragbot repositories.

I'd like to understand more about your use case. I'm converting this to a discussion for now; we can raise an issue if we figure out a necessary action.