Issue with Python on whales

[justRICHTOFEN]

I am having some trouble getting this to work. I am using web UI, and am at step 6 for the install. When I check the Memoir box and then click apply and restart,I am getting this Error stating that: "ModuleNotFoundError: No module named 'python_on_whales'"

I have python_on_whales installed and I am also running qdrant in docker using the yaml file you included.

I am not so knowledgeable (but am trying to learn) on this and this is most likely user error on my part.

That being said, would you be able to offer any assistance as to what I am doing wrong? My OS is win 11 and my web ui is installed locally on my desktop.

I did see the other post about this issue, but did not see a solution for it. what ever additional information is needed, i would be happy to provide.

[brucepro]

Since you are running qdrant in your own docker, you can comment out the import and remove the auto start code from the startup function

[justRICHTOFEN]

Since you are running qdrant in your own docker, you can comment out the import and remove the auto start code from the startup function

Thanks a Bunch Bruce! It has taken me three days to figure this out, but with your advice I have finally gotten the extension to run!

Now, is there a sure fire way to test if it is working as it should?

Also, and this is out of the scope of the initial question but, if I have the Memoir extension working on Web UI, would Silly tavern use it (since it's linked to Web UI) or does the extension have to be specifically install in silly tavern (if it's even compatible)?

[justRICHTOFEN]

Guess I spoke too soon. I just did a test chat on web ui itself (no silly tavern) and it generated this error message:

A name error appears stating: NameError: name 'SentenceTransformer' is not defined

[brucepro]

Run the cmd Linux sh script, go to the memoir folder. pip install -r requirements.txt
Not sure why it didn't install the dependancy.

[justRICHTOFEN]

Just to clarify and make sure im not being a dummy (which is probably the case), I have docker running the Qdrant, but the web ui and everything else is running on my windows desktop. Is that fine or does everything need to be on one or the other?

When i ran that command on either my desktop or the docker terminal I got this message both times:

Strangely enough, when i went to the memoir folder location on my windows desktop, input cmd to pull it up in cmd prompt, and then ran the pip install -r requirements.txt, it returned this:

From the top to the bottom of that cmd prompt, it said requirement already satisfied. I do believe this to be user error on my part though.

[brucepro]

Qdrant can be anywhere as long as the setting points to the location.
As for the pip install, textgen uses an environment to run everything, typically you can switch to that environment by running .\venv\Scripts\activate

I think text gen has a .bat script too.

Next time I get some free time I will update all the docs and confirm it works with latest textgen, last time I checked was with the portable version. I prolly just need to write oobooga an mcp wrapper so you can use my memory mcp.

[Destromite]

I'm also having this whale issue. I have qdrant in docker as well on windows. Got the whale error and commented it out and now its not crashing on start but it fails to generate text with the following errors. My Qdrant is reachable with its default local IP.

File "C:\Users\mocks\Downloads\text-generation-webui-main\modules\chat.py", line 797, in chatbot_wrapper
text = apply_extensions('input', text, state, is_chat=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\mocks\Downloads\text-generation-webui-main\modules\extensions.py", line 251, in apply_extensions
return EXTENSION_MAP[typ](*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\mocks\Downloads\text-generation-webui-main\modules\extensions.py", line 109, in _apply_string_extensions
text = func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\mocks\Downloads\text-generation-webui-main\extensions\Memoir\script.py", line 216, in input_modifier
params['user_long_term_memories'] = ltm.recall(string)
^^^^^^^^^^^^^^^^^^
File "C:\Users\mocks\Downloads\text-generation-webui-main\extensions\Memoir\memory\long_term_memory.py", line 105, in recall
results = self.qdrant.search(
^^^^^^^^^^^^^^^^^^
AttributeError: 'QdrantClient' object has no attribute 'search'

[brucepro]

They updated it to use points query instead of search in the latest version. https://api.qdrant.tech/api-reference/search/query-points Will push some updates to memoir this weekend as I have lots of improvements from my buildautomata memory mcp, also have a mcp client extension that is almost ready to release this weekend that will add MCP client features to textgenwebui that way you can run any mcp server.

[Destromite]

Aw, that is unfortunate but i appreciate you working on it. I look forward to the update!

[brucepro]

Test out latest code and let me know if you still encounter any issues.