Basic Chat, RAG in Symfony

[tacman]

git clone [email protected]:survos-sites/bots && cd bots
composer install

Install Meilisearch, or tweak the code to another vector store.

echo "OPENAI_API_KEY='sk-...'" > .env.local
bin/console ai:chat

RAG

Load some local news stories or products. Products is working, sort of, and the news stories I don't think are.

bin/console ai:products --embed
bin/console ai:rapp --embed

[ilvalerione]

If Meilisearch works properly do you think the request in the issues can be closed?

[tacman]

In fact, I shut down my meilisearch instance, and my load script did not give an error. So something's amiss.

[tacman]

Load script: https://github.com/survos-sites/bots/blob/main/src/Command/RappCommand.php
Agent: https://github.com/survos-sites/bots/blob/main/src/Agent/RappAgent.php

[ilvalerione]

After embedding documents here: https://github.com/survos-sites/bots/blob/main/src/Command/RappCommand.php#L63

You have to add embedded documents into the vector store:

$embedder = new OpenAIEmbeddingsProvider(...);
$store = new MeilisearchVectorStore(...)

$store->addDocuments(
    $embedder->embedDocuments(
        StringDataLoader::for($text)->getDocuments()
    )
);

After populating the vectore store your agent will start responding taking the uploaded knowledge in consideration.

Based on the Meilisearch implementation the first time addDocuments is called, it should create the index if it doesn't exist.

[tacman]

Thanks! Since the vectorStore() method is marked as protected in the example and parent class, I figured that was happening automatically. So my solution was to mark both embeddings() and vectorStore() as public in the Agent, so that they caller could access them to add the documents.

But maybe better would be an addDocuments method in the RAG class that added them. That is, replace

                $documents = StringDataLoader::for($text)->getDocuments();
                $this->agent->embeddings()->embedDocuments($documents);
                $this->agent->vectorStore()->addDocuments($documents);

with

                $documents = StringDataLoader::for($text)->getDocuments();
                $this->agent->addDocuments($documents);

That could even be added to the base RAG class, since it seems like it'd be pretty common, yes?

[ilvalerione]

It could be a good addition. Let me explore this opportunity.

[tacman]

I made a bunch of additions, including making the UI a bit prettier.

None of the RAG stuff works yet, I have it working locally because I can use the filesystem, but on production I'll need either Meilisearch or Postgres + the vector extension.

My goal is to get all of the example snippets and turn them into a working demo.

https://chad.survos.com/

[ilvalerione]

I would like to share it with the marketing team if you will.

[tacman]

certainly!