RAG_pipeline.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Retrieval Augmented Generation (RAG) for Question Answering\n",
    "\n",
    "This notebook demonstrates RAG mechanisms for pre-trained models for question-answering and text-generation tasks. The RAG model is a combination of a retriever and a generator. The retriever is responsible for finding relevant passages from a large corpus of text, and the generator is responsible for generating the answer based on the retrieved passages."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "%pip install langchain-huggingface\n",
    "%pip install transformers\n",
    "%pip install chromadb\n",
    "%pip install llama-index-vector-stores-chroma\n",
    "%pip install llama-index-embeddings-huggingface\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [],
   "source": [
    "import torch\n",
    "torch.cuda.set_device(0)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "from transformers import AutoModelForQuestionAnswering, AutoTokenizer, pipeline\n",
    "\n",
    "question_answering_roberta = \"deepset/roberta-base-squad2\"\n",
    "mistral_text_generation = \"mistralai/Mistral-Nemo-Instruct-2407\"\n",
    "\n",
    "# deepset/roberta-base-squad2\n",
    "\n",
    "question_answering_pipeline = pipeline('question-answering', model=question_answering_roberta, tokenizer=question_answering_roberta)\n",
    "question_answering = AutoModelForQuestionAnswering.from_pretrained(question_answering_roberta)\n",
    "tokenizer = AutoTokenizer.from_pretrained(question_answering_roberta)\n",
    "\n",
    "# mistralai/Mistral-Nemo-Instruct-2407\n",
    "mistral_pipeline = pipeline(\"text-generation\", model=mistral_text_generation, max_new_tokens=150)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Document Chunking\n",
    "Reading the entire document at once can be computationally expensive. To address this issue, we can split the document into smaller chunks and retrieve relevant chunks based on the question.\n",
    "\n",
    "_NOTE:_ The document chunking is done rule based and is not perfect. It is just a simple way to split the document into smaller chunks. However, for the rules itself it is quite good."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Extracted 1447 rules from the PDF.\n",
      "\n",
      "For example, a random chunk in the rules is:\n",
      " D7.2.3 Staging - The vehicle is staged at a staging line prior to the starting line. The timer starts\n",
      "only after the vehicle crosses the start line.\n",
      "\n",
      "\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "c:\\Users\\Chris\\Documents\\LLM_RAG\\venv\\lib\\site-packages\\pypdfium2\\_helpers\\textpage.py:80: UserWarning: get_text_range() call with default params will be implicitly redirected to get_text_bounded()\n",
      "  warnings.warn(\"get_text_range() call with default params will be implicitly redirected to get_text_bounded()\")\n"
     ]
    }
   ],
   "source": [
    "from utils import extract_rules_from_pdf\n",
    "import random\n",
    "\n",
    "pdf_path = \"FS-Rules_2024_v1.1.pdf\"\n",
    "extracted_rules = extract_rules_from_pdf(pdf_path)\n",
    "\n",
    "print(f\"Extracted {len(extracted_rules)} rules from the PDF.\\n\")\n",
    "print(f\"For example, a random chunk in the rules is:\\n {extracted_rules[random.randint(0, len(extracted_rules))]}\\n\\n\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Vector Database"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "import chromadb\n",
    "from llama_index.vector_stores.chroma import ChromaVectorStore\n",
    "\n",
    "# Create a ChromaDB collection\n",
    "chroma_client = chromadb.Client()\n",
    "chroma_collection = chroma_client.create_collection(\"rules\")\n",
    "\n",
    "\n",
    "# Create a vector store\n",
    "vector_store = ChromaVectorStore(chroma_collection=chroma_collection)\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Storing the document chunks in a vector database can help in faster retrieval of relevant chunks. For simplicity we use the TfidfVectorizer to convert the chunks into vectors and store them in a chromadb database."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "Insert of existing embedding ID: 0\n",
      "Add of existing embedding ID: 0\n",
      "Insert of existing embedding ID: 1\n",
      "Add of existing embedding ID: 1\n",
      "Insert of existing embedding ID: 2\n",
      "Add of existing embedding ID: 2\n",
      "Insert of existing embedding ID: 3\n",
      "Add of existing embedding ID: 3\n",
      "Insert of existing embedding ID: 4\n",
      "Add of existing embedding ID: 4\n",
      "Insert of existing embedding ID: 5\n",
      "Add of existing embedding ID: 5\n",
      "Insert of existing embedding ID: 6\n",
      "Add of existing embedding ID: 6\n",
      "Insert of existing embedding ID: 7\n",
      "Add of existing embedding ID: 7\n",
      "Insert of existing embedding ID: 8\n",
      "Add of existing embedding ID: 8\n",
      "Insert of existing embedding ID: 9\n",
      "Add of existing embedding ID: 9\n",
      "Insert of existing embedding ID: 10\n",
      "Add of existing embedding ID: 10\n",
      "Insert of existing embedding ID: 11\n",
      "Add of existing embedding ID: 11\n",
      "Insert of existing embedding ID: 12\n",
      "Add of existing embedding ID: 12\n",
      "Insert of existing embedding ID: 13\n",
      "Add of existing embedding ID: 13\n",
      "Insert of existing embedding ID: 14\n",
      "Add of existing embedding ID: 14\n",
      "Insert of existing embedding ID: 15\n",
      "Add of existing embedding ID: 15\n",
      "Insert of existing embedding ID: 16\n",
      "Add of existing embedding ID: 16\n",
      "Insert of existing embedding ID: 17\n",
      "Add of existing embedding ID: 17\n",
      "Insert of existing embedding ID: 18\n",
      "Add of existing embedding ID: 18\n",
      "Insert of existing embedding ID: 19\n",
      "Add of existing embedding ID: 19\n",
      "Insert of existing embedding ID: 20\n",
      "Add of existing embedding ID: 20\n",
      "Insert of existing embedding ID: 21\n",
      "Add of existing embedding ID: 21\n",
      "Insert of existing embedding ID: 22\n",
      "Add of existing embedding ID: 22\n",
      "Insert of existing embedding ID: 23\n",
      "Add of existing embedding ID: 23\n",
      "Insert of existing embedding ID: 24\n",
      "Add of existing embedding ID: 24\n",
      "Insert of existing embedding ID: 25\n",
      "Add of existing embedding ID: 25\n",
      "Insert of existing embedding ID: 26\n",
      "Add of existing embedding ID: 26\n",
      "Insert of existing embedding ID: 27\n",
      "Add of existing embedding ID: 27\n",
      "Insert of existing embedding ID: 28\n",
      "Add of existing embedding ID: 28\n",
      "Insert of existing embedding ID: 29\n",
      "Add of existing embedding ID: 29\n",
      "Insert of existing embedding ID: 30\n",
      "Add of existing embedding ID: 30\n",
      "Insert of existing embedding ID: 31\n",
      "Add of existing embedding ID: 31\n",
      "Insert of existing embedding ID: 32\n",
      "Add of existing embedding ID: 32\n",
      "Insert of existing embedding ID: 33\n",
      "Add of existing embedding ID: 33\n",
      "Insert of existing embedding ID: 34\n",
      "Add of existing embedding ID: 34\n",
      "Insert of existing embedding ID: 35\n",
      "Add of existing embedding ID: 35\n",
      "Insert of existing embedding ID: 36\n",
      "Add of existing embedding ID: 36\n",
      "Insert of existing embedding ID: 37\n",
      "Add of existing embedding ID: 37\n",
      "Insert of existing embedding ID: 38\n",
      "Add of existing embedding ID: 38\n",
      "Insert of existing embedding ID: 39\n",
      "Add of existing embedding ID: 39\n",
      "Insert of existing embedding ID: 40\n",
      "Add of existing embedding ID: 40\n",
      "Insert of existing embedding ID: 41\n",
      "Add of existing embedding ID: 41\n",
      "Insert of existing embedding ID: 42\n",
      "Add of existing embedding ID: 42\n",
      "Insert of existing embedding ID: 43\n",
      "Add of existing embedding ID: 43\n",
      "Insert of existing embedding ID: 44\n",
      "Add of existing embedding ID: 44\n",
      "Insert of existing embedding ID: 45\n",
      "Add of existing embedding ID: 45\n",
      "Insert of existing embedding ID: 46\n",
      "Add of existing embedding ID: 46\n",
      "Insert of existing embedding ID: 47\n",
      "Add of existing embedding ID: 47\n",
      "Insert of existing embedding ID: 48\n",
      "Add of existing embedding ID: 48\n",
      "Insert of existing embedding ID: 49\n",
      "Add of existing embedding ID: 49\n",
      "Insert of existing embedding ID: 50\n",
      "Add of existing embedding ID: 50\n",
      "Insert of existing embedding ID: 51\n",
      "Add of existing embedding ID: 51\n",
      "Insert of existing embedding ID: 52\n",
      "Add of existing embedding ID: 52\n",
      "Insert of existing embedding ID: 53\n",
      "Add of existing embedding ID: 53\n",
      "Insert of existing embedding ID: 54\n",
      "Add of existing embedding ID: 54\n",
      "Insert of existing embedding ID: 55\n",
      "Add of existing embedding ID: 55\n",
      "Insert of existing embedding ID: 56\n",
      "Add of existing embedding ID: 56\n",
      "Insert of existing embedding ID: 57\n",
      "Add of existing embedding ID: 57\n",
      "Insert of existing embedding ID: 58\n",
      "Add of existing embedding ID: 58\n",
      "Insert of existing embedding ID: 59\n",
      "Add of existing embedding ID: 59\n",
      "Insert of existing embedding ID: 60\n",
      "Add of existing embedding ID: 60\n",
      "Insert of existing embedding ID: 61\n",
      "Add of existing embedding ID: 61\n",
      "Insert of existing embedding ID: 62\n",
      "Add of existing embedding ID: 62\n",
      "Insert of existing embedding ID: 63\n",
      "Add of existing embedding ID: 63\n",
      "Insert of existing embedding ID: 64\n",
      "Add of existing embedding ID: 64\n",
      "Insert of existing embedding ID: 65\n",
      "Add of existing embedding ID: 65\n",
      "Insert of existing embedding ID: 66\n",
      "Add of existing embedding ID: 66\n",
      "Insert of existing embedding ID: 67\n",
      "Add of existing embedding ID: 67\n",
      "Insert of existing embedding ID: 68\n",
      "Add of existing embedding ID: 68\n",
      "Insert of existing embedding ID: 69\n",
      "Add of existing embedding ID: 69\n",
      "Insert of existing embedding ID: 70\n",
      "Add of existing embedding ID: 70\n",
      "Insert of existing embedding ID: 71\n",
      "Add of existing embedding ID: 71\n",
      "Insert of existing embedding ID: 72\n",
      "Add of existing embedding ID: 72\n",
      "Insert of existing embedding ID: 73\n",
      "Add of existing embedding ID: 73\n",
      "Insert of existing embedding ID: 74\n",
      "Add of existing embedding ID: 74\n",
      "Insert of existing embedding ID: 75\n",
      "Add of existing embedding ID: 75\n",
      "Insert of existing embedding ID: 76\n",
      "Add of existing embedding ID: 76\n",
      "Insert of existing embedding ID: 77\n",
      "Add of existing embedding ID: 77\n",
      "Insert of existing embedding ID: 78\n",
      "Add of existing embedding ID: 78\n",
      "Insert of existing embedding ID: 79\n",
      "Add of existing embedding ID: 79\n",
      "Insert of existing embedding ID: 80\n",
      "Add of existing embedding ID: 80\n",
      "Insert of existing embedding ID: 81\n",
      "Add of existing embedding ID: 81\n",
      "Insert of existing embedding ID: 82\n",
      "Add of existing embedding ID: 82\n",
      "Insert of existing embedding ID: 83\n",
      "Add of existing embedding ID: 83\n",
      "Insert of existing embedding ID: 84\n",
      "Add of existing embedding ID: 84\n",
      "Insert of existing embedding ID: 85\n",
      "Add of existing embedding ID: 85\n",
      "Insert of existing embedding ID: 86\n",
      "Add of existing embedding ID: 86\n",
      "Insert of existing embedding ID: 87\n",
      "Add of existing embedding ID: 87\n",
      "Insert of existing embedding ID: 88\n",
      "Add of existing embedding ID: 88\n",
      "Insert of existing embedding ID: 89\n",
      "Add of existing embedding ID: 89\n",
      "Insert of existing embedding ID: 90\n",
      "Add of existing embedding ID: 90\n",
      "Insert of existing embedding ID: 91\n",
      "Add of existing embedding ID: 91\n",
      "Insert of existing embedding ID: 92\n",
      "Add of existing embedding ID: 92\n",
      "Insert of existing embedding ID: 93\n",
      "Add of existing embedding ID: 93\n",
      "Insert of existing embedding ID: 94\n",
      "Add of existing embedding ID: 94\n",
      "Insert of existing embedding ID: 95\n",
      "Add of existing embedding ID: 95\n",
      "Insert of existing embedding ID: 96\n",
      "Add of existing embedding ID: 96\n",
      "Insert of existing embedding ID: 97\n",
      "Add of existing embedding ID: 97\n",
      "Insert of existing embedding ID: 98\n",
      "Add of existing embedding ID: 98\n",
      "Insert of existing embedding ID: 99\n",
      "Add of existing embedding ID: 99\n",
      "Insert of existing embedding ID: 100\n",
      "Add of existing embedding ID: 100\n",
      "Insert of existing embedding ID: 101\n",
      "Add of existing embedding ID: 101\n",
      "Insert of existing embedding ID: 102\n",
      "Add of existing embedding ID: 102\n",
      "Insert of existing embedding ID: 103\n",
      "Add of existing embedding ID: 103\n",
      "Insert of existing embedding ID: 104\n",
      "Add of existing embedding ID: 104\n",
      "Insert of existing embedding ID: 105\n",
      "Add of existing embedding ID: 105\n",
      "Insert of existing embedding ID: 106\n",
      "Add of existing embedding ID: 106\n",
      "Insert of existing embedding ID: 107\n",
      "Add of existing embedding ID: 107\n",
      "Insert of existing embedding ID: 108\n",
      "Add of existing embedding ID: 108\n",
      "Insert of existing embedding ID: 109\n",
      "Add of existing embedding ID: 109\n",
      "Insert of existing embedding ID: 110\n",
      "Add of existing embedding ID: 110\n",
      "Insert of existing embedding ID: 111\n",
      "Add of existing embedding ID: 111\n",
      "Insert of existing embedding ID: 112\n",
      "Add of existing embedding ID: 112\n",
      "Insert of existing embedding ID: 113\n",
      "Add of existing embedding ID: 113\n",
      "Insert of existing embedding ID: 114\n",
      "Add of existing embedding ID: 114\n",
      "Insert of existing embedding ID: 115\n",
      "Add of existing embedding ID: 115\n",
      "Insert of existing embedding ID: 116\n",
      "Add of existing embedding ID: 116\n",
      "Insert of existing embedding ID: 117\n",
      "Add of existing embedding ID: 117\n",
      "Insert of existing embedding ID: 118\n",
      "Add of existing embedding ID: 118\n",
      "Insert of existing embedding ID: 119\n",
      "Add of existing embedding ID: 119\n",
      "Insert of existing embedding ID: 120\n",
      "Add of existing embedding ID: 120\n",
      "Insert of existing embedding ID: 121\n",
      "Add of existing embedding ID: 121\n",
      "Insert of existing embedding ID: 122\n",
      "Add of existing embedding ID: 122\n",
      "Insert of existing embedding ID: 123\n",
      "Add of existing embedding ID: 123\n",
      "Insert of existing embedding ID: 124\n",
      "Add of existing embedding ID: 124\n",
      "Insert of existing embedding ID: 125\n",
      "Add of existing embedding ID: 125\n",
      "Insert of existing embedding ID: 126\n",
      "Add of existing embedding ID: 126\n",
      "Insert of existing embedding ID: 127\n",
      "Add of existing embedding ID: 127\n",
      "Insert of existing embedding ID: 128\n",
      "Add of existing embedding ID: 128\n",
      "Insert of existing embedding ID: 129\n",
      "Add of existing embedding ID: 129\n",
      "Insert of existing embedding ID: 130\n",
      "Add of existing embedding ID: 130\n",
      "Insert of existing embedding ID: 131\n",
      "Add of existing embedding ID: 131\n",
      "Insert of existing embedding ID: 132\n",
      "Add of existing embedding ID: 132\n",
      "Insert of existing embedding ID: 133\n",
      "Add of existing embedding ID: 133\n",
      "Insert of existing embedding ID: 134\n",
      "Add of existing embedding ID: 134\n",
      "Insert of existing embedding ID: 135\n",
      "Add of existing embedding ID: 135\n",
      "Insert of existing embedding ID: 136\n",
      "Add of existing embedding ID: 136\n",
      "Insert of existing embedding ID: 137\n",
      "Add of existing embedding ID: 137\n",
      "Insert of existing embedding ID: 138\n",
      "Add of existing embedding ID: 138\n",
      "Insert of existing embedding ID: 139\n",
      "Add of existing embedding ID: 139\n",
      "Insert of existing embedding ID: 140\n",
      "Add of existing embedding ID: 140\n",
      "Insert of existing embedding ID: 141\n",
      "Add of existing embedding ID: 141\n",
      "Insert of existing embedding ID: 142\n",
      "Add of existing embedding ID: 142\n",
      "Insert of existing embedding ID: 143\n",
      "Add of existing embedding ID: 143\n",
      "Insert of existing embedding ID: 144\n",
      "Add of existing embedding ID: 144\n",
      "Insert of existing embedding ID: 145\n",
      "Add of existing embedding ID: 145\n",
      "Insert of existing embedding ID: 146\n",
      "Add of existing embedding ID: 146\n",
      "Insert of existing embedding ID: 147\n",
      "Add of existing embedding ID: 147\n",
      "Insert of existing embedding ID: 148\n",
      "Add of existing embedding ID: 148\n",
      "Insert of existing embedding ID: 149\n",
      "Add of existing embedding ID: 149\n",
      "Insert of existing embedding ID: 150\n",
      "Add of existing embedding ID: 150\n",
      "Insert of existing embedding ID: 151\n",
      "Add of existing embedding ID: 151\n",
      "Insert of existing embedding ID: 152\n",
      "Add of existing embedding ID: 152\n",
      "Insert of existing embedding ID: 153\n",
      "Add of existing embedding ID: 153\n",
      "Insert of existing embedding ID: 154\n",
      "Add of existing embedding ID: 154\n",
      "Insert of existing embedding ID: 155\n",
      "Add of existing embedding ID: 155\n",
      "Insert of existing embedding ID: 156\n",
      "Add of existing embedding ID: 156\n",
      "Insert of existing embedding ID: 157\n",
      "Add of existing embedding ID: 157\n",
      "Insert of existing embedding ID: 158\n",
      "Add of existing embedding ID: 158\n",
      "Insert of existing embedding ID: 159\n",
      "Add of existing embedding ID: 159\n",
      "Insert of existing embedding ID: 160\n",
      "Add of existing embedding ID: 160\n",
      "Insert of existing embedding ID: 161\n",
      "Add of existing embedding ID: 161\n",
      "Insert of existing embedding ID: 162\n",
      "Add of existing embedding ID: 162\n",
      "Insert of existing embedding ID: 163\n",
      "Add of existing embedding ID: 163\n",
      "Insert of existing embedding ID: 164\n",
      "Add of existing embedding ID: 164\n",
      "Insert of existing embedding ID: 165\n",
      "Add of existing embedding ID: 165\n",
      "Insert of existing embedding ID: 166\n",
      "Add of existing embedding ID: 166\n",
      "Insert of existing embedding ID: 167\n",
      "Add of existing embedding ID: 167\n",
      "Insert of existing embedding ID: 168\n",
      "Add of existing embedding ID: 168\n",
      "Insert of existing embedding ID: 169\n",
      "Add of existing embedding ID: 169\n",
      "Insert of existing embedding ID: 170\n",
      "Add of existing embedding ID: 170\n",
      "Insert of existing embedding ID: 171\n",
      "Add of existing embedding ID: 171\n",
      "Insert of existing embedding ID: 172\n",
      "Add of existing embedding ID: 172\n",
      "Insert of existing embedding ID: 173\n",
      "Add of existing embedding ID: 173\n",
      "Insert of existing embedding ID: 174\n",
      "Add of existing embedding ID: 174\n",
      "Insert of existing embedding ID: 175\n",
      "Add of existing embedding ID: 175\n",
      "Insert of existing embedding ID: 176\n",
      "Add of existing embedding ID: 176\n",
      "Insert of existing embedding ID: 177\n",
      "Add of existing embedding ID: 177\n",
      "Insert of existing embedding ID: 178\n",
      "Add of existing embedding ID: 178\n",
      "Insert of existing embedding ID: 179\n",
      "Add of existing embedding ID: 179\n",
      "Insert of existing embedding ID: 180\n",
      "Add of existing embedding ID: 180\n",
      "Insert of existing embedding ID: 181\n",
      "Add of existing embedding ID: 181\n",
      "Insert of existing embedding ID: 182\n",
      "Add of existing embedding ID: 182\n",
      "Insert of existing embedding ID: 183\n",
      "Add of existing embedding ID: 183\n",
      "Insert of existing embedding ID: 184\n",
      "Add of existing embedding ID: 184\n",
      "Insert of existing embedding ID: 185\n",
      "Add of existing embedding ID: 185\n",
      "Insert of existing embedding ID: 186\n",
      "Add of existing embedding ID: 186\n",
      "Insert of existing embedding ID: 187\n",
      "Add of existing embedding ID: 187\n",
      "Insert of existing embedding ID: 188\n",
      "Add of existing embedding ID: 188\n",
      "Insert of existing embedding ID: 189\n",
      "Add of existing embedding ID: 189\n",
      "Insert of existing embedding ID: 190\n",
      "Add of existing embedding ID: 190\n",
      "Insert of existing embedding ID: 191\n",
      "Add of existing embedding ID: 191\n",
      "Insert of existing embedding ID: 192\n",
      "Add of existing embedding ID: 192\n",
      "Insert of existing embedding ID: 193\n",
      "Add of existing embedding ID: 193\n",
      "Insert of existing embedding ID: 194\n",
      "Add of existing embedding ID: 194\n",
      "Insert of existing embedding ID: 195\n",
      "Add of existing embedding ID: 195\n",
      "Insert of existing embedding ID: 196\n",
      "Add of existing embedding ID: 196\n",
      "Insert of existing embedding ID: 197\n",
      "Add of existing embedding ID: 197\n",
      "Insert of existing embedding ID: 198\n",
      "Add of existing embedding ID: 198\n",
      "Insert of existing embedding ID: 199\n",
      "Add of existing embedding ID: 199\n",
      "Insert of existing embedding ID: 200\n",
      "Add of existing embedding ID: 200\n",
      "Insert of existing embedding ID: 201\n",
      "Add of existing embedding ID: 201\n",
      "Insert of existing embedding ID: 202\n",
      "Add of existing embedding ID: 202\n",
      "Insert of existing embedding ID: 203\n",
      "Add of existing embedding ID: 203\n",
      "Insert of existing embedding ID: 204\n",
      "Add of existing embedding ID: 204\n",
      "Insert of existing embedding ID: 205\n",
      "Add of existing embedding ID: 205\n",
      "Insert of existing embedding ID: 206\n",
      "Add of existing embedding ID: 206\n",
      "Insert of existing embedding ID: 207\n",
      "Add of existing embedding ID: 207\n",
      "Insert of existing embedding ID: 208\n",
      "Add of existing embedding ID: 208\n",
      "Insert of existing embedding ID: 209\n",
      "Add of existing embedding ID: 209\n",
      "Insert of existing embedding ID: 210\n",
      "Add of existing embedding ID: 210\n",
      "Insert of existing embedding ID: 211\n",
      "Add of existing embedding ID: 211\n",
      "Insert of existing embedding ID: 212\n",
      "Add of existing embedding ID: 212\n",
      "Insert of existing embedding ID: 213\n",
      "Add of existing embedding ID: 213\n",
      "Insert of existing embedding ID: 214\n",
      "Add of existing embedding ID: 214\n",
      "Insert of existing embedding ID: 215\n",
      "Add of existing embedding ID: 215\n",
      "Insert of existing embedding ID: 216\n",
      "Add of existing embedding ID: 216\n",
      "Insert of existing embedding ID: 217\n",
      "Add of existing embedding ID: 217\n",
      "Insert of existing embedding ID: 218\n",
      "Add of existing embedding ID: 218\n",
      "Insert of existing embedding ID: 219\n",
      "Add of existing embedding ID: 219\n",
      "Insert of existing embedding ID: 220\n",
      "Add of existing embedding ID: 220\n",
      "Insert of existing embedding ID: 221\n",
      "Add of existing embedding ID: 221\n",
      "Insert of existing embedding ID: 222\n",
      "Add of existing embedding ID: 222\n",
      "Insert of existing embedding ID: 223\n",
      "Add of existing embedding ID: 223\n",
      "Insert of existing embedding ID: 224\n",
      "Add of existing embedding ID: 224\n",
      "Insert of existing embedding ID: 225\n",
      "Add of existing embedding ID: 225\n",
      "Insert of existing embedding ID: 226\n",
      "Add of existing embedding ID: 226\n",
      "Insert of existing embedding ID: 227\n",
      "Add of existing embedding ID: 227\n",
      "Insert of existing embedding ID: 228\n",
      "Add of existing embedding ID: 228\n",
      "Insert of existing embedding ID: 229\n",
      "Add of existing embedding ID: 229\n",
      "Insert of existing embedding ID: 230\n",
      "Add of existing embedding ID: 230\n",
      "Insert of existing embedding ID: 231\n",
      "Add of existing embedding ID: 231\n",
      "Insert of existing embedding ID: 232\n",
      "Add of existing embedding ID: 232\n",
      "Insert of existing embedding ID: 233\n",
      "Add of existing embedding ID: 233\n",
      "Insert of existing embedding ID: 234\n",
      "Add of existing embedding ID: 234\n",
      "Insert of existing embedding ID: 235\n",
      "Add of existing embedding ID: 235\n",
      "Insert of existing embedding ID: 236\n",
      "Add of existing embedding ID: 236\n",
      "Insert of existing embedding ID: 237\n",
      "Add of existing embedding ID: 237\n",
      "Insert of existing embedding ID: 238\n",
      "Add of existing embedding ID: 238\n",
      "Insert of existing embedding ID: 239\n",
      "Add of existing embedding ID: 239\n",
      "Insert of existing embedding ID: 240\n",
      "Add of existing embedding ID: 240\n",
      "Insert of existing embedding ID: 241\n",
      "Add of existing embedding ID: 241\n",
      "Insert of existing embedding ID: 242\n",
      "Add of existing embedding ID: 242\n",
      "Insert of existing embedding ID: 243\n",
      "Add of existing embedding ID: 243\n",
      "Insert of existing embedding ID: 244\n",
      "Add of existing embedding ID: 244\n",
      "Insert of existing embedding ID: 245\n",
      "Add of existing embedding ID: 245\n",
      "Insert of existing embedding ID: 246\n",
      "Add of existing embedding ID: 246\n",
      "Insert of existing embedding ID: 247\n",
      "Add of existing embedding ID: 247\n",
      "Insert of existing embedding ID: 248\n",
      "Add of existing embedding ID: 248\n",
      "Insert of existing embedding ID: 249\n",
      "Add of existing embedding ID: 249\n",
      "Insert of existing embedding ID: 250\n",
      "Add of existing embedding ID: 250\n",
      "Insert of existing embedding ID: 251\n",
      "Add of existing embedding ID: 251\n",
      "Insert of existing embedding ID: 252\n",
      "Add of existing embedding ID: 252\n",
      "Insert of existing embedding ID: 253\n",
      "Add of existing embedding ID: 253\n",
      "Insert of existing embedding ID: 254\n",
      "Add of existing embedding ID: 254\n",
      "Insert of existing embedding ID: 255\n",
      "Add of existing embedding ID: 255\n",
      "Insert of existing embedding ID: 256\n",
      "Add of existing embedding ID: 256\n",
      "Insert of existing embedding ID: 257\n",
      "Add of existing embedding ID: 257\n",
      "Insert of existing embedding ID: 258\n",
      "Add of existing embedding ID: 258\n",
      "Insert of existing embedding ID: 259\n",
      "Add of existing embedding ID: 259\n",
      "Insert of existing embedding ID: 260\n",
      "Add of existing embedding ID: 260\n",
      "Insert of existing embedding ID: 261\n",
      "Add of existing embedding ID: 261\n",
      "Insert of existing embedding ID: 262\n",
      "Add of existing embedding ID: 262\n",
      "Insert of existing embedding ID: 263\n",
      "Add of existing embedding ID: 263\n",
      "Insert of existing embedding ID: 264\n",
      "Add of existing embedding ID: 264\n",
      "Insert of existing embedding ID: 265\n",
      "Add of existing embedding ID: 265\n",
      "Insert of existing embedding ID: 266\n",
      "Add of existing embedding ID: 266\n",
      "Insert of existing embedding ID: 267\n",
      "Add of existing embedding ID: 267\n",
      "Insert of existing embedding ID: 268\n",
      "Add of existing embedding ID: 268\n",
      "Insert of existing embedding ID: 269\n",
      "Add of existing embedding ID: 269\n",
      "Insert of existing embedding ID: 270\n",
      "Add of existing embedding ID: 270\n",
      "Insert of existing embedding ID: 271\n",
      "Add of existing embedding ID: 271\n",
      "Insert of existing embedding ID: 272\n",
      "Add of existing embedding ID: 272\n",
      "Insert of existing embedding ID: 273\n",
      "Add of existing embedding ID: 273\n",
      "Insert of existing embedding ID: 274\n",
      "Add of existing embedding ID: 274\n",
      "Insert of existing embedding ID: 275\n",
      "Add of existing embedding ID: 275\n",
      "Insert of existing embedding ID: 276\n",
      "Add of existing embedding ID: 276\n",
      "Insert of existing embedding ID: 277\n",
      "Add of existing embedding ID: 277\n",
      "Insert of existing embedding ID: 278\n",
      "Add of existing embedding ID: 278\n",
      "Insert of existing embedding ID: 279\n",
      "Add of existing embedding ID: 279\n",
      "Insert of existing embedding ID: 280\n",
      "Add of existing embedding ID: 280\n",
      "Insert of existing embedding ID: 281\n",
      "Add of existing embedding ID: 281\n",
      "Insert of existing embedding ID: 282\n",
      "Add of existing embedding ID: 282\n",
      "Insert of existing embedding ID: 283\n",
      "Add of existing embedding ID: 283\n",
      "Insert of existing embedding ID: 284\n",
      "Add of existing embedding ID: 284\n",
      "Insert of existing embedding ID: 285\n",
      "Add of existing embedding ID: 285\n",
      "Insert of existing embedding ID: 286\n",
      "Add of existing embedding ID: 286\n",
      "Insert of existing embedding ID: 287\n",
      "Add of existing embedding ID: 287\n",
      "Insert of existing embedding ID: 288\n",
      "Add of existing embedding ID: 288\n",
      "Insert of existing embedding ID: 289\n",
      "Add of existing embedding ID: 289\n",
      "Insert of existing embedding ID: 290\n",
      "Add of existing embedding ID: 290\n",
      "Insert of existing embedding ID: 291\n",
      "Add of existing embedding ID: 291\n",
      "Insert of existing embedding ID: 292\n",
      "Add of existing embedding ID: 292\n",
      "Insert of existing embedding ID: 293\n",
      "Add of existing embedding ID: 293\n",
      "Insert of existing embedding ID: 294\n",
      "Add of existing embedding ID: 294\n",
      "Insert of existing embedding ID: 295\n",
      "Add of existing embedding ID: 295\n",
      "Insert of existing embedding ID: 296\n",
      "Add of existing embedding ID: 296\n",
      "Insert of existing embedding ID: 297\n",
      "Add of existing embedding ID: 297\n",
      "Insert of existing embedding ID: 298\n",
      "Add of existing embedding ID: 298\n",
      "Insert of existing embedding ID: 299\n",
      "Add of existing embedding ID: 299\n",
      "Insert of existing embedding ID: 300\n",
      "Add of existing embedding ID: 300\n",
      "Insert of existing embedding ID: 301\n",
      "Add of existing embedding ID: 301\n",
      "Insert of existing embedding ID: 302\n",
      "Add of existing embedding ID: 302\n",
      "Insert of existing embedding ID: 303\n",
      "Add of existing embedding ID: 303\n",
      "Insert of existing embedding ID: 304\n",
      "Add of existing embedding ID: 304\n",
      "Insert of existing embedding ID: 305\n",
      "Add of existing embedding ID: 305\n",
      "Insert of existing embedding ID: 306\n",
      "Add of existing embedding ID: 306\n",
      "Insert of existing embedding ID: 307\n",
      "Add of existing embedding ID: 307\n",
      "Insert of existing embedding ID: 308\n",
      "Add of existing embedding ID: 308\n",
      "Insert of existing embedding ID: 309\n",
      "Add of existing embedding ID: 309\n",
      "Insert of existing embedding ID: 310\n",
      "Add of existing embedding ID: 310\n",
      "Insert of existing embedding ID: 311\n",
      "Add of existing embedding ID: 311\n",
      "Insert of existing embedding ID: 312\n",
      "Add of existing embedding ID: 312\n",
      "Insert of existing embedding ID: 313\n",
      "Add of existing embedding ID: 313\n",
      "Insert of existing embedding ID: 314\n",
      "Add of existing embedding ID: 314\n",
      "Insert of existing embedding ID: 315\n",
      "Add of existing embedding ID: 315\n",
      "Insert of existing embedding ID: 316\n",
      "Add of existing embedding ID: 316\n",
      "Insert of existing embedding ID: 317\n",
      "Add of existing embedding ID: 317\n",
      "Insert of existing embedding ID: 318\n",
      "Add of existing embedding ID: 318\n",
      "Insert of existing embedding ID: 319\n",
      "Add of existing embedding ID: 319\n",
      "Insert of existing embedding ID: 320\n",
      "Add of existing embedding ID: 320\n",
      "Insert of existing embedding ID: 321\n",
      "Add of existing embedding ID: 321\n",
      "Insert of existing embedding ID: 322\n",
      "Add of existing embedding ID: 322\n",
      "Insert of existing embedding ID: 323\n",
      "Add of existing embedding ID: 323\n",
      "Insert of existing embedding ID: 324\n",
      "Add of existing embedding ID: 324\n",
      "Insert of existing embedding ID: 325\n",
      "Add of existing embedding ID: 325\n",
      "Insert of existing embedding ID: 326\n",
      "Add of existing embedding ID: 326\n",
      "Insert of existing embedding ID: 327\n",
      "Add of existing embedding ID: 327\n",
      "Insert of existing embedding ID: 328\n",
      "Add of existing embedding ID: 328\n",
      "Insert of existing embedding ID: 329\n",
      "Add of existing embedding ID: 329\n",
      "Insert of existing embedding ID: 330\n",
      "Add of existing embedding ID: 330\n",
      "Insert of existing embedding ID: 331\n",
      "Add of existing embedding ID: 331\n",
      "Insert of existing embedding ID: 332\n",
      "Add of existing embedding ID: 332\n",
      "Insert of existing embedding ID: 333\n",
      "Add of existing embedding ID: 333\n",
      "Insert of existing embedding ID: 334\n",
      "Add of existing embedding ID: 334\n",
      "Insert of existing embedding ID: 335\n",
      "Add of existing embedding ID: 335\n",
      "Insert of existing embedding ID: 336\n",
      "Add of existing embedding ID: 336\n",
      "Insert of existing embedding ID: 337\n",
      "Add of existing embedding ID: 337\n",
      "Insert of existing embedding ID: 338\n",
      "Add of existing embedding ID: 338\n",
      "Insert of existing embedding ID: 339\n",
      "Add of existing embedding ID: 339\n",
      "Insert of existing embedding ID: 340\n",
      "Add of existing embedding ID: 340\n",
      "Insert of existing embedding ID: 341\n",
      "Add of existing embedding ID: 341\n",
      "Insert of existing embedding ID: 342\n",
      "Add of existing embedding ID: 342\n",
      "Insert of existing embedding ID: 343\n",
      "Add of existing embedding ID: 343\n",
      "Insert of existing embedding ID: 344\n",
      "Add of existing embedding ID: 344\n",
      "Insert of existing embedding ID: 345\n",
      "Add of existing embedding ID: 345\n",
      "Insert of existing embedding ID: 346\n",
      "Add of existing embedding ID: 346\n",
      "Insert of existing embedding ID: 347\n",
      "Add of existing embedding ID: 347\n",
      "Insert of existing embedding ID: 348\n",
      "Add of existing embedding ID: 348\n",
      "Insert of existing embedding ID: 349\n",
      "Add of existing embedding ID: 349\n",
      "Insert of existing embedding ID: 350\n",
      "Add of existing embedding ID: 350\n",
      "Insert of existing embedding ID: 351\n",
      "Add of existing embedding ID: 351\n",
      "Insert of existing embedding ID: 352\n",
      "Add of existing embedding ID: 352\n",
      "Insert of existing embedding ID: 353\n",
      "Add of existing embedding ID: 353\n",
      "Insert of existing embedding ID: 354\n",
      "Add of existing embedding ID: 354\n",
      "Insert of existing embedding ID: 355\n",
      "Add of existing embedding ID: 355\n",
      "Insert of existing embedding ID: 356\n",
      "Add of existing embedding ID: 356\n",
      "Insert of existing embedding ID: 357\n",
      "Add of existing embedding ID: 357\n",
      "Insert of existing embedding ID: 358\n",
      "Add of existing embedding ID: 358\n",
      "Insert of existing embedding ID: 359\n",
      "Add of existing embedding ID: 359\n",
      "Insert of existing embedding ID: 360\n",
      "Add of existing embedding ID: 360\n",
      "Insert of existing embedding ID: 361\n",
      "Add of existing embedding ID: 361\n",
      "Insert of existing embedding ID: 362\n",
      "Add of existing embedding ID: 362\n",
      "Insert of existing embedding ID: 363\n",
      "Add of existing embedding ID: 363\n",
      "Insert of existing embedding ID: 364\n",
      "Add of existing embedding ID: 364\n",
      "Insert of existing embedding ID: 365\n",
      "Add of existing embedding ID: 365\n",
      "Insert of existing embedding ID: 366\n",
      "Add of existing embedding ID: 366\n",
      "Insert of existing embedding ID: 367\n",
      "Add of existing embedding ID: 367\n",
      "Insert of existing embedding ID: 368\n",
      "Add of existing embedding ID: 368\n",
      "Insert of existing embedding ID: 369\n",
      "Add of existing embedding ID: 369\n",
      "Insert of existing embedding ID: 370\n",
      "Add of existing embedding ID: 370\n",
      "Insert of existing embedding ID: 371\n",
      "Add of existing embedding ID: 371\n",
      "Insert of existing embedding ID: 372\n",
      "Add of existing embedding ID: 372\n",
      "Insert of existing embedding ID: 373\n",
      "Add of existing embedding ID: 373\n",
      "Insert of existing embedding ID: 374\n",
      "Add of existing embedding ID: 374\n",
      "Insert of existing embedding ID: 375\n",
      "Add of existing embedding ID: 375\n",
      "Insert of existing embedding ID: 376\n",
      "Add of existing embedding ID: 376\n",
      "Insert of existing embedding ID: 377\n",
      "Add of existing embedding ID: 377\n",
      "Insert of existing embedding ID: 378\n",
      "Add of existing embedding ID: 378\n",
      "Insert of existing embedding ID: 379\n",
      "Add of existing embedding ID: 379\n",
      "Insert of existing embedding ID: 380\n",
      "Add of existing embedding ID: 380\n",
      "Insert of existing embedding ID: 381\n",
      "Add of existing embedding ID: 381\n",
      "Insert of existing embedding ID: 382\n",
      "Add of existing embedding ID: 382\n",
      "Insert of existing embedding ID: 383\n",
      "Add of existing embedding ID: 383\n",
      "Insert of existing embedding ID: 384\n",
      "Add of existing embedding ID: 384\n",
      "Insert of existing embedding ID: 385\n",
      "Add of existing embedding ID: 385\n",
      "Insert of existing embedding ID: 386\n",
      "Add of existing embedding ID: 386\n",
      "Insert of existing embedding ID: 387\n",
      "Add of existing embedding ID: 387\n",
      "Insert of existing embedding ID: 388\n",
      "Add of existing embedding ID: 388\n",
      "Insert of existing embedding ID: 389\n",
      "Add of existing embedding ID: 389\n",
      "Insert of existing embedding ID: 390\n",
      "Add of existing embedding ID: 390\n",
      "Insert of existing embedding ID: 391\n",
      "Add of existing embedding ID: 391\n",
      "Insert of existing embedding ID: 392\n",
      "Add of existing embedding ID: 392\n",
      "Insert of existing embedding ID: 393\n",
      "Add of existing embedding ID: 393\n",
      "Insert of existing embedding ID: 394\n",
      "Add of existing embedding ID: 394\n",
      "Insert of existing embedding ID: 395\n",
      "Add of existing embedding ID: 395\n",
      "Insert of existing embedding ID: 396\n",
      "Add of existing embedding ID: 396\n",
      "Insert of existing embedding ID: 397\n",
      "Add of existing embedding ID: 397\n",
      "Insert of existing embedding ID: 398\n",
      "Add of existing embedding ID: 398\n",
      "Insert of existing embedding ID: 399\n",
      "Add of existing embedding ID: 399\n",
      "Insert of existing embedding ID: 400\n",
      "Add of existing embedding ID: 400\n",
      "Insert of existing embedding ID: 401\n",
      "Add of existing embedding ID: 401\n",
      "Insert of existing embedding ID: 402\n",
      "Add of existing embedding ID: 402\n",
      "Insert of existing embedding ID: 403\n",
      "Add of existing embedding ID: 403\n",
      "Insert of existing embedding ID: 404\n",
      "Add of existing embedding ID: 404\n",
      "Insert of existing embedding ID: 405\n",
      "Add of existing embedding ID: 405\n",
      "Insert of existing embedding ID: 406\n",
      "Add of existing embedding ID: 406\n",
      "Insert of existing embedding ID: 407\n",
      "Add of existing embedding ID: 407\n",
      "Insert of existing embedding ID: 408\n",
      "Add of existing embedding ID: 408\n",
      "Insert of existing embedding ID: 409\n",
      "Add of existing embedding ID: 409\n",
      "Insert of existing embedding ID: 410\n",
      "Add of existing embedding ID: 410\n",
      "Insert of existing embedding ID: 411\n",
      "Add of existing embedding ID: 411\n",
      "Insert of existing embedding ID: 412\n",
      "Add of existing embedding ID: 412\n",
      "Insert of existing embedding ID: 413\n",
      "Add of existing embedding ID: 413\n",
      "Insert of existing embedding ID: 414\n",
      "Add of existing embedding ID: 414\n",
      "Insert of existing embedding ID: 415\n",
      "Add of existing embedding ID: 415\n",
      "Insert of existing embedding ID: 416\n",
      "Add of existing embedding ID: 416\n",
      "Insert of existing embedding ID: 417\n",
      "Add of existing embedding ID: 417\n",
      "Insert of existing embedding ID: 418\n",
      "Add of existing embedding ID: 418\n",
      "Insert of existing embedding ID: 419\n",
      "Add of existing embedding ID: 419\n",
      "Insert of existing embedding ID: 420\n",
      "Add of existing embedding ID: 420\n",
      "Insert of existing embedding ID: 421\n",
      "Add of existing embedding ID: 421\n",
      "Insert of existing embedding ID: 422\n",
      "Add of existing embedding ID: 422\n",
      "Insert of existing embedding ID: 423\n",
      "Add of existing embedding ID: 423\n",
      "Insert of existing embedding ID: 424\n",
      "Add of existing embedding ID: 424\n",
      "Insert of existing embedding ID: 425\n",
      "Add of existing embedding ID: 425\n",
      "Insert of existing embedding ID: 426\n",
      "Add of existing embedding ID: 426\n",
      "Insert of existing embedding ID: 427\n",
      "Add of existing embedding ID: 427\n",
      "Insert of existing embedding ID: 428\n",
      "Add of existing embedding ID: 428\n",
      "Insert of existing embedding ID: 429\n",
      "Add of existing embedding ID: 429\n",
      "Insert of existing embedding ID: 430\n",
      "Add of existing embedding ID: 430\n",
      "Insert of existing embedding ID: 431\n",
      "Add of existing embedding ID: 431\n",
      "Insert of existing embedding ID: 432\n",
      "Add of existing embedding ID: 432\n",
      "Insert of existing embedding ID: 433\n",
      "Add of existing embedding ID: 433\n",
      "Insert of existing embedding ID: 434\n",
      "Add of existing embedding ID: 434\n",
      "Insert of existing embedding ID: 435\n",
      "Add of existing embedding ID: 435\n",
      "Insert of existing embedding ID: 436\n",
      "Add of existing embedding ID: 436\n",
      "Insert of existing embedding ID: 437\n",
      "Add of existing embedding ID: 437\n",
      "Insert of existing embedding ID: 438\n",
      "Add of existing embedding ID: 438\n",
      "Insert of existing embedding ID: 439\n",
      "Add of existing embedding ID: 439\n",
      "Insert of existing embedding ID: 440\n",
      "Add of existing embedding ID: 440\n",
      "Insert of existing embedding ID: 441\n",
      "Add of existing embedding ID: 441\n",
      "Insert of existing embedding ID: 442\n",
      "Add of existing embedding ID: 442\n",
      "Insert of existing embedding ID: 443\n",
      "Add of existing embedding ID: 443\n",
      "Insert of existing embedding ID: 444\n",
      "Add of existing embedding ID: 444\n",
      "Insert of existing embedding ID: 445\n",
      "Add of existing embedding ID: 445\n",
      "Insert of existing embedding ID: 446\n",
      "Add of existing embedding ID: 446\n",
      "Insert of existing embedding ID: 447\n",
      "Add of existing embedding ID: 447\n",
      "Insert of existing embedding ID: 448\n",
      "Add of existing embedding ID: 448\n",
      "Insert of existing embedding ID: 449\n",
      "Add of existing embedding ID: 449\n",
      "Insert of existing embedding ID: 450\n",
      "Add of existing embedding ID: 450\n",
      "Insert of existing embedding ID: 451\n",
      "Add of existing embedding ID: 451\n",
      "Insert of existing embedding ID: 452\n",
      "Add of existing embedding ID: 452\n",
      "Insert of existing embedding ID: 453\n",
      "Add of existing embedding ID: 453\n",
      "Insert of existing embedding ID: 454\n",
      "Add of existing embedding ID: 454\n",
      "Insert of existing embedding ID: 455\n",
      "Add of existing embedding ID: 455\n",
      "Insert of existing embedding ID: 456\n",
      "Add of existing embedding ID: 456\n",
      "Insert of existing embedding ID: 457\n",
      "Add of existing embedding ID: 457\n",
      "Insert of existing embedding ID: 458\n",
      "Add of existing embedding ID: 458\n",
      "Insert of existing embedding ID: 459\n",
      "Add of existing embedding ID: 459\n",
      "Insert of existing embedding ID: 460\n",
      "Add of existing embedding ID: 460\n",
      "Insert of existing embedding ID: 461\n",
      "Add of existing embedding ID: 461\n",
      "Insert of existing embedding ID: 462\n",
      "Add of existing embedding ID: 462\n",
      "Insert of existing embedding ID: 463\n",
      "Add of existing embedding ID: 463\n",
      "Insert of existing embedding ID: 464\n",
      "Add of existing embedding ID: 464\n",
      "Insert of existing embedding ID: 465\n",
      "Add of existing embedding ID: 465\n",
      "Insert of existing embedding ID: 466\n",
      "Add of existing embedding ID: 466\n",
      "Insert of existing embedding ID: 467\n",
      "Add of existing embedding ID: 467\n",
      "Insert of existing embedding ID: 468\n",
      "Add of existing embedding ID: 468\n",
      "Insert of existing embedding ID: 469\n",
      "Add of existing embedding ID: 469\n",
      "Insert of existing embedding ID: 470\n",
      "Add of existing embedding ID: 470\n",
      "Insert of existing embedding ID: 471\n",
      "Add of existing embedding ID: 471\n",
      "Insert of existing embedding ID: 472\n",
      "Add of existing embedding ID: 472\n",
      "Insert of existing embedding ID: 473\n",
      "Add of existing embedding ID: 473\n",
      "Insert of existing embedding ID: 474\n",
      "Add of existing embedding ID: 474\n",
      "Insert of existing embedding ID: 475\n",
      "Add of existing embedding ID: 475\n",
      "Insert of existing embedding ID: 476\n",
      "Add of existing embedding ID: 476\n",
      "Insert of existing embedding ID: 477\n",
      "Add of existing embedding ID: 477\n",
      "Insert of existing embedding ID: 478\n",
      "Add of existing embedding ID: 478\n",
      "Insert of existing embedding ID: 479\n",
      "Add of existing embedding ID: 479\n",
      "Insert of existing embedding ID: 480\n",
      "Add of existing embedding ID: 480\n",
      "Insert of existing embedding ID: 481\n",
      "Add of existing embedding ID: 481\n",
      "Insert of existing embedding ID: 482\n",
      "Add of existing embedding ID: 482\n",
      "Insert of existing embedding ID: 483\n",
      "Add of existing embedding ID: 483\n",
      "Insert of existing embedding ID: 484\n",
      "Add of existing embedding ID: 484\n",
      "Insert of existing embedding ID: 485\n",
      "Add of existing embedding ID: 485\n",
      "Insert of existing embedding ID: 486\n",
      "Add of existing embedding ID: 486\n",
      "Insert of existing embedding ID: 487\n",
      "Add of existing embedding ID: 487\n",
      "Insert of existing embedding ID: 488\n",
      "Add of existing embedding ID: 488\n",
      "Insert of existing embedding ID: 489\n",
      "Add of existing embedding ID: 489\n",
      "Insert of existing embedding ID: 490\n",
      "Add of existing embedding ID: 490\n",
      "Insert of existing embedding ID: 491\n",
      "Add of existing embedding ID: 491\n",
      "Insert of existing embedding ID: 492\n",
      "Add of existing embedding ID: 492\n",
      "Insert of existing embedding ID: 493\n",
      "Add of existing embedding ID: 493\n",
      "Insert of existing embedding ID: 494\n",
      "Add of existing embedding ID: 494\n",
      "Insert of existing embedding ID: 495\n",
      "Add of existing embedding ID: 495\n",
      "Insert of existing embedding ID: 496\n",
      "Add of existing embedding ID: 496\n",
      "Insert of existing embedding ID: 497\n",
      "Add of existing embedding ID: 497\n",
      "Insert of existing embedding ID: 498\n",
      "Add of existing embedding ID: 498\n",
      "Insert of existing embedding ID: 499\n",
      "Add of existing embedding ID: 499\n",
      "Insert of existing embedding ID: 500\n",
      "Add of existing embedding ID: 500\n",
      "Insert of existing embedding ID: 501\n",
      "Add of existing embedding ID: 501\n",
      "Insert of existing embedding ID: 502\n",
      "Add of existing embedding ID: 502\n",
      "Insert of existing embedding ID: 503\n",
      "Add of existing embedding ID: 503\n",
      "Insert of existing embedding ID: 504\n",
      "Add of existing embedding ID: 504\n",
      "Insert of existing embedding ID: 505\n",
      "Add of existing embedding ID: 505\n",
      "Insert of existing embedding ID: 506\n",
      "Add of existing embedding ID: 506\n",
      "Insert of existing embedding ID: 507\n",
      "Add of existing embedding ID: 507\n",
      "Insert of existing embedding ID: 508\n",
      "Add of existing embedding ID: 508\n",
      "Insert of existing embedding ID: 509\n",
      "Add of existing embedding ID: 509\n",
      "Insert of existing embedding ID: 510\n",
      "Add of existing embedding ID: 510\n",
      "Insert of existing embedding ID: 511\n",
      "Add of existing embedding ID: 511\n",
      "Insert of existing embedding ID: 512\n",
      "Add of existing embedding ID: 512\n",
      "Insert of existing embedding ID: 513\n",
      "Add of existing embedding ID: 513\n",
      "Insert of existing embedding ID: 514\n",
      "Add of existing embedding ID: 514\n",
      "Insert of existing embedding ID: 515\n",
      "Add of existing embedding ID: 515\n",
      "Insert of existing embedding ID: 516\n",
      "Add of existing embedding ID: 516\n",
      "Insert of existing embedding ID: 517\n",
      "Add of existing embedding ID: 517\n",
      "Insert of existing embedding ID: 518\n",
      "Add of existing embedding ID: 518\n",
      "Insert of existing embedding ID: 519\n",
      "Add of existing embedding ID: 519\n",
      "Insert of existing embedding ID: 520\n",
      "Add of existing embedding ID: 520\n",
      "Insert of existing embedding ID: 521\n",
      "Add of existing embedding ID: 521\n",
      "Insert of existing embedding ID: 522\n",
      "Add of existing embedding ID: 522\n",
      "Insert of existing embedding ID: 523\n",
      "Add of existing embedding ID: 523\n",
      "Insert of existing embedding ID: 524\n",
      "Add of existing embedding ID: 524\n",
      "Insert of existing embedding ID: 525\n",
      "Add of existing embedding ID: 525\n",
      "Insert of existing embedding ID: 526\n",
      "Add of existing embedding ID: 526\n",
      "Insert of existing embedding ID: 527\n",
      "Add of existing embedding ID: 527\n",
      "Insert of existing embedding ID: 528\n",
      "Add of existing embedding ID: 528\n",
      "Insert of existing embedding ID: 529\n",
      "Add of existing embedding ID: 529\n",
      "Insert of existing embedding ID: 530\n",
      "Add of existing embedding ID: 530\n",
      "Insert of existing embedding ID: 531\n",
      "Add of existing embedding ID: 531\n",
      "Insert of existing embedding ID: 532\n",
      "Add of existing embedding ID: 532\n",
      "Insert of existing embedding ID: 533\n",
      "Add of existing embedding ID: 533\n",
      "Insert of existing embedding ID: 534\n",
      "Add of existing embedding ID: 534\n",
      "Insert of existing embedding ID: 535\n",
      "Add of existing embedding ID: 535\n",
      "Insert of existing embedding ID: 536\n",
      "Add of existing embedding ID: 536\n",
      "Insert of existing embedding ID: 537\n",
      "Add of existing embedding ID: 537\n",
      "Insert of existing embedding ID: 538\n",
      "Add of existing embedding ID: 538\n",
      "Insert of existing embedding ID: 539\n",
      "Add of existing embedding ID: 539\n",
      "Insert of existing embedding ID: 540\n",
      "Add of existing embedding ID: 540\n",
      "Insert of existing embedding ID: 541\n",
      "Add of existing embedding ID: 541\n",
      "Insert of existing embedding ID: 542\n",
      "Add of existing embedding ID: 542\n",
      "Insert of existing embedding ID: 543\n",
      "Add of existing embedding ID: 543\n",
      "Insert of existing embedding ID: 544\n",
      "Add of existing embedding ID: 544\n",
      "Insert of existing embedding ID: 545\n",
      "Add of existing embedding ID: 545\n",
      "Insert of existing embedding ID: 546\n",
      "Add of existing embedding ID: 546\n",
      "Insert of existing embedding ID: 547\n",
      "Add of existing embedding ID: 547\n",
      "Insert of existing embedding ID: 548\n",
      "Add of existing embedding ID: 548\n",
      "Insert of existing embedding ID: 549\n",
      "Add of existing embedding ID: 549\n",
      "Insert of existing embedding ID: 550\n",
      "Add of existing embedding ID: 550\n",
      "Insert of existing embedding ID: 551\n",
      "Add of existing embedding ID: 551\n",
      "Insert of existing embedding ID: 552\n",
      "Add of existing embedding ID: 552\n",
      "Insert of existing embedding ID: 553\n",
      "Add of existing embedding ID: 553\n",
      "Insert of existing embedding ID: 554\n",
      "Add of existing embedding ID: 554\n",
      "Insert of existing embedding ID: 555\n",
      "Add of existing embedding ID: 555\n",
      "Insert of existing embedding ID: 556\n",
      "Add of existing embedding ID: 556\n",
      "Insert of existing embedding ID: 557\n",
      "Add of existing embedding ID: 557\n",
      "Insert of existing embedding ID: 558\n",
      "Add of existing embedding ID: 558\n",
      "Insert of existing embedding ID: 559\n",
      "Add of existing embedding ID: 559\n",
      "Insert of existing embedding ID: 560\n",
      "Add of existing embedding ID: 560\n",
      "Insert of existing embedding ID: 561\n",
      "Add of existing embedding ID: 561\n",
      "Insert of existing embedding ID: 562\n",
      "Add of existing embedding ID: 562\n",
      "Insert of existing embedding ID: 563\n",
      "Add of existing embedding ID: 563\n",
      "Insert of existing embedding ID: 564\n",
      "Add of existing embedding ID: 564\n",
      "Insert of existing embedding ID: 565\n",
      "Add of existing embedding ID: 565\n",
      "Insert of existing embedding ID: 566\n",
      "Add of existing embedding ID: 566\n",
      "Insert of existing embedding ID: 567\n",
      "Add of existing embedding ID: 567\n",
      "Insert of existing embedding ID: 568\n",
      "Add of existing embedding ID: 568\n",
      "Insert of existing embedding ID: 569\n",
      "Add of existing embedding ID: 569\n",
      "Insert of existing embedding ID: 570\n",
      "Add of existing embedding ID: 570\n",
      "Insert of existing embedding ID: 571\n",
      "Add of existing embedding ID: 571\n",
      "Insert of existing embedding ID: 572\n",
      "Add of existing embedding ID: 572\n",
      "Insert of existing embedding ID: 573\n",
      "Add of existing embedding ID: 573\n",
      "Insert of existing embedding ID: 574\n",
      "Add of existing embedding ID: 574\n",
      "Insert of existing embedding ID: 575\n",
      "Add of existing embedding ID: 575\n",
      "Insert of existing embedding ID: 576\n",
      "Add of existing embedding ID: 576\n",
      "Insert of existing embedding ID: 577\n",
      "Add of existing embedding ID: 577\n",
      "Insert of existing embedding ID: 578\n",
      "Add of existing embedding ID: 578\n",
      "Insert of existing embedding ID: 579\n",
      "Add of existing embedding ID: 579\n",
      "Insert of existing embedding ID: 580\n",
      "Add of existing embedding ID: 580\n",
      "Insert of existing embedding ID: 581\n",
      "Add of existing embedding ID: 581\n",
      "Insert of existing embedding ID: 582\n",
      "Add of existing embedding ID: 582\n",
      "Insert of existing embedding ID: 583\n",
      "Add of existing embedding ID: 583\n",
      "Insert of existing embedding ID: 584\n",
      "Add of existing embedding ID: 584\n",
      "Insert of existing embedding ID: 585\n",
      "Add of existing embedding ID: 585\n",
      "Insert of existing embedding ID: 586\n",
      "Add of existing embedding ID: 586\n",
      "Insert of existing embedding ID: 587\n",
      "Add of existing embedding ID: 587\n",
      "Insert of existing embedding ID: 588\n",
      "Add of existing embedding ID: 588\n",
      "Insert of existing embedding ID: 589\n",
      "Add of existing embedding ID: 589\n",
      "Insert of existing embedding ID: 590\n",
      "Add of existing embedding ID: 590\n",
      "Insert of existing embedding ID: 591\n",
      "Add of existing embedding ID: 591\n",
      "Insert of existing embedding ID: 592\n",
      "Add of existing embedding ID: 592\n",
      "Insert of existing embedding ID: 593\n",
      "Add of existing embedding ID: 593\n",
      "Insert of existing embedding ID: 594\n",
      "Add of existing embedding ID: 594\n",
      "Insert of existing embedding ID: 595\n",
      "Add of existing embedding ID: 595\n",
      "Insert of existing embedding ID: 596\n",
      "Add of existing embedding ID: 596\n",
      "Insert of existing embedding ID: 597\n",
      "Add of existing embedding ID: 597\n",
      "Insert of existing embedding ID: 598\n",
      "Add of existing embedding ID: 598\n",
      "Insert of existing embedding ID: 599\n",
      "Add of existing embedding ID: 599\n",
      "Insert of existing embedding ID: 600\n",
      "Add of existing embedding ID: 600\n",
      "Insert of existing embedding ID: 601\n",
      "Add of existing embedding ID: 601\n",
      "Insert of existing embedding ID: 602\n",
      "Add of existing embedding ID: 602\n",
      "Insert of existing embedding ID: 603\n",
      "Add of existing embedding ID: 603\n",
      "Insert of existing embedding ID: 604\n",
      "Add of existing embedding ID: 604\n",
      "Insert of existing embedding ID: 605\n",
      "Add of existing embedding ID: 605\n",
      "Insert of existing embedding ID: 606\n",
      "Add of existing embedding ID: 606\n",
      "Insert of existing embedding ID: 607\n",
      "Add of existing embedding ID: 607\n",
      "Insert of existing embedding ID: 608\n",
      "Add of existing embedding ID: 608\n",
      "Insert of existing embedding ID: 609\n",
      "Add of existing embedding ID: 609\n",
      "Insert of existing embedding ID: 610\n",
      "Add of existing embedding ID: 610\n",
      "Insert of existing embedding ID: 611\n",
      "Add of existing embedding ID: 611\n",
      "Insert of existing embedding ID: 612\n",
      "Add of existing embedding ID: 612\n",
      "Insert of existing embedding ID: 613\n",
      "Add of existing embedding ID: 613\n",
      "Insert of existing embedding ID: 614\n",
      "Add of existing embedding ID: 614\n",
      "Insert of existing embedding ID: 615\n",
      "Add of existing embedding ID: 615\n",
      "Insert of existing embedding ID: 616\n",
      "Add of existing embedding ID: 616\n",
      "Insert of existing embedding ID: 617\n",
      "Add of existing embedding ID: 617\n",
      "Insert of existing embedding ID: 618\n",
      "Add of existing embedding ID: 618\n",
      "Insert of existing embedding ID: 619\n",
      "Add of existing embedding ID: 619\n",
      "Insert of existing embedding ID: 620\n",
      "Add of existing embedding ID: 620\n",
      "Insert of existing embedding ID: 621\n",
      "Add of existing embedding ID: 621\n",
      "Insert of existing embedding ID: 622\n",
      "Add of existing embedding ID: 622\n",
      "Insert of existing embedding ID: 623\n",
      "Add of existing embedding ID: 623\n",
      "Insert of existing embedding ID: 624\n",
      "Add of existing embedding ID: 624\n",
      "Insert of existing embedding ID: 625\n",
      "Add of existing embedding ID: 625\n",
      "Insert of existing embedding ID: 626\n",
      "Add of existing embedding ID: 626\n",
      "Insert of existing embedding ID: 627\n",
      "Add of existing embedding ID: 627\n",
      "Insert of existing embedding ID: 628\n",
      "Add of existing embedding ID: 628\n",
      "Insert of existing embedding ID: 629\n",
      "Add of existing embedding ID: 629\n",
      "Insert of existing embedding ID: 630\n",
      "Add of existing embedding ID: 630\n",
      "Insert of existing embedding ID: 631\n",
      "Add of existing embedding ID: 631\n",
      "Insert of existing embedding ID: 632\n",
      "Add of existing embedding ID: 632\n",
      "Insert of existing embedding ID: 633\n",
      "Add of existing embedding ID: 633\n",
      "Insert of existing embedding ID: 634\n",
      "Add of existing embedding ID: 634\n",
      "Insert of existing embedding ID: 635\n",
      "Add of existing embedding ID: 635\n",
      "Insert of existing embedding ID: 636\n",
      "Add of existing embedding ID: 636\n",
      "Insert of existing embedding ID: 637\n",
      "Add of existing embedding ID: 637\n",
      "Insert of existing embedding ID: 638\n",
      "Add of existing embedding ID: 638\n",
      "Insert of existing embedding ID: 639\n",
      "Add of existing embedding ID: 639\n",
      "Insert of existing embedding ID: 640\n",
      "Add of existing embedding ID: 640\n",
      "Insert of existing embedding ID: 641\n",
      "Add of existing embedding ID: 641\n",
      "Insert of existing embedding ID: 642\n",
      "Add of existing embedding ID: 642\n",
      "Insert of existing embedding ID: 643\n",
      "Add of existing embedding ID: 643\n",
      "Insert of existing embedding ID: 644\n",
      "Add of existing embedding ID: 644\n",
      "Insert of existing embedding ID: 645\n",
      "Add of existing embedding ID: 645\n",
      "Insert of existing embedding ID: 646\n",
      "Add of existing embedding ID: 646\n",
      "Insert of existing embedding ID: 647\n",
      "Add of existing embedding ID: 647\n",
      "Insert of existing embedding ID: 648\n",
      "Add of existing embedding ID: 648\n",
      "Insert of existing embedding ID: 649\n",
      "Add of existing embedding ID: 649\n",
      "Insert of existing embedding ID: 650\n",
      "Add of existing embedding ID: 650\n",
      "Insert of existing embedding ID: 651\n",
      "Add of existing embedding ID: 651\n",
      "Insert of existing embedding ID: 652\n",
      "Add of existing embedding ID: 652\n",
      "Insert of existing embedding ID: 653\n",
      "Add of existing embedding ID: 653\n",
      "Insert of existing embedding ID: 654\n",
      "Add of existing embedding ID: 654\n",
      "Insert of existing embedding ID: 655\n",
      "Add of existing embedding ID: 655\n",
      "Insert of existing embedding ID: 656\n",
      "Add of existing embedding ID: 656\n",
      "Insert of existing embedding ID: 657\n",
      "Add of existing embedding ID: 657\n",
      "Insert of existing embedding ID: 658\n",
      "Add of existing embedding ID: 658\n",
      "Insert of existing embedding ID: 659\n",
      "Add of existing embedding ID: 659\n",
      "Insert of existing embedding ID: 660\n",
      "Add of existing embedding ID: 660\n",
      "Insert of existing embedding ID: 661\n",
      "Add of existing embedding ID: 661\n",
      "Insert of existing embedding ID: 662\n",
      "Add of existing embedding ID: 662\n",
      "Insert of existing embedding ID: 663\n",
      "Add of existing embedding ID: 663\n",
      "Insert of existing embedding ID: 664\n",
      "Add of existing embedding ID: 664\n",
      "Insert of existing embedding ID: 665\n",
      "Add of existing embedding ID: 665\n",
      "Insert of existing embedding ID: 666\n",
      "Add of existing embedding ID: 666\n",
      "Insert of existing embedding ID: 667\n",
      "Add of existing embedding ID: 667\n",
      "Insert of existing embedding ID: 668\n",
      "Add of existing embedding ID: 668\n",
      "Insert of existing embedding ID: 669\n",
      "Add of existing embedding ID: 669\n",
      "Insert of existing embedding ID: 670\n",
      "Add of existing embedding ID: 670\n",
      "Insert of existing embedding ID: 671\n",
      "Add of existing embedding ID: 671\n",
      "Insert of existing embedding ID: 672\n",
      "Add of existing embedding ID: 672\n",
      "Insert of existing embedding ID: 673\n",
      "Add of existing embedding ID: 673\n",
      "Insert of existing embedding ID: 674\n",
      "Add of existing embedding ID: 674\n",
      "Insert of existing embedding ID: 675\n",
      "Add of existing embedding ID: 675\n",
      "Insert of existing embedding ID: 676\n",
      "Add of existing embedding ID: 676\n",
      "Insert of existing embedding ID: 677\n",
      "Add of existing embedding ID: 677\n",
      "Insert of existing embedding ID: 678\n",
      "Add of existing embedding ID: 678\n",
      "Insert of existing embedding ID: 679\n",
      "Add of existing embedding ID: 679\n",
      "Insert of existing embedding ID: 680\n",
      "Add of existing embedding ID: 680\n",
      "Insert of existing embedding ID: 681\n",
      "Add of existing embedding ID: 681\n",
      "Insert of existing embedding ID: 682\n",
      "Add of existing embedding ID: 682\n",
      "Insert of existing embedding ID: 683\n",
      "Add of existing embedding ID: 683\n",
      "Insert of existing embedding ID: 684\n",
      "Add of existing embedding ID: 684\n",
      "Insert of existing embedding ID: 685\n",
      "Add of existing embedding ID: 685\n",
      "Insert of existing embedding ID: 686\n",
      "Add of existing embedding ID: 686\n",
      "Insert of existing embedding ID: 687\n",
      "Add of existing embedding ID: 687\n",
      "Insert of existing embedding ID: 688\n",
      "Add of existing embedding ID: 688\n",
      "Insert of existing embedding ID: 689\n",
      "Add of existing embedding ID: 689\n",
      "Insert of existing embedding ID: 690\n",
      "Add of existing embedding ID: 690\n",
      "Insert of existing embedding ID: 691\n",
      "Add of existing embedding ID: 691\n",
      "Insert of existing embedding ID: 692\n",
      "Add of existing embedding ID: 692\n",
      "Insert of existing embedding ID: 693\n",
      "Add of existing embedding ID: 693\n",
      "Insert of existing embedding ID: 694\n",
      "Add of existing embedding ID: 694\n",
      "Insert of existing embedding ID: 695\n",
      "Add of existing embedding ID: 695\n",
      "Insert of existing embedding ID: 696\n",
      "Add of existing embedding ID: 696\n",
      "Insert of existing embedding ID: 697\n",
      "Add of existing embedding ID: 697\n",
      "Insert of existing embedding ID: 698\n",
      "Add of existing embedding ID: 698\n",
      "Insert of existing embedding ID: 699\n",
      "Add of existing embedding ID: 699\n",
      "Insert of existing embedding ID: 700\n",
      "Add of existing embedding ID: 700\n",
      "Insert of existing embedding ID: 701\n",
      "Add of existing embedding ID: 701\n",
      "Insert of existing embedding ID: 702\n",
      "Add of existing embedding ID: 702\n",
      "Insert of existing embedding ID: 703\n",
      "Add of existing embedding ID: 703\n",
      "Insert of existing embedding ID: 704\n",
      "Add of existing embedding ID: 704\n",
      "Insert of existing embedding ID: 705\n",
      "Add of existing embedding ID: 705\n",
      "Insert of existing embedding ID: 706\n",
      "Add of existing embedding ID: 706\n",
      "Insert of existing embedding ID: 707\n",
      "Add of existing embedding ID: 707\n",
      "Insert of existing embedding ID: 708\n",
      "Add of existing embedding ID: 708\n",
      "Insert of existing embedding ID: 709\n",
      "Add of existing embedding ID: 709\n",
      "Insert of existing embedding ID: 710\n",
      "Add of existing embedding ID: 710\n",
      "Insert of existing embedding ID: 711\n",
      "Add of existing embedding ID: 711\n",
      "Insert of existing embedding ID: 712\n",
      "Add of existing embedding ID: 712\n",
      "Insert of existing embedding ID: 713\n",
      "Add of existing embedding ID: 713\n",
      "Insert of existing embedding ID: 714\n",
      "Add of existing embedding ID: 714\n",
      "Insert of existing embedding ID: 715\n",
      "Add of existing embedding ID: 715\n",
      "Insert of existing embedding ID: 716\n",
      "Add of existing embedding ID: 716\n",
      "Insert of existing embedding ID: 717\n",
      "Add of existing embedding ID: 717\n",
      "Insert of existing embedding ID: 718\n",
      "Add of existing embedding ID: 718\n",
      "Insert of existing embedding ID: 719\n",
      "Add of existing embedding ID: 719\n",
      "Insert of existing embedding ID: 720\n",
      "Add of existing embedding ID: 720\n",
      "Insert of existing embedding ID: 721\n",
      "Add of existing embedding ID: 721\n",
      "Insert of existing embedding ID: 722\n",
      "Add of existing embedding ID: 722\n",
      "Insert of existing embedding ID: 723\n",
      "Add of existing embedding ID: 723\n",
      "Insert of existing embedding ID: 724\n",
      "Add of existing embedding ID: 724\n",
      "Insert of existing embedding ID: 725\n",
      "Add of existing embedding ID: 725\n",
      "Insert of existing embedding ID: 726\n",
      "Add of existing embedding ID: 726\n",
      "Insert of existing embedding ID: 727\n",
      "Add of existing embedding ID: 727\n",
      "Insert of existing embedding ID: 728\n",
      "Add of existing embedding ID: 728\n",
      "Insert of existing embedding ID: 729\n",
      "Add of existing embedding ID: 729\n",
      "Insert of existing embedding ID: 730\n",
      "Add of existing embedding ID: 730\n",
      "Insert of existing embedding ID: 731\n",
      "Add of existing embedding ID: 731\n",
      "Insert of existing embedding ID: 732\n",
      "Add of existing embedding ID: 732\n",
      "Insert of existing embedding ID: 733\n",
      "Add of existing embedding ID: 733\n",
      "Insert of existing embedding ID: 734\n",
      "Add of existing embedding ID: 734\n",
      "Insert of existing embedding ID: 735\n",
      "Add of existing embedding ID: 735\n",
      "Insert of existing embedding ID: 736\n",
      "Add of existing embedding ID: 736\n",
      "Insert of existing embedding ID: 737\n",
      "Add of existing embedding ID: 737\n",
      "Insert of existing embedding ID: 738\n",
      "Add of existing embedding ID: 738\n",
      "Insert of existing embedding ID: 739\n",
      "Add of existing embedding ID: 739\n",
      "Insert of existing embedding ID: 740\n",
      "Add of existing embedding ID: 740\n",
      "Insert of existing embedding ID: 741\n",
      "Add of existing embedding ID: 741\n",
      "Insert of existing embedding ID: 742\n",
      "Add of existing embedding ID: 742\n",
      "Insert of existing embedding ID: 743\n",
      "Add of existing embedding ID: 743\n",
      "Insert of existing embedding ID: 744\n",
      "Add of existing embedding ID: 744\n",
      "Insert of existing embedding ID: 745\n",
      "Add of existing embedding ID: 745\n",
      "Insert of existing embedding ID: 746\n",
      "Add of existing embedding ID: 746\n",
      "Insert of existing embedding ID: 747\n",
      "Add of existing embedding ID: 747\n",
      "Insert of existing embedding ID: 748\n",
      "Add of existing embedding ID: 748\n",
      "Insert of existing embedding ID: 749\n",
      "Add of existing embedding ID: 749\n",
      "Insert of existing embedding ID: 750\n",
      "Add of existing embedding ID: 750\n",
      "Insert of existing embedding ID: 751\n",
      "Add of existing embedding ID: 751\n",
      "Insert of existing embedding ID: 752\n",
      "Add of existing embedding ID: 752\n",
      "Insert of existing embedding ID: 753\n",
      "Add of existing embedding ID: 753\n",
      "Insert of existing embedding ID: 754\n",
      "Add of existing embedding ID: 754\n",
      "Insert of existing embedding ID: 755\n",
      "Add of existing embedding ID: 755\n",
      "Insert of existing embedding ID: 756\n",
      "Add of existing embedding ID: 756\n",
      "Insert of existing embedding ID: 757\n",
      "Add of existing embedding ID: 757\n",
      "Insert of existing embedding ID: 758\n",
      "Add of existing embedding ID: 758\n",
      "Insert of existing embedding ID: 759\n",
      "Add of existing embedding ID: 759\n",
      "Insert of existing embedding ID: 760\n",
      "Add of existing embedding ID: 760\n",
      "Insert of existing embedding ID: 761\n",
      "Add of existing embedding ID: 761\n",
      "Insert of existing embedding ID: 762\n",
      "Add of existing embedding ID: 762\n",
      "Insert of existing embedding ID: 763\n",
      "Add of existing embedding ID: 763\n",
      "Insert of existing embedding ID: 764\n",
      "Add of existing embedding ID: 764\n",
      "Insert of existing embedding ID: 765\n",
      "Add of existing embedding ID: 765\n",
      "Insert of existing embedding ID: 766\n",
      "Add of existing embedding ID: 766\n",
      "Insert of existing embedding ID: 767\n",
      "Add of existing embedding ID: 767\n",
      "Insert of existing embedding ID: 768\n",
      "Add of existing embedding ID: 768\n",
      "Insert of existing embedding ID: 769\n",
      "Add of existing embedding ID: 769\n",
      "Insert of existing embedding ID: 770\n",
      "Add of existing embedding ID: 770\n",
      "Insert of existing embedding ID: 771\n",
      "Add of existing embedding ID: 771\n",
      "Insert of existing embedding ID: 772\n",
      "Add of existing embedding ID: 772\n",
      "Insert of existing embedding ID: 773\n",
      "Add of existing embedding ID: 773\n",
      "Insert of existing embedding ID: 774\n",
      "Add of existing embedding ID: 774\n",
      "Insert of existing embedding ID: 775\n",
      "Add of existing embedding ID: 775\n",
      "Insert of existing embedding ID: 776\n",
      "Add of existing embedding ID: 776\n",
      "Insert of existing embedding ID: 777\n",
      "Add of existing embedding ID: 777\n",
      "Insert of existing embedding ID: 778\n",
      "Add of existing embedding ID: 778\n",
      "Insert of existing embedding ID: 779\n",
      "Add of existing embedding ID: 779\n",
      "Insert of existing embedding ID: 780\n",
      "Add of existing embedding ID: 780\n",
      "Insert of existing embedding ID: 781\n",
      "Add of existing embedding ID: 781\n",
      "Insert of existing embedding ID: 782\n",
      "Add of existing embedding ID: 782\n",
      "Insert of existing embedding ID: 783\n",
      "Add of existing embedding ID: 783\n",
      "Insert of existing embedding ID: 784\n",
      "Add of existing embedding ID: 784\n",
      "Insert of existing embedding ID: 785\n",
      "Add of existing embedding ID: 785\n",
      "Insert of existing embedding ID: 786\n",
      "Add of existing embedding ID: 786\n",
      "Insert of existing embedding ID: 787\n",
      "Add of existing embedding ID: 787\n",
      "Insert of existing embedding ID: 788\n",
      "Add of existing embedding ID: 788\n",
      "Insert of existing embedding ID: 789\n",
      "Add of existing embedding ID: 789\n",
      "Insert of existing embedding ID: 790\n",
      "Add of existing embedding ID: 790\n",
      "Insert of existing embedding ID: 791\n",
      "Add of existing embedding ID: 791\n",
      "Insert of existing embedding ID: 792\n",
      "Add of existing embedding ID: 792\n",
      "Insert of existing embedding ID: 793\n",
      "Add of existing embedding ID: 793\n",
      "Insert of existing embedding ID: 794\n",
      "Add of existing embedding ID: 794\n",
      "Insert of existing embedding ID: 795\n",
      "Add of existing embedding ID: 795\n",
      "Insert of existing embedding ID: 796\n",
      "Add of existing embedding ID: 796\n",
      "Insert of existing embedding ID: 797\n",
      "Add of existing embedding ID: 797\n",
      "Insert of existing embedding ID: 798\n",
      "Add of existing embedding ID: 798\n",
      "Insert of existing embedding ID: 799\n",
      "Add of existing embedding ID: 799\n",
      "Insert of existing embedding ID: 800\n",
      "Add of existing embedding ID: 800\n",
      "Insert of existing embedding ID: 801\n",
      "Add of existing embedding ID: 801\n",
      "Insert of existing embedding ID: 802\n",
      "Add of existing embedding ID: 802\n",
      "Insert of existing embedding ID: 803\n",
      "Add of existing embedding ID: 803\n",
      "Insert of existing embedding ID: 804\n",
      "Add of existing embedding ID: 804\n",
      "Insert of existing embedding ID: 805\n",
      "Add of existing embedding ID: 805\n",
      "Insert of existing embedding ID: 806\n",
      "Add of existing embedding ID: 806\n",
      "Insert of existing embedding ID: 807\n",
      "Add of existing embedding ID: 807\n",
      "Insert of existing embedding ID: 808\n",
      "Add of existing embedding ID: 808\n",
      "Insert of existing embedding ID: 809\n",
      "Add of existing embedding ID: 809\n",
      "Insert of existing embedding ID: 810\n",
      "Add of existing embedding ID: 810\n",
      "Insert of existing embedding ID: 811\n",
      "Add of existing embedding ID: 811\n",
      "Insert of existing embedding ID: 812\n",
      "Add of existing embedding ID: 812\n",
      "Insert of existing embedding ID: 813\n",
      "Add of existing embedding ID: 813\n",
      "Insert of existing embedding ID: 814\n",
      "Add of existing embedding ID: 814\n",
      "Insert of existing embedding ID: 815\n",
      "Add of existing embedding ID: 815\n",
      "Insert of existing embedding ID: 816\n",
      "Add of existing embedding ID: 816\n",
      "Insert of existing embedding ID: 817\n",
      "Add of existing embedding ID: 817\n",
      "Insert of existing embedding ID: 818\n",
      "Add of existing embedding ID: 818\n",
      "Insert of existing embedding ID: 819\n",
      "Add of existing embedding ID: 819\n",
      "Insert of existing embedding ID: 820\n",
      "Add of existing embedding ID: 820\n",
      "Insert of existing embedding ID: 821\n",
      "Add of existing embedding ID: 821\n",
      "Insert of existing embedding ID: 822\n",
      "Add of existing embedding ID: 822\n",
      "Insert of existing embedding ID: 823\n",
      "Add of existing embedding ID: 823\n",
      "Insert of existing embedding ID: 824\n",
      "Add of existing embedding ID: 824\n",
      "Insert of existing embedding ID: 825\n",
      "Add of existing embedding ID: 825\n",
      "Insert of existing embedding ID: 826\n",
      "Add of existing embedding ID: 826\n",
      "Insert of existing embedding ID: 827\n",
      "Add of existing embedding ID: 827\n",
      "Insert of existing embedding ID: 828\n",
      "Add of existing embedding ID: 828\n",
      "Insert of existing embedding ID: 829\n",
      "Add of existing embedding ID: 829\n",
      "Insert of existing embedding ID: 830\n",
      "Add of existing embedding ID: 830\n",
      "Insert of existing embedding ID: 831\n",
      "Add of existing embedding ID: 831\n",
      "Insert of existing embedding ID: 832\n",
      "Add of existing embedding ID: 832\n",
      "Insert of existing embedding ID: 833\n",
      "Add of existing embedding ID: 833\n",
      "Insert of existing embedding ID: 834\n",
      "Add of existing embedding ID: 834\n",
      "Insert of existing embedding ID: 835\n",
      "Add of existing embedding ID: 835\n",
      "Insert of existing embedding ID: 836\n",
      "Add of existing embedding ID: 836\n",
      "Insert of existing embedding ID: 837\n",
      "Add of existing embedding ID: 837\n",
      "Insert of existing embedding ID: 838\n",
      "Add of existing embedding ID: 838\n",
      "Insert of existing embedding ID: 839\n",
      "Add of existing embedding ID: 839\n",
      "Insert of existing embedding ID: 840\n",
      "Add of existing embedding ID: 840\n",
      "Insert of existing embedding ID: 841\n",
      "Add of existing embedding ID: 841\n",
      "Insert of existing embedding ID: 842\n",
      "Add of existing embedding ID: 842\n",
      "Insert of existing embedding ID: 843\n",
      "Add of existing embedding ID: 843\n",
      "Insert of existing embedding ID: 844\n",
      "Add of existing embedding ID: 844\n",
      "Insert of existing embedding ID: 845\n",
      "Add of existing embedding ID: 845\n",
      "Insert of existing embedding ID: 846\n",
      "Add of existing embedding ID: 846\n",
      "Insert of existing embedding ID: 847\n",
      "Add of existing embedding ID: 847\n",
      "Insert of existing embedding ID: 848\n",
      "Add of existing embedding ID: 848\n",
      "Insert of existing embedding ID: 849\n",
      "Add of existing embedding ID: 849\n",
      "Insert of existing embedding ID: 850\n",
      "Add of existing embedding ID: 850\n",
      "Insert of existing embedding ID: 851\n",
      "Add of existing embedding ID: 851\n",
      "Insert of existing embedding ID: 852\n",
      "Add of existing embedding ID: 852\n",
      "Insert of existing embedding ID: 853\n",
      "Add of existing embedding ID: 853\n",
      "Insert of existing embedding ID: 854\n",
      "Add of existing embedding ID: 854\n",
      "Insert of existing embedding ID: 855\n",
      "Add of existing embedding ID: 855\n",
      "Insert of existing embedding ID: 856\n",
      "Add of existing embedding ID: 856\n",
      "Insert of existing embedding ID: 857\n",
      "Add of existing embedding ID: 857\n",
      "Insert of existing embedding ID: 858\n",
      "Add of existing embedding ID: 858\n",
      "Insert of existing embedding ID: 859\n",
      "Add of existing embedding ID: 859\n",
      "Insert of existing embedding ID: 860\n",
      "Add of existing embedding ID: 860\n",
      "Insert of existing embedding ID: 861\n",
      "Add of existing embedding ID: 861\n",
      "Insert of existing embedding ID: 862\n",
      "Add of existing embedding ID: 862\n",
      "Insert of existing embedding ID: 863\n",
      "Add of existing embedding ID: 863\n",
      "Insert of existing embedding ID: 864\n",
      "Add of existing embedding ID: 864\n",
      "Insert of existing embedding ID: 865\n",
      "Add of existing embedding ID: 865\n",
      "Insert of existing embedding ID: 866\n",
      "Add of existing embedding ID: 866\n",
      "Insert of existing embedding ID: 867\n",
      "Add of existing embedding ID: 867\n",
      "Insert of existing embedding ID: 868\n",
      "Add of existing embedding ID: 868\n",
      "Insert of existing embedding ID: 869\n",
      "Add of existing embedding ID: 869\n",
      "Insert of existing embedding ID: 870\n",
      "Add of existing embedding ID: 870\n",
      "Insert of existing embedding ID: 871\n",
      "Add of existing embedding ID: 871\n",
      "Insert of existing embedding ID: 872\n",
      "Add of existing embedding ID: 872\n",
      "Insert of existing embedding ID: 873\n",
      "Add of existing embedding ID: 873\n",
      "Insert of existing embedding ID: 874\n",
      "Add of existing embedding ID: 874\n",
      "Insert of existing embedding ID: 875\n",
      "Add of existing embedding ID: 875\n",
      "Insert of existing embedding ID: 876\n",
      "Add of existing embedding ID: 876\n",
      "Insert of existing embedding ID: 877\n",
      "Add of existing embedding ID: 877\n",
      "Insert of existing embedding ID: 878\n",
      "Add of existing embedding ID: 878\n",
      "Insert of existing embedding ID: 879\n",
      "Add of existing embedding ID: 879\n",
      "Insert of existing embedding ID: 880\n",
      "Add of existing embedding ID: 880\n",
      "Insert of existing embedding ID: 881\n",
      "Add of existing embedding ID: 881\n",
      "Insert of existing embedding ID: 882\n",
      "Add of existing embedding ID: 882\n",
      "Insert of existing embedding ID: 883\n",
      "Add of existing embedding ID: 883\n",
      "Insert of existing embedding ID: 884\n",
      "Add of existing embedding ID: 884\n",
      "Insert of existing embedding ID: 885\n",
      "Add of existing embedding ID: 885\n",
      "Insert of existing embedding ID: 886\n",
      "Add of existing embedding ID: 886\n",
      "Insert of existing embedding ID: 887\n",
      "Add of existing embedding ID: 887\n",
      "Insert of existing embedding ID: 888\n",
      "Add of existing embedding ID: 888\n",
      "Insert of existing embedding ID: 889\n",
      "Add of existing embedding ID: 889\n",
      "Insert of existing embedding ID: 890\n",
      "Add of existing embedding ID: 890\n",
      "Insert of existing embedding ID: 891\n",
      "Add of existing embedding ID: 891\n",
      "Insert of existing embedding ID: 892\n",
      "Add of existing embedding ID: 892\n",
      "Insert of existing embedding ID: 893\n",
      "Add of existing embedding ID: 893\n",
      "Insert of existing embedding ID: 894\n",
      "Add of existing embedding ID: 894\n",
      "Insert of existing embedding ID: 895\n",
      "Add of existing embedding ID: 895\n",
      "Insert of existing embedding ID: 896\n",
      "Add of existing embedding ID: 896\n",
      "Insert of existing embedding ID: 897\n",
      "Add of existing embedding ID: 897\n",
      "Insert of existing embedding ID: 898\n",
      "Add of existing embedding ID: 898\n",
      "Insert of existing embedding ID: 899\n",
      "Add of existing embedding ID: 899\n",
      "Insert of existing embedding ID: 900\n",
      "Add of existing embedding ID: 900\n",
      "Insert of existing embedding ID: 901\n",
      "Add of existing embedding ID: 901\n",
      "Insert of existing embedding ID: 902\n",
      "Add of existing embedding ID: 902\n",
      "Insert of existing embedding ID: 903\n",
      "Add of existing embedding ID: 903\n",
      "Insert of existing embedding ID: 904\n",
      "Add of existing embedding ID: 904\n",
      "Insert of existing embedding ID: 905\n",
      "Add of existing embedding ID: 905\n",
      "Insert of existing embedding ID: 906\n",
      "Add of existing embedding ID: 906\n",
      "Insert of existing embedding ID: 907\n",
      "Add of existing embedding ID: 907\n",
      "Insert of existing embedding ID: 908\n",
      "Add of existing embedding ID: 908\n",
      "Insert of existing embedding ID: 909\n",
      "Add of existing embedding ID: 909\n",
      "Insert of existing embedding ID: 910\n",
      "Add of existing embedding ID: 910\n",
      "Insert of existing embedding ID: 911\n",
      "Add of existing embedding ID: 911\n",
      "Insert of existing embedding ID: 912\n",
      "Add of existing embedding ID: 912\n",
      "Insert of existing embedding ID: 913\n",
      "Add of existing embedding ID: 913\n",
      "Insert of existing embedding ID: 914\n",
      "Add of existing embedding ID: 914\n",
      "Insert of existing embedding ID: 915\n",
      "Add of existing embedding ID: 915\n",
      "Insert of existing embedding ID: 916\n",
      "Add of existing embedding ID: 916\n",
      "Insert of existing embedding ID: 917\n",
      "Add of existing embedding ID: 917\n",
      "Insert of existing embedding ID: 918\n",
      "Add of existing embedding ID: 918\n",
      "Insert of existing embedding ID: 919\n",
      "Add of existing embedding ID: 919\n",
      "Insert of existing embedding ID: 920\n",
      "Add of existing embedding ID: 920\n",
      "Insert of existing embedding ID: 921\n",
      "Add of existing embedding ID: 921\n",
      "Insert of existing embedding ID: 922\n",
      "Add of existing embedding ID: 922\n",
      "Insert of existing embedding ID: 923\n",
      "Add of existing embedding ID: 923\n",
      "Insert of existing embedding ID: 924\n",
      "Add of existing embedding ID: 924\n",
      "Insert of existing embedding ID: 925\n",
      "Add of existing embedding ID: 925\n",
      "Insert of existing embedding ID: 926\n",
      "Add of existing embedding ID: 926\n",
      "Insert of existing embedding ID: 927\n",
      "Add of existing embedding ID: 927\n",
      "Insert of existing embedding ID: 928\n",
      "Add of existing embedding ID: 928\n",
      "Insert of existing embedding ID: 929\n",
      "Add of existing embedding ID: 929\n",
      "Insert of existing embedding ID: 930\n",
      "Add of existing embedding ID: 930\n",
      "Insert of existing embedding ID: 931\n",
      "Add of existing embedding ID: 931\n",
      "Insert of existing embedding ID: 932\n",
      "Add of existing embedding ID: 932\n",
      "Insert of existing embedding ID: 933\n",
      "Add of existing embedding ID: 933\n",
      "Insert of existing embedding ID: 934\n",
      "Add of existing embedding ID: 934\n",
      "Insert of existing embedding ID: 935\n",
      "Add of existing embedding ID: 935\n",
      "Insert of existing embedding ID: 936\n",
      "Add of existing embedding ID: 936\n",
      "Insert of existing embedding ID: 937\n",
      "Add of existing embedding ID: 937\n",
      "Insert of existing embedding ID: 938\n",
      "Add of existing embedding ID: 938\n",
      "Insert of existing embedding ID: 939\n",
      "Add of existing embedding ID: 939\n",
      "Insert of existing embedding ID: 940\n",
      "Add of existing embedding ID: 940\n",
      "Insert of existing embedding ID: 941\n",
      "Add of existing embedding ID: 941\n",
      "Insert of existing embedding ID: 942\n",
      "Add of existing embedding ID: 942\n",
      "Insert of existing embedding ID: 943\n",
      "Add of existing embedding ID: 943\n",
      "Insert of existing embedding ID: 944\n",
      "Add of existing embedding ID: 944\n",
      "Insert of existing embedding ID: 945\n",
      "Add of existing embedding ID: 945\n",
      "Insert of existing embedding ID: 946\n",
      "Add of existing embedding ID: 946\n",
      "Insert of existing embedding ID: 947\n",
      "Add of existing embedding ID: 947\n",
      "Insert of existing embedding ID: 948\n",
      "Add of existing embedding ID: 948\n",
      "Insert of existing embedding ID: 949\n",
      "Add of existing embedding ID: 949\n",
      "Insert of existing embedding ID: 950\n",
      "Add of existing embedding ID: 950\n",
      "Insert of existing embedding ID: 951\n",
      "Add of existing embedding ID: 951\n",
      "Insert of existing embedding ID: 952\n",
      "Add of existing embedding ID: 952\n",
      "Insert of existing embedding ID: 953\n",
      "Add of existing embedding ID: 953\n",
      "Insert of existing embedding ID: 954\n",
      "Add of existing embedding ID: 954\n",
      "Insert of existing embedding ID: 955\n",
      "Add of existing embedding ID: 955\n",
      "Insert of existing embedding ID: 956\n",
      "Add of existing embedding ID: 956\n",
      "Insert of existing embedding ID: 957\n",
      "Add of existing embedding ID: 957\n",
      "Insert of existing embedding ID: 958\n",
      "Add of existing embedding ID: 958\n",
      "Insert of existing embedding ID: 959\n",
      "Add of existing embedding ID: 959\n",
      "Insert of existing embedding ID: 960\n",
      "Add of existing embedding ID: 960\n",
      "Insert of existing embedding ID: 961\n",
      "Add of existing embedding ID: 961\n",
      "Insert of existing embedding ID: 962\n",
      "Add of existing embedding ID: 962\n",
      "Insert of existing embedding ID: 963\n",
      "Add of existing embedding ID: 963\n",
      "Insert of existing embedding ID: 964\n",
      "Add of existing embedding ID: 964\n",
      "Insert of existing embedding ID: 965\n",
      "Add of existing embedding ID: 965\n",
      "Insert of existing embedding ID: 966\n",
      "Add of existing embedding ID: 966\n",
      "Insert of existing embedding ID: 967\n",
      "Add of existing embedding ID: 967\n",
      "Insert of existing embedding ID: 968\n",
      "Add of existing embedding ID: 968\n",
      "Insert of existing embedding ID: 969\n",
      "Add of existing embedding ID: 969\n",
      "Insert of existing embedding ID: 970\n",
      "Add of existing embedding ID: 970\n",
      "Insert of existing embedding ID: 971\n",
      "Add of existing embedding ID: 971\n",
      "Insert of existing embedding ID: 972\n",
      "Add of existing embedding ID: 972\n",
      "Insert of existing embedding ID: 973\n",
      "Add of existing embedding ID: 973\n",
      "Insert of existing embedding ID: 974\n",
      "Add of existing embedding ID: 974\n",
      "Insert of existing embedding ID: 975\n",
      "Add of existing embedding ID: 975\n",
      "Insert of existing embedding ID: 976\n",
      "Add of existing embedding ID: 976\n",
      "Insert of existing embedding ID: 977\n",
      "Add of existing embedding ID: 977\n",
      "Insert of existing embedding ID: 978\n",
      "Add of existing embedding ID: 978\n",
      "Insert of existing embedding ID: 979\n",
      "Add of existing embedding ID: 979\n",
      "Insert of existing embedding ID: 980\n",
      "Add of existing embedding ID: 980\n",
      "Insert of existing embedding ID: 981\n",
      "Add of existing embedding ID: 981\n",
      "Insert of existing embedding ID: 982\n",
      "Add of existing embedding ID: 982\n",
      "Insert of existing embedding ID: 983\n",
      "Add of existing embedding ID: 983\n",
      "Insert of existing embedding ID: 984\n",
      "Add of existing embedding ID: 984\n",
      "Insert of existing embedding ID: 985\n",
      "Add of existing embedding ID: 985\n",
      "Insert of existing embedding ID: 986\n",
      "Add of existing embedding ID: 986\n",
      "Insert of existing embedding ID: 987\n",
      "Add of existing embedding ID: 987\n",
      "Insert of existing embedding ID: 988\n",
      "Add of existing embedding ID: 988\n",
      "Insert of existing embedding ID: 989\n",
      "Add of existing embedding ID: 989\n",
      "Insert of existing embedding ID: 990\n",
      "Add of existing embedding ID: 990\n",
      "Insert of existing embedding ID: 991\n",
      "Add of existing embedding ID: 991\n",
      "Insert of existing embedding ID: 992\n",
      "Add of existing embedding ID: 992\n",
      "Insert of existing embedding ID: 993\n",
      "Add of existing embedding ID: 993\n",
      "Insert of existing embedding ID: 994\n",
      "Add of existing embedding ID: 994\n",
      "Insert of existing embedding ID: 995\n",
      "Add of existing embedding ID: 995\n",
      "Insert of existing embedding ID: 996\n",
      "Add of existing embedding ID: 996\n",
      "Insert of existing embedding ID: 997\n",
      "Add of existing embedding ID: 997\n",
      "Insert of existing embedding ID: 998\n",
      "Add of existing embedding ID: 998\n",
      "Insert of existing embedding ID: 999\n",
      "Add of existing embedding ID: 999\n",
      "Insert of existing embedding ID: 1000\n",
      "Add of existing embedding ID: 1000\n",
      "Insert of existing embedding ID: 1001\n",
      "Add of existing embedding ID: 1001\n",
      "Insert of existing embedding ID: 1002\n",
      "Add of existing embedding ID: 1002\n",
      "Insert of existing embedding ID: 1003\n",
      "Add of existing embedding ID: 1003\n",
      "Insert of existing embedding ID: 1004\n",
      "Add of existing embedding ID: 1004\n",
      "Insert of existing embedding ID: 1005\n",
      "Add of existing embedding ID: 1005\n",
      "Insert of existing embedding ID: 1006\n",
      "Add of existing embedding ID: 1006\n",
      "Insert of existing embedding ID: 1007\n",
      "Add of existing embedding ID: 1007\n",
      "Insert of existing embedding ID: 1008\n",
      "Add of existing embedding ID: 1008\n",
      "Insert of existing embedding ID: 1009\n",
      "Add of existing embedding ID: 1009\n",
      "Insert of existing embedding ID: 1010\n",
      "Add of existing embedding ID: 1010\n",
      "Insert of existing embedding ID: 1011\n",
      "Add of existing embedding ID: 1011\n",
      "Insert of existing embedding ID: 1012\n",
      "Add of existing embedding ID: 1012\n",
      "Insert of existing embedding ID: 1013\n",
      "Add of existing embedding ID: 1013\n",
      "Insert of existing embedding ID: 1014\n",
      "Add of existing embedding ID: 1014\n",
      "Insert of existing embedding ID: 1015\n",
      "Add of existing embedding ID: 1015\n",
      "Insert of existing embedding ID: 1016\n",
      "Add of existing embedding ID: 1016\n",
      "Insert of existing embedding ID: 1017\n",
      "Add of existing embedding ID: 1017\n",
      "Insert of existing embedding ID: 1018\n",
      "Add of existing embedding ID: 1018\n",
      "Insert of existing embedding ID: 1019\n",
      "Add of existing embedding ID: 1019\n",
      "Insert of existing embedding ID: 1020\n",
      "Add of existing embedding ID: 1020\n",
      "Insert of existing embedding ID: 1021\n",
      "Add of existing embedding ID: 1021\n",
      "Insert of existing embedding ID: 1022\n",
      "Add of existing embedding ID: 1022\n",
      "Insert of existing embedding ID: 1023\n",
      "Add of existing embedding ID: 1023\n",
      "Insert of existing embedding ID: 1024\n",
      "Add of existing embedding ID: 1024\n",
      "Insert of existing embedding ID: 1025\n",
      "Add of existing embedding ID: 1025\n",
      "Insert of existing embedding ID: 1026\n",
      "Add of existing embedding ID: 1026\n",
      "Insert of existing embedding ID: 1027\n",
      "Add of existing embedding ID: 1027\n",
      "Insert of existing embedding ID: 1028\n",
      "Add of existing embedding ID: 1028\n",
      "Insert of existing embedding ID: 1029\n",
      "Add of existing embedding ID: 1029\n",
      "Insert of existing embedding ID: 1030\n",
      "Add of existing embedding ID: 1030\n",
      "Insert of existing embedding ID: 1031\n",
      "Add of existing embedding ID: 1031\n",
      "Insert of existing embedding ID: 1032\n",
      "Add of existing embedding ID: 1032\n",
      "Insert of existing embedding ID: 1033\n",
      "Add of existing embedding ID: 1033\n",
      "Insert of existing embedding ID: 1034\n",
      "Add of existing embedding ID: 1034\n",
      "Insert of existing embedding ID: 1035\n",
      "Add of existing embedding ID: 1035\n",
      "Insert of existing embedding ID: 1036\n",
      "Add of existing embedding ID: 1036\n",
      "Insert of existing embedding ID: 1037\n",
      "Add of existing embedding ID: 1037\n",
      "Insert of existing embedding ID: 1038\n",
      "Add of existing embedding ID: 1038\n",
      "Insert of existing embedding ID: 1039\n",
      "Add of existing embedding ID: 1039\n",
      "Insert of existing embedding ID: 1040\n",
      "Add of existing embedding ID: 1040\n",
      "Insert of existing embedding ID: 1041\n",
      "Add of existing embedding ID: 1041\n",
      "Insert of existing embedding ID: 1042\n",
      "Add of existing embedding ID: 1042\n",
      "Insert of existing embedding ID: 1043\n",
      "Add of existing embedding ID: 1043\n",
      "Insert of existing embedding ID: 1044\n",
      "Add of existing embedding ID: 1044\n",
      "Insert of existing embedding ID: 1045\n",
      "Add of existing embedding ID: 1045\n",
      "Insert of existing embedding ID: 1046\n",
      "Add of existing embedding ID: 1046\n",
      "Insert of existing embedding ID: 1047\n",
      "Add of existing embedding ID: 1047\n",
      "Insert of existing embedding ID: 1048\n",
      "Add of existing embedding ID: 1048\n",
      "Insert of existing embedding ID: 1049\n",
      "Add of existing embedding ID: 1049\n",
      "Insert of existing embedding ID: 1050\n",
      "Add of existing embedding ID: 1050\n",
      "Insert of existing embedding ID: 1051\n",
      "Add of existing embedding ID: 1051\n",
      "Insert of existing embedding ID: 1052\n",
      "Add of existing embedding ID: 1052\n",
      "Insert of existing embedding ID: 1053\n",
      "Add of existing embedding ID: 1053\n",
      "Insert of existing embedding ID: 1054\n",
      "Add of existing embedding ID: 1054\n",
      "Insert of existing embedding ID: 1055\n",
      "Add of existing embedding ID: 1055\n",
      "Insert of existing embedding ID: 1056\n",
      "Add of existing embedding ID: 1056\n",
      "Insert of existing embedding ID: 1057\n",
      "Add of existing embedding ID: 1057\n",
      "Insert of existing embedding ID: 1058\n",
      "Add of existing embedding ID: 1058\n",
      "Insert of existing embedding ID: 1059\n",
      "Add of existing embedding ID: 1059\n",
      "Insert of existing embedding ID: 1060\n",
      "Add of existing embedding ID: 1060\n",
      "Insert of existing embedding ID: 1061\n",
      "Add of existing embedding ID: 1061\n",
      "Insert of existing embedding ID: 1062\n",
      "Add of existing embedding ID: 1062\n",
      "Insert of existing embedding ID: 1063\n",
      "Add of existing embedding ID: 1063\n",
      "Insert of existing embedding ID: 1064\n",
      "Add of existing embedding ID: 1064\n",
      "Insert of existing embedding ID: 1065\n",
      "Add of existing embedding ID: 1065\n",
      "Insert of existing embedding ID: 1066\n",
      "Add of existing embedding ID: 1066\n",
      "Insert of existing embedding ID: 1067\n",
      "Add of existing embedding ID: 1067\n",
      "Insert of existing embedding ID: 1068\n",
      "Add of existing embedding ID: 1068\n",
      "Insert of existing embedding ID: 1069\n",
      "Add of existing embedding ID: 1069\n",
      "Insert of existing embedding ID: 1070\n",
      "Add of existing embedding ID: 1070\n",
      "Insert of existing embedding ID: 1071\n",
      "Add of existing embedding ID: 1071\n",
      "Insert of existing embedding ID: 1072\n",
      "Add of existing embedding ID: 1072\n",
      "Insert of existing embedding ID: 1073\n",
      "Add of existing embedding ID: 1073\n",
      "Insert of existing embedding ID: 1074\n",
      "Add of existing embedding ID: 1074\n",
      "Insert of existing embedding ID: 1075\n",
      "Add of existing embedding ID: 1075\n",
      "Insert of existing embedding ID: 1076\n",
      "Add of existing embedding ID: 1076\n",
      "Insert of existing embedding ID: 1077\n",
      "Add of existing embedding ID: 1077\n",
      "Insert of existing embedding ID: 1078\n",
      "Add of existing embedding ID: 1078\n",
      "Insert of existing embedding ID: 1079\n",
      "Add of existing embedding ID: 1079\n",
      "Insert of existing embedding ID: 1080\n",
      "Add of existing embedding ID: 1080\n",
      "Insert of existing embedding ID: 1081\n",
      "Add of existing embedding ID: 1081\n",
      "Insert of existing embedding ID: 1082\n",
      "Add of existing embedding ID: 1082\n",
      "Insert of existing embedding ID: 1083\n",
      "Add of existing embedding ID: 1083\n",
      "Insert of existing embedding ID: 1084\n",
      "Add of existing embedding ID: 1084\n",
      "Insert of existing embedding ID: 1085\n",
      "Add of existing embedding ID: 1085\n",
      "Insert of existing embedding ID: 1086\n",
      "Add of existing embedding ID: 1086\n",
      "Insert of existing embedding ID: 1087\n",
      "Add of existing embedding ID: 1087\n",
      "Insert of existing embedding ID: 1088\n",
      "Add of existing embedding ID: 1088\n",
      "Insert of existing embedding ID: 1089\n",
      "Add of existing embedding ID: 1089\n",
      "Insert of existing embedding ID: 1090\n",
      "Add of existing embedding ID: 1090\n",
      "Insert of existing embedding ID: 1091\n",
      "Add of existing embedding ID: 1091\n",
      "Insert of existing embedding ID: 1092\n",
      "Add of existing embedding ID: 1092\n",
      "Insert of existing embedding ID: 1093\n",
      "Add of existing embedding ID: 1093\n",
      "Insert of existing embedding ID: 1094\n",
      "Add of existing embedding ID: 1094\n",
      "Insert of existing embedding ID: 1095\n",
      "Add of existing embedding ID: 1095\n",
      "Insert of existing embedding ID: 1096\n",
      "Add of existing embedding ID: 1096\n",
      "Insert of existing embedding ID: 1097\n",
      "Add of existing embedding ID: 1097\n",
      "Insert of existing embedding ID: 1098\n",
      "Add of existing embedding ID: 1098\n",
      "Insert of existing embedding ID: 1099\n",
      "Add of existing embedding ID: 1099\n",
      "Insert of existing embedding ID: 1100\n",
      "Add of existing embedding ID: 1100\n",
      "Insert of existing embedding ID: 1101\n",
      "Add of existing embedding ID: 1101\n",
      "Insert of existing embedding ID: 1102\n",
      "Add of existing embedding ID: 1102\n",
      "Insert of existing embedding ID: 1103\n",
      "Add of existing embedding ID: 1103\n",
      "Insert of existing embedding ID: 1104\n",
      "Add of existing embedding ID: 1104\n",
      "Insert of existing embedding ID: 1105\n",
      "Add of existing embedding ID: 1105\n",
      "Insert of existing embedding ID: 1106\n",
      "Add of existing embedding ID: 1106\n",
      "Insert of existing embedding ID: 1107\n",
      "Add of existing embedding ID: 1107\n",
      "Insert of existing embedding ID: 1108\n",
      "Add of existing embedding ID: 1108\n",
      "Insert of existing embedding ID: 1109\n",
      "Add of existing embedding ID: 1109\n",
      "Insert of existing embedding ID: 1110\n",
      "Add of existing embedding ID: 1110\n",
      "Insert of existing embedding ID: 1111\n",
      "Add of existing embedding ID: 1111\n",
      "Insert of existing embedding ID: 1112\n",
      "Add of existing embedding ID: 1112\n",
      "Insert of existing embedding ID: 1113\n",
      "Add of existing embedding ID: 1113\n",
      "Insert of existing embedding ID: 1114\n",
      "Add of existing embedding ID: 1114\n",
      "Insert of existing embedding ID: 1115\n",
      "Add of existing embedding ID: 1115\n",
      "Insert of existing embedding ID: 1116\n",
      "Add of existing embedding ID: 1116\n",
      "Insert of existing embedding ID: 1117\n",
      "Add of existing embedding ID: 1117\n",
      "Insert of existing embedding ID: 1118\n",
      "Add of existing embedding ID: 1118\n",
      "Insert of existing embedding ID: 1119\n",
      "Add of existing embedding ID: 1119\n",
      "Insert of existing embedding ID: 1120\n",
      "Add of existing embedding ID: 1120\n",
      "Insert of existing embedding ID: 1121\n",
      "Add of existing embedding ID: 1121\n",
      "Insert of existing embedding ID: 1122\n",
      "Add of existing embedding ID: 1122\n",
      "Insert of existing embedding ID: 1123\n",
      "Add of existing embedding ID: 1123\n",
      "Insert of existing embedding ID: 1124\n",
      "Add of existing embedding ID: 1124\n",
      "Insert of existing embedding ID: 1125\n",
      "Add of existing embedding ID: 1125\n",
      "Insert of existing embedding ID: 1126\n",
      "Add of existing embedding ID: 1126\n",
      "Insert of existing embedding ID: 1127\n",
      "Add of existing embedding ID: 1127\n",
      "Insert of existing embedding ID: 1128\n",
      "Add of existing embedding ID: 1128\n",
      "Insert of existing embedding ID: 1129\n",
      "Add of existing embedding ID: 1129\n",
      "Insert of existing embedding ID: 1130\n",
      "Add of existing embedding ID: 1130\n",
      "Insert of existing embedding ID: 1131\n",
      "Add of existing embedding ID: 1131\n",
      "Insert of existing embedding ID: 1132\n",
      "Add of existing embedding ID: 1132\n",
      "Insert of existing embedding ID: 1133\n",
      "Add of existing embedding ID: 1133\n",
      "Insert of existing embedding ID: 1134\n",
      "Add of existing embedding ID: 1134\n",
      "Insert of existing embedding ID: 1135\n",
      "Add of existing embedding ID: 1135\n",
      "Insert of existing embedding ID: 1136\n",
      "Add of existing embedding ID: 1136\n",
      "Insert of existing embedding ID: 1137\n",
      "Add of existing embedding ID: 1137\n",
      "Insert of existing embedding ID: 1138\n",
      "Add of existing embedding ID: 1138\n",
      "Insert of existing embedding ID: 1139\n",
      "Add of existing embedding ID: 1139\n",
      "Insert of existing embedding ID: 1140\n",
      "Add of existing embedding ID: 1140\n",
      "Insert of existing embedding ID: 1141\n",
      "Add of existing embedding ID: 1141\n",
      "Insert of existing embedding ID: 1142\n",
      "Add of existing embedding ID: 1142\n",
      "Insert of existing embedding ID: 1143\n",
      "Add of existing embedding ID: 1143\n",
      "Insert of existing embedding ID: 1144\n",
      "Add of existing embedding ID: 1144\n",
      "Insert of existing embedding ID: 1145\n",
      "Add of existing embedding ID: 1145\n",
      "Insert of existing embedding ID: 1146\n",
      "Add of existing embedding ID: 1146\n",
      "Insert of existing embedding ID: 1147\n",
      "Add of existing embedding ID: 1147\n",
      "Insert of existing embedding ID: 1148\n",
      "Add of existing embedding ID: 1148\n",
      "Insert of existing embedding ID: 1149\n",
      "Add of existing embedding ID: 1149\n",
      "Insert of existing embedding ID: 1150\n",
      "Add of existing embedding ID: 1150\n",
      "Insert of existing embedding ID: 1151\n",
      "Add of existing embedding ID: 1151\n",
      "Insert of existing embedding ID: 1152\n",
      "Add of existing embedding ID: 1152\n",
      "Insert of existing embedding ID: 1153\n",
      "Add of existing embedding ID: 1153\n",
      "Insert of existing embedding ID: 1154\n",
      "Add of existing embedding ID: 1154\n",
      "Insert of existing embedding ID: 1155\n",
      "Add of existing embedding ID: 1155\n",
      "Insert of existing embedding ID: 1156\n",
      "Add of existing embedding ID: 1156\n",
      "Insert of existing embedding ID: 1157\n",
      "Add of existing embedding ID: 1157\n",
      "Insert of existing embedding ID: 1158\n",
      "Add of existing embedding ID: 1158\n",
      "Insert of existing embedding ID: 1159\n",
      "Add of existing embedding ID: 1159\n",
      "Insert of existing embedding ID: 1160\n",
      "Add of existing embedding ID: 1160\n",
      "Insert of existing embedding ID: 1161\n",
      "Add of existing embedding ID: 1161\n",
      "Insert of existing embedding ID: 1162\n",
      "Add of existing embedding ID: 1162\n",
      "Insert of existing embedding ID: 1163\n",
      "Add of existing embedding ID: 1163\n",
      "Insert of existing embedding ID: 1164\n",
      "Add of existing embedding ID: 1164\n",
      "Insert of existing embedding ID: 1165\n",
      "Add of existing embedding ID: 1165\n",
      "Insert of existing embedding ID: 1166\n",
      "Add of existing embedding ID: 1166\n",
      "Insert of existing embedding ID: 1167\n",
      "Add of existing embedding ID: 1167\n",
      "Insert of existing embedding ID: 1168\n",
      "Add of existing embedding ID: 1168\n",
      "Insert of existing embedding ID: 1169\n",
      "Add of existing embedding ID: 1169\n",
      "Insert of existing embedding ID: 1170\n",
      "Add of existing embedding ID: 1170\n",
      "Insert of existing embedding ID: 1171\n",
      "Add of existing embedding ID: 1171\n",
      "Insert of existing embedding ID: 1172\n",
      "Add of existing embedding ID: 1172\n",
      "Insert of existing embedding ID: 1173\n",
      "Add of existing embedding ID: 1173\n",
      "Insert of existing embedding ID: 1174\n",
      "Add of existing embedding ID: 1174\n",
      "Insert of existing embedding ID: 1175\n",
      "Add of existing embedding ID: 1175\n",
      "Insert of existing embedding ID: 1176\n",
      "Add of existing embedding ID: 1176\n",
      "Insert of existing embedding ID: 1177\n",
      "Add of existing embedding ID: 1177\n",
      "Insert of existing embedding ID: 1178\n",
      "Add of existing embedding ID: 1178\n",
      "Insert of existing embedding ID: 1179\n",
      "Add of existing embedding ID: 1179\n",
      "Insert of existing embedding ID: 1180\n",
      "Add of existing embedding ID: 1180\n",
      "Insert of existing embedding ID: 1181\n",
      "Add of existing embedding ID: 1181\n",
      "Insert of existing embedding ID: 1182\n",
      "Add of existing embedding ID: 1182\n",
      "Insert of existing embedding ID: 1183\n",
      "Add of existing embedding ID: 1183\n",
      "Insert of existing embedding ID: 1184\n",
      "Add of existing embedding ID: 1184\n",
      "Insert of existing embedding ID: 1185\n",
      "Add of existing embedding ID: 1185\n",
      "Insert of existing embedding ID: 1186\n",
      "Add of existing embedding ID: 1186\n",
      "Insert of existing embedding ID: 1187\n",
      "Add of existing embedding ID: 1187\n",
      "Insert of existing embedding ID: 1188\n",
      "Add of existing embedding ID: 1188\n",
      "Insert of existing embedding ID: 1189\n",
      "Add of existing embedding ID: 1189\n",
      "Insert of existing embedding ID: 1190\n",
      "Add of existing embedding ID: 1190\n",
      "Insert of existing embedding ID: 1191\n",
      "Add of existing embedding ID: 1191\n",
      "Insert of existing embedding ID: 1192\n",
      "Add of existing embedding ID: 1192\n",
      "Insert of existing embedding ID: 1193\n",
      "Add of existing embedding ID: 1193\n",
      "Insert of existing embedding ID: 1194\n",
      "Add of existing embedding ID: 1194\n",
      "Insert of existing embedding ID: 1195\n",
      "Add of existing embedding ID: 1195\n",
      "Insert of existing embedding ID: 1196\n",
      "Add of existing embedding ID: 1196\n",
      "Insert of existing embedding ID: 1197\n",
      "Add of existing embedding ID: 1197\n",
      "Insert of existing embedding ID: 1198\n",
      "Add of existing embedding ID: 1198\n",
      "Insert of existing embedding ID: 1199\n",
      "Add of existing embedding ID: 1199\n",
      "Insert of existing embedding ID: 1200\n",
      "Add of existing embedding ID: 1200\n",
      "Insert of existing embedding ID: 1201\n",
      "Add of existing embedding ID: 1201\n",
      "Insert of existing embedding ID: 1202\n",
      "Add of existing embedding ID: 1202\n",
      "Insert of existing embedding ID: 1203\n",
      "Add of existing embedding ID: 1203\n",
      "Insert of existing embedding ID: 1204\n",
      "Add of existing embedding ID: 1204\n",
      "Insert of existing embedding ID: 1205\n",
      "Add of existing embedding ID: 1205\n",
      "Insert of existing embedding ID: 1206\n",
      "Add of existing embedding ID: 1206\n",
      "Insert of existing embedding ID: 1207\n",
      "Add of existing embedding ID: 1207\n",
      "Insert of existing embedding ID: 1208\n",
      "Add of existing embedding ID: 1208\n",
      "Insert of existing embedding ID: 1209\n",
      "Add of existing embedding ID: 1209\n",
      "Insert of existing embedding ID: 1210\n",
      "Add of existing embedding ID: 1210\n",
      "Insert of existing embedding ID: 1211\n",
      "Add of existing embedding ID: 1211\n",
      "Insert of existing embedding ID: 1212\n",
      "Add of existing embedding ID: 1212\n",
      "Insert of existing embedding ID: 1213\n",
      "Add of existing embedding ID: 1213\n",
      "Insert of existing embedding ID: 1214\n",
      "Add of existing embedding ID: 1214\n",
      "Insert of existing embedding ID: 1215\n",
      "Add of existing embedding ID: 1215\n",
      "Insert of existing embedding ID: 1216\n",
      "Add of existing embedding ID: 1216\n",
      "Insert of existing embedding ID: 1217\n",
      "Add of existing embedding ID: 1217\n",
      "Insert of existing embedding ID: 1218\n",
      "Add of existing embedding ID: 1218\n",
      "Insert of existing embedding ID: 1219\n",
      "Add of existing embedding ID: 1219\n",
      "Insert of existing embedding ID: 1220\n",
      "Add of existing embedding ID: 1220\n",
      "Insert of existing embedding ID: 1221\n",
      "Add of existing embedding ID: 1221\n",
      "Insert of existing embedding ID: 1222\n",
      "Add of existing embedding ID: 1222\n",
      "Insert of existing embedding ID: 1223\n",
      "Add of existing embedding ID: 1223\n",
      "Insert of existing embedding ID: 1224\n",
      "Add of existing embedding ID: 1224\n",
      "Insert of existing embedding ID: 1225\n",
      "Add of existing embedding ID: 1225\n",
      "Insert of existing embedding ID: 1226\n",
      "Add of existing embedding ID: 1226\n",
      "Insert of existing embedding ID: 1227\n",
      "Add of existing embedding ID: 1227\n",
      "Insert of existing embedding ID: 1228\n",
      "Add of existing embedding ID: 1228\n",
      "Insert of existing embedding ID: 1229\n",
      "Add of existing embedding ID: 1229\n",
      "Insert of existing embedding ID: 1230\n",
      "Add of existing embedding ID: 1230\n",
      "Insert of existing embedding ID: 1231\n",
      "Add of existing embedding ID: 1231\n",
      "Insert of existing embedding ID: 1232\n",
      "Add of existing embedding ID: 1232\n",
      "Insert of existing embedding ID: 1233\n",
      "Add of existing embedding ID: 1233\n",
      "Insert of existing embedding ID: 1234\n",
      "Add of existing embedding ID: 1234\n",
      "Insert of existing embedding ID: 1235\n",
      "Add of existing embedding ID: 1235\n",
      "Insert of existing embedding ID: 1236\n",
      "Add of existing embedding ID: 1236\n",
      "Insert of existing embedding ID: 1237\n",
      "Add of existing embedding ID: 1237\n",
      "Insert of existing embedding ID: 1238\n",
      "Add of existing embedding ID: 1238\n",
      "Insert of existing embedding ID: 1239\n",
      "Add of existing embedding ID: 1239\n",
      "Insert of existing embedding ID: 1240\n",
      "Add of existing embedding ID: 1240\n",
      "Insert of existing embedding ID: 1241\n",
      "Add of existing embedding ID: 1241\n",
      "Insert of existing embedding ID: 1242\n",
      "Add of existing embedding ID: 1242\n",
      "Insert of existing embedding ID: 1243\n",
      "Add of existing embedding ID: 1243\n",
      "Insert of existing embedding ID: 1244\n",
      "Add of existing embedding ID: 1244\n",
      "Insert of existing embedding ID: 1245\n",
      "Add of existing embedding ID: 1245\n",
      "Insert of existing embedding ID: 1246\n",
      "Add of existing embedding ID: 1246\n",
      "Insert of existing embedding ID: 1247\n",
      "Add of existing embedding ID: 1247\n",
      "Insert of existing embedding ID: 1248\n",
      "Add of existing embedding ID: 1248\n",
      "Insert of existing embedding ID: 1249\n",
      "Add of existing embedding ID: 1249\n",
      "Insert of existing embedding ID: 1250\n",
      "Add of existing embedding ID: 1250\n",
      "Insert of existing embedding ID: 1251\n",
      "Add of existing embedding ID: 1251\n",
      "Insert of existing embedding ID: 1252\n",
      "Add of existing embedding ID: 1252\n",
      "Insert of existing embedding ID: 1253\n",
      "Add of existing embedding ID: 1253\n",
      "Insert of existing embedding ID: 1254\n",
      "Add of existing embedding ID: 1254\n",
      "Insert of existing embedding ID: 1255\n",
      "Add of existing embedding ID: 1255\n",
      "Insert of existing embedding ID: 1256\n",
      "Add of existing embedding ID: 1256\n",
      "Insert of existing embedding ID: 1257\n",
      "Add of existing embedding ID: 1257\n",
      "Insert of existing embedding ID: 1258\n",
      "Add of existing embedding ID: 1258\n",
      "Insert of existing embedding ID: 1259\n",
      "Add of existing embedding ID: 1259\n",
      "Insert of existing embedding ID: 1260\n",
      "Add of existing embedding ID: 1260\n",
      "Insert of existing embedding ID: 1261\n",
      "Add of existing embedding ID: 1261\n",
      "Insert of existing embedding ID: 1262\n",
      "Add of existing embedding ID: 1262\n",
      "Insert of existing embedding ID: 1263\n",
      "Add of existing embedding ID: 1263\n",
      "Insert of existing embedding ID: 1264\n",
      "Add of existing embedding ID: 1264\n",
      "Insert of existing embedding ID: 1265\n",
      "Add of existing embedding ID: 1265\n",
      "Insert of existing embedding ID: 1266\n",
      "Add of existing embedding ID: 1266\n",
      "Insert of existing embedding ID: 1267\n",
      "Add of existing embedding ID: 1267\n",
      "Insert of existing embedding ID: 1268\n",
      "Add of existing embedding ID: 1268\n",
      "Insert of existing embedding ID: 1269\n",
      "Add of existing embedding ID: 1269\n",
      "Insert of existing embedding ID: 1270\n",
      "Add of existing embedding ID: 1270\n",
      "Insert of existing embedding ID: 1271\n",
      "Add of existing embedding ID: 1271\n",
      "Insert of existing embedding ID: 1272\n",
      "Add of existing embedding ID: 1272\n",
      "Insert of existing embedding ID: 1273\n",
      "Add of existing embedding ID: 1273\n",
      "Insert of existing embedding ID: 1274\n",
      "Add of existing embedding ID: 1274\n",
      "Insert of existing embedding ID: 1275\n",
      "Add of existing embedding ID: 1275\n",
      "Insert of existing embedding ID: 1276\n",
      "Add of existing embedding ID: 1276\n",
      "Insert of existing embedding ID: 1277\n",
      "Add of existing embedding ID: 1277\n",
      "Insert of existing embedding ID: 1278\n",
      "Add of existing embedding ID: 1278\n",
      "Insert of existing embedding ID: 1279\n",
      "Add of existing embedding ID: 1279\n",
      "Insert of existing embedding ID: 1280\n",
      "Add of existing embedding ID: 1280\n",
      "Insert of existing embedding ID: 1281\n",
      "Add of existing embedding ID: 1281\n",
      "Insert of existing embedding ID: 1282\n",
      "Add of existing embedding ID: 1282\n",
      "Insert of existing embedding ID: 1283\n",
      "Add of existing embedding ID: 1283\n",
      "Insert of existing embedding ID: 1284\n",
      "Add of existing embedding ID: 1284\n",
      "Insert of existing embedding ID: 1285\n",
      "Add of existing embedding ID: 1285\n",
      "Insert of existing embedding ID: 1286\n",
      "Add of existing embedding ID: 1286\n",
      "Insert of existing embedding ID: 1287\n",
      "Add of existing embedding ID: 1287\n",
      "Insert of existing embedding ID: 1288\n",
      "Add of existing embedding ID: 1288\n",
      "Insert of existing embedding ID: 1289\n",
      "Add of existing embedding ID: 1289\n",
      "Insert of existing embedding ID: 1290\n",
      "Add of existing embedding ID: 1290\n",
      "Insert of existing embedding ID: 1291\n",
      "Add of existing embedding ID: 1291\n",
      "Insert of existing embedding ID: 1292\n",
      "Add of existing embedding ID: 1292\n",
      "Insert of existing embedding ID: 1293\n",
      "Add of existing embedding ID: 1293\n",
      "Insert of existing embedding ID: 1294\n",
      "Add of existing embedding ID: 1294\n",
      "Insert of existing embedding ID: 1295\n",
      "Add of existing embedding ID: 1295\n",
      "Insert of existing embedding ID: 1296\n",
      "Add of existing embedding ID: 1296\n",
      "Insert of existing embedding ID: 1297\n",
      "Add of existing embedding ID: 1297\n",
      "Insert of existing embedding ID: 1298\n",
      "Add of existing embedding ID: 1298\n",
      "Insert of existing embedding ID: 1299\n",
      "Add of existing embedding ID: 1299\n",
      "Insert of existing embedding ID: 1300\n",
      "Add of existing embedding ID: 1300\n",
      "Insert of existing embedding ID: 1301\n",
      "Add of existing embedding ID: 1301\n",
      "Insert of existing embedding ID: 1302\n",
      "Add of existing embedding ID: 1302\n",
      "Insert of existing embedding ID: 1303\n",
      "Add of existing embedding ID: 1303\n",
      "Insert of existing embedding ID: 1304\n",
      "Add of existing embedding ID: 1304\n",
      "Insert of existing embedding ID: 1305\n",
      "Add of existing embedding ID: 1305\n",
      "Insert of existing embedding ID: 1306\n",
      "Add of existing embedding ID: 1306\n",
      "Insert of existing embedding ID: 1307\n",
      "Add of existing embedding ID: 1307\n",
      "Insert of existing embedding ID: 1308\n",
      "Add of existing embedding ID: 1308\n",
      "Insert of existing embedding ID: 1309\n",
      "Add of existing embedding ID: 1309\n",
      "Insert of existing embedding ID: 1310\n",
      "Add of existing embedding ID: 1310\n",
      "Insert of existing embedding ID: 1311\n",
      "Add of existing embedding ID: 1311\n",
      "Insert of existing embedding ID: 1312\n",
      "Add of existing embedding ID: 1312\n",
      "Insert of existing embedding ID: 1313\n",
      "Add of existing embedding ID: 1313\n",
      "Insert of existing embedding ID: 1314\n",
      "Add of existing embedding ID: 1314\n",
      "Insert of existing embedding ID: 1315\n",
      "Add of existing embedding ID: 1315\n",
      "Insert of existing embedding ID: 1316\n",
      "Add of existing embedding ID: 1316\n",
      "Insert of existing embedding ID: 1317\n",
      "Add of existing embedding ID: 1317\n",
      "Insert of existing embedding ID: 1318\n",
      "Add of existing embedding ID: 1318\n",
      "Insert of existing embedding ID: 1319\n",
      "Add of existing embedding ID: 1319\n",
      "Insert of existing embedding ID: 1320\n",
      "Add of existing embedding ID: 1320\n",
      "Insert of existing embedding ID: 1321\n",
      "Add of existing embedding ID: 1321\n",
      "Insert of existing embedding ID: 1322\n",
      "Add of existing embedding ID: 1322\n",
      "Insert of existing embedding ID: 1323\n",
      "Add of existing embedding ID: 1323\n",
      "Insert of existing embedding ID: 1324\n",
      "Add of existing embedding ID: 1324\n",
      "Insert of existing embedding ID: 1325\n",
      "Add of existing embedding ID: 1325\n",
      "Insert of existing embedding ID: 1326\n",
      "Add of existing embedding ID: 1326\n",
      "Insert of existing embedding ID: 1327\n",
      "Add of existing embedding ID: 1327\n",
      "Insert of existing embedding ID: 1328\n",
      "Add of existing embedding ID: 1328\n",
      "Insert of existing embedding ID: 1329\n",
      "Add of existing embedding ID: 1329\n",
      "Insert of existing embedding ID: 1330\n",
      "Add of existing embedding ID: 1330\n",
      "Insert of existing embedding ID: 1331\n",
      "Add of existing embedding ID: 1331\n",
      "Insert of existing embedding ID: 1332\n",
      "Add of existing embedding ID: 1332\n",
      "Insert of existing embedding ID: 1333\n",
      "Add of existing embedding ID: 1333\n",
      "Insert of existing embedding ID: 1334\n",
      "Add of existing embedding ID: 1334\n",
      "Insert of existing embedding ID: 1335\n",
      "Add of existing embedding ID: 1335\n",
      "Insert of existing embedding ID: 1336\n",
      "Add of existing embedding ID: 1336\n",
      "Insert of existing embedding ID: 1337\n",
      "Add of existing embedding ID: 1337\n",
      "Insert of existing embedding ID: 1338\n",
      "Add of existing embedding ID: 1338\n",
      "Insert of existing embedding ID: 1339\n",
      "Add of existing embedding ID: 1339\n",
      "Insert of existing embedding ID: 1340\n",
      "Add of existing embedding ID: 1340\n",
      "Insert of existing embedding ID: 1341\n",
      "Add of existing embedding ID: 1341\n",
      "Insert of existing embedding ID: 1342\n",
      "Add of existing embedding ID: 1342\n",
      "Insert of existing embedding ID: 1343\n",
      "Add of existing embedding ID: 1343\n",
      "Insert of existing embedding ID: 1344\n",
      "Add of existing embedding ID: 1344\n",
      "Insert of existing embedding ID: 1345\n",
      "Add of existing embedding ID: 1345\n",
      "Insert of existing embedding ID: 1346\n",
      "Add of existing embedding ID: 1346\n",
      "Insert of existing embedding ID: 1347\n",
      "Add of existing embedding ID: 1347\n",
      "Insert of existing embedding ID: 1348\n",
      "Add of existing embedding ID: 1348\n",
      "Insert of existing embedding ID: 1349\n",
      "Add of existing embedding ID: 1349\n",
      "Insert of existing embedding ID: 1350\n",
      "Add of existing embedding ID: 1350\n",
      "Insert of existing embedding ID: 1351\n",
      "Add of existing embedding ID: 1351\n",
      "Insert of existing embedding ID: 1352\n",
      "Add of existing embedding ID: 1352\n",
      "Insert of existing embedding ID: 1353\n",
      "Add of existing embedding ID: 1353\n",
      "Insert of existing embedding ID: 1354\n",
      "Add of existing embedding ID: 1354\n",
      "Insert of existing embedding ID: 1355\n",
      "Add of existing embedding ID: 1355\n",
      "Insert of existing embedding ID: 1356\n",
      "Add of existing embedding ID: 1356\n",
      "Insert of existing embedding ID: 1357\n",
      "Add of existing embedding ID: 1357\n",
      "Insert of existing embedding ID: 1358\n",
      "Add of existing embedding ID: 1358\n",
      "Insert of existing embedding ID: 1359\n",
      "Add of existing embedding ID: 1359\n",
      "Insert of existing embedding ID: 1360\n",
      "Add of existing embedding ID: 1360\n",
      "Insert of existing embedding ID: 1361\n",
      "Add of existing embedding ID: 1361\n",
      "Insert of existing embedding ID: 1362\n",
      "Add of existing embedding ID: 1362\n",
      "Insert of existing embedding ID: 1363\n",
      "Add of existing embedding ID: 1363\n",
      "Insert of existing embedding ID: 1364\n",
      "Add of existing embedding ID: 1364\n",
      "Insert of existing embedding ID: 1365\n",
      "Add of existing embedding ID: 1365\n",
      "Insert of existing embedding ID: 1366\n",
      "Add of existing embedding ID: 1366\n",
      "Insert of existing embedding ID: 1367\n",
      "Add of existing embedding ID: 1367\n",
      "Insert of existing embedding ID: 1368\n",
      "Add of existing embedding ID: 1368\n",
      "Insert of existing embedding ID: 1369\n",
      "Add of existing embedding ID: 1369\n",
      "Insert of existing embedding ID: 1370\n",
      "Add of existing embedding ID: 1370\n",
      "Insert of existing embedding ID: 1371\n",
      "Add of existing embedding ID: 1371\n",
      "Insert of existing embedding ID: 1372\n",
      "Add of existing embedding ID: 1372\n",
      "Insert of existing embedding ID: 1373\n",
      "Add of existing embedding ID: 1373\n",
      "Insert of existing embedding ID: 1374\n",
      "Add of existing embedding ID: 1374\n",
      "Insert of existing embedding ID: 1375\n",
      "Add of existing embedding ID: 1375\n",
      "Insert of existing embedding ID: 1376\n",
      "Add of existing embedding ID: 1376\n",
      "Insert of existing embedding ID: 1377\n",
      "Add of existing embedding ID: 1377\n",
      "Insert of existing embedding ID: 1378\n",
      "Add of existing embedding ID: 1378\n",
      "Insert of existing embedding ID: 1379\n",
      "Add of existing embedding ID: 1379\n",
      "Insert of existing embedding ID: 1380\n",
      "Add of existing embedding ID: 1380\n",
      "Insert of existing embedding ID: 1381\n",
      "Add of existing embedding ID: 1381\n",
      "Insert of existing embedding ID: 1382\n",
      "Add of existing embedding ID: 1382\n",
      "Insert of existing embedding ID: 1383\n",
      "Add of existing embedding ID: 1383\n",
      "Insert of existing embedding ID: 1384\n",
      "Add of existing embedding ID: 1384\n",
      "Insert of existing embedding ID: 1385\n",
      "Add of existing embedding ID: 1385\n",
      "Insert of existing embedding ID: 1386\n",
      "Add of existing embedding ID: 1386\n",
      "Insert of existing embedding ID: 1387\n",
      "Add of existing embedding ID: 1387\n",
      "Insert of existing embedding ID: 1388\n",
      "Add of existing embedding ID: 1388\n",
      "Insert of existing embedding ID: 1389\n",
      "Add of existing embedding ID: 1389\n",
      "Insert of existing embedding ID: 1390\n",
      "Add of existing embedding ID: 1390\n",
      "Insert of existing embedding ID: 1391\n",
      "Add of existing embedding ID: 1391\n",
      "Insert of existing embedding ID: 1392\n",
      "Add of existing embedding ID: 1392\n",
      "Insert of existing embedding ID: 1393\n",
      "Add of existing embedding ID: 1393\n",
      "Insert of existing embedding ID: 1394\n",
      "Add of existing embedding ID: 1394\n",
      "Insert of existing embedding ID: 1395\n",
      "Add of existing embedding ID: 1395\n",
      "Insert of existing embedding ID: 1396\n",
      "Add of existing embedding ID: 1396\n",
      "Insert of existing embedding ID: 1397\n",
      "Add of existing embedding ID: 1397\n",
      "Insert of existing embedding ID: 1398\n",
      "Add of existing embedding ID: 1398\n",
      "Insert of existing embedding ID: 1399\n",
      "Add of existing embedding ID: 1399\n",
      "Insert of existing embedding ID: 1400\n",
      "Add of existing embedding ID: 1400\n",
      "Insert of existing embedding ID: 1401\n",
      "Add of existing embedding ID: 1401\n",
      "Insert of existing embedding ID: 1402\n",
      "Add of existing embedding ID: 1402\n",
      "Insert of existing embedding ID: 1403\n",
      "Add of existing embedding ID: 1403\n",
      "Insert of existing embedding ID: 1404\n",
      "Add of existing embedding ID: 1404\n",
      "Insert of existing embedding ID: 1405\n",
      "Add of existing embedding ID: 1405\n",
      "Insert of existing embedding ID: 1406\n",
      "Add of existing embedding ID: 1406\n",
      "Insert of existing embedding ID: 1407\n",
      "Add of existing embedding ID: 1407\n",
      "Insert of existing embedding ID: 1408\n",
      "Add of existing embedding ID: 1408\n",
      "Insert of existing embedding ID: 1409\n",
      "Add of existing embedding ID: 1409\n",
      "Insert of existing embedding ID: 1410\n",
      "Add of existing embedding ID: 1410\n",
      "Insert of existing embedding ID: 1411\n",
      "Add of existing embedding ID: 1411\n",
      "Insert of existing embedding ID: 1412\n",
      "Add of existing embedding ID: 1412\n",
      "Insert of existing embedding ID: 1413\n",
      "Add of existing embedding ID: 1413\n",
      "Insert of existing embedding ID: 1414\n",
      "Add of existing embedding ID: 1414\n",
      "Insert of existing embedding ID: 1415\n",
      "Add of existing embedding ID: 1415\n",
      "Insert of existing embedding ID: 1416\n",
      "Add of existing embedding ID: 1416\n",
      "Insert of existing embedding ID: 1417\n",
      "Add of existing embedding ID: 1417\n",
      "Insert of existing embedding ID: 1418\n",
      "Add of existing embedding ID: 1418\n",
      "Insert of existing embedding ID: 1419\n",
      "Add of existing embedding ID: 1419\n",
      "Insert of existing embedding ID: 1420\n",
      "Add of existing embedding ID: 1420\n",
      "Insert of existing embedding ID: 1421\n",
      "Add of existing embedding ID: 1421\n",
      "Insert of existing embedding ID: 1422\n",
      "Add of existing embedding ID: 1422\n",
      "Insert of existing embedding ID: 1423\n",
      "Add of existing embedding ID: 1423\n",
      "Insert of existing embedding ID: 1424\n",
      "Add of existing embedding ID: 1424\n",
      "Insert of existing embedding ID: 1425\n",
      "Add of existing embedding ID: 1425\n",
      "Insert of existing embedding ID: 1426\n",
      "Add of existing embedding ID: 1426\n",
      "Insert of existing embedding ID: 1427\n",
      "Add of existing embedding ID: 1427\n",
      "Insert of existing embedding ID: 1428\n",
      "Add of existing embedding ID: 1428\n",
      "Insert of existing embedding ID: 1429\n",
      "Add of existing embedding ID: 1429\n",
      "Insert of existing embedding ID: 1430\n",
      "Add of existing embedding ID: 1430\n",
      "Insert of existing embedding ID: 1431\n",
      "Add of existing embedding ID: 1431\n",
      "Insert of existing embedding ID: 1432\n",
      "Add of existing embedding ID: 1432\n",
      "Insert of existing embedding ID: 1433\n",
      "Add of existing embedding ID: 1433\n",
      "Insert of existing embedding ID: 1434\n",
      "Add of existing embedding ID: 1434\n",
      "Insert of existing embedding ID: 1435\n",
      "Add of existing embedding ID: 1435\n",
      "Insert of existing embedding ID: 1436\n",
      "Add of existing embedding ID: 1436\n",
      "Insert of existing embedding ID: 1437\n",
      "Add of existing embedding ID: 1437\n",
      "Insert of existing embedding ID: 1438\n",
      "Add of existing embedding ID: 1438\n",
      "Insert of existing embedding ID: 1439\n",
      "Add of existing embedding ID: 1439\n",
      "Insert of existing embedding ID: 1440\n",
      "Add of existing embedding ID: 1440\n",
      "Insert of existing embedding ID: 1441\n",
      "Add of existing embedding ID: 1441\n",
      "Insert of existing embedding ID: 1442\n",
      "Add of existing embedding ID: 1442\n",
      "Insert of existing embedding ID: 1443\n",
      "Add of existing embedding ID: 1443\n",
      "Insert of existing embedding ID: 1444\n",
      "Add of existing embedding ID: 1444\n",
      "Insert of existing embedding ID: 1445\n",
      "Add of existing embedding ID: 1445\n",
      "Insert of existing embedding ID: 1446\n",
      "Add of existing embedding ID: 1446\n"
     ]
    }
   ],
   "source": [
    "from sklearn.feature_extraction.text import TfidfVectorizer\n",
    "from sklearn.metrics.pairwise import cosine_similarity\n",
    "\n",
    "# Create a TF-IDF vectorizer\n",
    "vectorizer = TfidfVectorizer()\n",
    "\n",
    "# Fit and transform the documents to get embeddings\n",
    "embeddings = vectorizer.fit_transform(extracted_rules).toarray()\n",
    "\n",
    "# Store the documents and their embeddings in ChromaDB\n",
    "for i, (doc, embedding) in enumerate(zip(extracted_rules, embeddings)):\n",
    "    chroma_collection.add(\n",
    "        ids=[str(i)],\n",
    "        embeddings=[embedding.tolist()],\n",
    "        metadatas=[{\"text\": doc}]\n",
    "    )\n",
    "\n",
    "# Define the query context\n",
    "query_context = \"The fuel tank must be securely attached.\"\n",
    "\n",
    "# Transform the query context to get its embedding\n",
    "query_embedding = vectorizer.transform([query_context]).toarray()\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Top-k Retrieval and Context Generation\n",
    "\n",
    "For creating the context we can use the top-k retrieved chunks and concatenate them to form the context. Below, there is an example of how the context can be generated."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "The top 5 retrieved chunks are:\n",
      "\n",
      "\n",
      "D9.1.7 Acceleration Skidpad Autocross Endurance Trackdrive\n",
      "DOO 2 s 0.2 s 2 s 2 s 2 s\n",
      "OC DNF DNF 10 s 10 s 10 s\n",
      "USS DNF DNF DNF n/a −50 points\n",
      "\n",
      "D9.1.8 DNF equals zero points for that run.\n",
      "\n",
      "S2.9.2 The judges will not evaluate any vehicle that is presented at the cost and manufacturing event,\n",
      "in what they consider to be an unfinished state and will award zero points for the entire event.\n",
      "\n",
      "S3.5.2 The judges will not evaluate any vehicle that is presented at the design event in what they\n",
      "consider to be an unfinished state and will award zero points for the entire design event.\n",
      "\n",
      "D9.1.11 Each run with an incorrect number of laps at skidpad is classified as DNF.\n",
      "\n"
     ]
    }
   ],
   "source": [
    "def get_top_k_retrieved_chunks(query, chroma_collection, top_k=5, display_results=False):\n",
    "    # 1. embed the query\n",
    "    query_embedding = vectorizer.transform([query]).toarray()\n",
    "\n",
    "    # 2. query the collection\n",
    "    top_k = 5\n",
    "    results = chroma_collection.query(query_embeddings=query_embedding, n_results=top_k)\n",
    "\n",
    "    # 3. get the results\n",
    "    top_k_retrieved_chunks = []\n",
    "    if display_results:\n",
    "        print(f\"The top {top_k} retrieved chunks are:\\n\\n\")\n",
    "    for metadata in results[\"metadatas\"][0]:\n",
    "        top_k_retrieved_chunks.append(metadata[\"text\"])\n",
    "        if display_results:\n",
    "            print(metadata[\"text\"]+ \"\\n\")\n",
    "\n",
    "    return top_k_retrieved_chunks\n",
    "\n",
    "\n",
    "_ = get_top_k_retrieved_chunks(\"What is DNF?\", chroma_collection, display_results=True)\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Prompt-based Generation\n",
    "\n",
    "Now, putting it all together, we can create a Retrieval Augmented Generation (RAG) pipeline for question answering. We can use the prompt-based generation to generate the answer based on the context generated from the top-k retrieved chunks."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 36,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "c:\\Users\\Chris\\Documents\\LLM_RAG\\venv\\lib\\site-packages\\transformers\\pipelines\\question_answering.py:391: FutureWarning: Passing a list of SQuAD examples to the pipeline is deprecated and will be removed in v5. Inputs should be passed using the `question` and `context` keyword arguments instead.\n",
      "  warnings.warn(\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "{'score': 0.19868534803390503, 'start': 106, 'end': 128, 'answer': 'must not exceed 200 ms'}\n"
     ]
    }
   ],
   "source": [
    "QUERY = \"What are the requirements for the emergency break system regarding opening of the SDC and start of deceleration?\"\n",
    "\n",
    "# Get the top k retrieved chunks\n",
    "top_k_retrieved_chunks = get_top_k_retrieved_chunks(QUERY, chroma_collection, top_k=10)\n",
    "\n",
    "# extend the context with the top k retrieved chunks\n",
    "# and get the answer\n",
    "QA_input = {\n",
    "    'question': QUERY,\n",
    "    # context with \\n separator\n",
    "    'context': \"\\n\".join(top_k_retrieved_chunks)\n",
    "}\n",
    "res = question_answering_pipeline(QA_input)\n",
    "\n",
    "print(res)\n",
    "\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "# extend the context with the top k retrieved chunks\n",
    "# and get the answer\n",
    "\n",
    "\n",
    "print(res)\n",
    "messages = [\n",
    "    {\"role\": \"system\", \"content\": \"Here is some information about Formula Student rules. : \" + \"\\n\".join(top_k_retrieved_chunks)},\n",
    "    {\"role\": \"user\", \"content\": QUERY},\n",
    "]\n",
    "res = mistral_pipeline(messages)\n",
    "print(res)\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 41,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "Hardware accelerator e.g. GPU is available in the environment, but no `device` argument is passed to the `Pipeline` object. Model will be on CPU.\n",
      "Setting `pad_token_id` to `eos_token_id`:None for open-end generation.\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "[{'generated_text': 'Given the Formula Student Rules T15.4.1 The system reaction time (the time between opening of the SDC and the start of the decelera\\x02tion) must not exceed 200 ms.\\nT11.6.2 The action of opening the SDC must occur if the implausibility is persistent for more than\\n500 ms.\\nT4.1.1 The size of the cockpit opening needs to be sufficient for the template shown on the left of\\nfigure 12 to pass vertically from the cockpit opening to below the upper side impact member\\nwhen held horizontally. The template may be moved fore and aft.\\nEV6.1.5 If the SDC is opened the TS must be shut down by opening all AIRs and the voltage in the\\nTS must drop to below 60 VDC and 50 VACRMS in less than 5 s. All accumulator current\\nflow must stop immediately.\\nThe action of opening the AIRs may be delayed by ≤250 ms to signal the action to the motor\\ncontrollers and reduce the TS current before the AIRs are opened. The AIR supply must be\\nabruptly switched off before reaching the minimum AIR supply voltage.\\nCV1.2.2 For autonomous operation, the vehicle must be equipped with an additional engine start\\nbutton next to the LVMS, see T11.3, that can be easily actuated from outside the vehicle.\\nUsing the external engine start button, the engine may only start if\\n• the ASMS (see T14.6) is switched on and\\n• the gearbox is in neutral. Answer the question: What are the requirements for the emergency break system regarding opening of the SDC and start of deceleration? Answer \"a. The engine must be started, at least for the next 300 ms.\\n•B. The ASMS must be manually activated when the engine is not\\n•Active. C. Each stop of the SDC must be independently activated by turning the gearbox or by\\n•V, if the ASMS is not in neutral and is connected\\n•Bypassing the SDC. E. The ASMS stop\\n* must, when activated, be connected to a power source which\\n*is available at the engine\\'s\\ninitiator. F. Each motor or\\ntransmission can be started while the engine is operating and used.\\nT4.1.2 The action of opening the SDC must be continuous if\\n1) air pressure is greater than or equal to the temperature of air at the ground level after the\\n·seam of the VACRMS (see\\n2) has changed or\\n2) air pressure cannot have changed below the'}]"
      ]
     },
     "execution_count": 41,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Use a pipeline as a high-level helper\n",
    "from transformers import pipeline\n",
    "\n",
    "pipe = pipeline(\"text-generation\", model=\"openai-community/gpt2\", max_new_tokens=200)\n",
    "\n",
    "pipe(\"Given the Formula Student Rules \" + \"\\n\".join(top_k_retrieved_chunks) + f\" Answer the question: {QUERY}\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "venv",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.10.10"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}