Groq API problems with micro agent

[mackimart1]

I've been trying to solve this issue to be able to use Groq API with micro-agent, I've made .bat and even .py scripts to try to run the API/ LLM model correctly but no avail, I'm very interested in this project and would love to see how we can improve and grow, any assistance would be great thank you for your time.

C:\Users\USER>micro-agent config set OPENAI_API_ENDPOINT=*******
(node:28380) [DEP0040] DeprecationWarning: The punycode module is deprecated. Please use a userland alternative instead.
(Use node --trace-deprecation ... to show where the warning was created)
|
— Config updated ✅

C:\Users\user>micro-agent config set OPENAI_API_ENDPOINT=https://api.groq.com/openai/v1
(node:22840) [DEP0040] DeprecationWarning: The punycode module is deprecated. Please use a userland alternative instead.
(Use node --trace-deprecation ... to show where the warning was created)
|
— Config updated ✅

C:\Users\user>micro-agent config set MODEL=llama3-8b-8192
(node:31152) [DEP0040] DeprecationWarning: The punycode module is deprecated. Please use a userland alternative instead.
(Use node --trace-deprecation ... to show where the warning was created)
|
— Config updated ✅

C:\Users\user>micro-agent
(node:26400) [DEP0040] DeprecationWarning: The punycode module is deprecated. Please use a userland alternative instead.
(Use node --trace-deprecation ... to show where the warning was created)

T 🦾 Micro Agent
|
o What would you like to do?
| I want to improve my neural network
|

✖ model 'llama3-8b-8192' not found, try pulling it first
at checkOk (file:///C:/Users/user/AppData/Roaming/npm/node_modules/@builder.io/micro-agent/node_modules/ollama/dist/shared/ollama.d8c046e0.mjs:70:9)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async post (file:///C:/Users/user/AppData/Roaming/npm/node_modules/@builder.io/micro-agent/node_modules/ollama/dist/shared/ollama.d8c046e0.mjs:117:3)
at async Ollama.processStreamableRequest (file:///C:/Users/user/AppData/Roaming/npm/node_modules/@builder.io/micro-agent/node_modules/ollama/dist/shared/ollama.d8c046e0.mjs:229:25)
at async getSimpleCompletion (file:///C:/Users/user/AppData/Roaming/npm/node_modules/@builder.io/micro-agent/dist/cli.mjs:1034:22)
at async getFileSuggestion (file:///C:/Users/user/AppData/Roaming/npm/node_modules/@builder.io/micro-agent/dist/cli.mjs:949:9)
at async interactiveMode (file:///C:/Users/user/AppData/Roaming/npm/node_modules/@builder.io/micro-agent/dist/cli.mjs:730:33)
at async file:///C:/Users/user/AppData/Roaming/npm/node_modules/@builder.io/micro-agent/dist/cli.mjs:1712:11

ai-shell v0.1.3

Please open a Bug report with the information above:
https://github.com/BuilderIO/micro-agent/issues/new

x Canceled
"

[steve8708]

what is your OPENAI_API_ENDPOINT? for groq it needs to be https://api.groq.com/openai/v1

[qaribhaider]

@steve8708 I guess I can see the url in the reported bug as well, which is the same url as in the documents. But to confirm I faced the same issue, here are the steps to reproduce this:

npm install -g @builder.io/micro-agent
micro-agent config set OPENAI_KEY=************
micro-agent config set MODEL=llama3-8b-8192
micro-agent config set OPENAI_API_ENDPOINT=https://api.groq.com/openai/v1
│
└  Config updated ✅

│
└  Config updated ✅

│
└  Config updated ✅
micro-agent                                                                               

┌  🦾 Micro Agent
│
◇  What would you like to do?
│  A function that returns whether a given number is even or odd
│

✖ model "llama3-8b" not found, try pulling it first

I tried changing the model as well, but to no avail.

[karim0sec]

I face same issue the only model that works for me in groq is mixtral:8x22b even those I have access for almost every model on groq I verify that by request all model and test them with curl working fine
Micro-agent have absolute big potential if support Every model includes Gemini and upcoming xAi
I hope pro programmers pay attention repo this will save them much effort, also it lake of documentation and no warnings of missing dependencies or packages messages and install them manually a bit annoying I'll try to help as much as I can