I get the following errors with any of the models #3658
distincttt
started this conversation in
Bindings
Replies: 1 comment 1 reply
|
Did you install the Python SDK with the If you are using the Python SDK without success, you may wish to consider migrating to XLlamaCPP, which is much more recent and well-supported. |
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Windows 11 operating system. Cuda paths have been added to the Paths section. I get the following errors with any of the models. Please help.
Failed to load llamamodel-mainline-cuda-avxonly.dll: LoadLibraryExW failed with error 0x7e
Failed to load llamamodel-mainline-cuda.dll: LoadLibraryExW failed with error 0x7e
I'm using the models as follows, and I get the correct result after the errors:
model = GPT4All("E:/Projects/tg-bot/models/Llama3.3-8B-Instruct-Thinking-Claude-4.5-Opus-High-Reasoning.i1-Q4_0.gguf") res = model.generate(prompt, max_tokens=2100) print(res)All reactions