Skip to content

Issues: kvcache-ai/ktransformers

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

445 Open 261 Closed
445 Open 261 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

源码编译问题
#997 opened Mar 29, 2025 by 1556900941lizerui
Ktransformers是否支持deepseek-v3的function calling
#994 opened Mar 28, 2025 by ruralharry
6
[Bug] 海光DCU运行中模型胡言乱语
#992 opened Mar 28, 2025 by yeungtuzi
5 tasks done
8
怎么样运行新的V3 0324
#989 opened Mar 28, 2025 by 113514089
10
[Bug] V100运行DeepSeek-R1-Q2_K 报错
#988 opened Mar 28, 2025 by Weishaoya
5 tasks
2
运行Deepseek R1 K4的V0.3的测试报错
#985 opened Mar 27, 2025 by lixivip
1
[Bug] AttributeError: 'DeepseekV3Config' object has no attribute 'seq_aux'
#983 opened Mar 27, 2025 by CookiePPP
5 tasks done
12
1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/kvcache-ai/ktransformers/discussions. Otherwise, it will be closed.
#982 opened Mar 26, 2025 by Dogggggggggg
Deleted
#981 opened Mar 26, 2025 by Dogggggggggg
2 tasks
[Feature] 多进程CPU、GPU流水
#977 opened Mar 26, 2025 by ltcs11
2 tasks
加载完聊天报错
#976 opened Mar 26, 2025 by motu001
1
[Bug] FileNotFoundError: [Errno 2] No such file or directory: '.../ktransformers/lib/python3.11/site-packages/ktransformers/website/dist/config.js'
#975 opened Mar 25, 2025 by devinliswe
1 of 5 tasks
[Feature] wish next version of KT fix local_chat.py for support OPENAI chat
#972 opened Mar 25, 2025 by CYSTEV-chn
2 tasks done
2
Tesla P100一直跑不起来，能成功加载模型到出现chat的界面，但是一提交prompt就报错。torch,vision,audio是本地编译的，有指定架构，全部都单独测试过没问题。是ktransformers这边需要配置什么吗？求大佬们指教
#971 opened Mar 24, 2025 by 2203476
4
[Feature] 腾讯的llama-mmap.cpp优化，是否可以参考
#969 opened Mar 24, 2025 by yeungtuzi
2 tasks
@chenht2022
1
在ragflow中模型提供商使用ollama，报错Non-streaming chat is not implement。
#967 opened Mar 24, 2025 by Zzzer0o
1
@qiyuxinlin
1
满血的q4km 的智商还是很低吗。
#966 opened Mar 24, 2025 by 113514089
8
[Bug] Mixtral inference encounters error about tensor location
#963 opened Mar 23, 2025 by pl752
5 tasks done
6
[Bug] DeepSeekV2 lite config has cpu device assigned to KLinearMarlin
#962 opened Mar 23, 2025 by pl752
5 tasks done
[Bug] (flashinfer) Mixtral inference with flashinfer encounters missing 'kv_lora_rank' attribute when using flashinfer
#961 opened Mar 23, 2025 by pl752
5 tasks done
1
[Bug] DeepSeek R1 Q4_K_M failed on dual 3080ti with version v0.2.3 due to CUDA OOM
#960 opened Mar 23, 2025 by windr00
1 of 5 tasks
5
[Feature] deepseek-r1 671b太大了，有deepseek-v2-lite成功安装的流程吗？
#958 opened Mar 22, 2025 by blockcloud
2 tasks
4
显卡上接了个显示器，输出到14token了，有谁知道什么原因吗。
#952 opened Mar 21, 2025 by 113514089
8
deepseek-r1 671B 满血版配置
#951 opened Mar 21, 2025 by 1556900941lizerui
3
[Bug] RuntimeError: CUDA error: invalid device function
#949 opened Mar 21, 2025 by Z27-DSR1
5 tasks
@Atream
ProTip! Add no:assignee to see everything that’s not assigned.