-
Notifications
You must be signed in to change notification settings - Fork 45
Issues: ModelCloud/GPTQModel
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
[BUG] [CPU Memory OOM] DeekSpeek R1 got os oom-kill when packing model.layers
bug
Something isn't working
#1355
opened Feb 27, 2025 by
ShiningMaker
[BUG] pip install ... Running setup.py install for gptqmodel ... error
bug
Something isn't working
#1330
opened Feb 22, 2025 by
git9875
[DOC] All of the Quantization Examples have wrong reference to
backends.
#1296
opened Feb 18, 2025 by
ColumbusAI
[BUG] 3bit quant and/or inference regression vs AutoGPTQ
bug
Something isn't working
#1278
opened Feb 14, 2025 by
sidhantls
How would I do a calibration data for a lyrics2music model?
#1214
opened Feb 4, 2025 by
alisson-anjos
[BUG] Bitblas Kernel not compatbile with bitblas > 0.0.1-dev13
bug
Something isn't working
#1192
opened Jan 31, 2025 by
Qubitium
[BUG] Quantized MoE model is generating invalid repsonse
bug
Something isn't working
#991
opened Jan 2, 2025 by
BodhiHu
Fix Qwen docs about gptq quantization quality + sharding + bad quants + autogptq
#817
opened Dec 11, 2024 by
Qubitium
[INTEGRATION] Expose stable kernel/packing/repacking apis
bug
Something isn't working
#726
opened Dec 3, 2024 by
wenhuach21
[FEATURE] Add Something isn't working
dynamic suppor for AutoRound quantiztion
bug
#329
opened Aug 2, 2024 by
Qubitium
ProTip!
Exclude everything labeled
bug with -label:bug.