Interesting neural network compression technology #461
igor-yusupov
started this conversation in
Show and tell
Replies: 1 comment
-
|
Looks interesting. Thanks for the info! |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi! I found an interesting service for running language models with 8 billion parameters on user devices. Maybe it will be useful for you and you will find some tricks for your engine: link and code
Beta Was this translation helpful? Give feedback.
All reactions