Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

rv1126 混合量化后激活层消失了 #63

Open
zj445680666 opened this issue Sep 18, 2024 · 2 comments
Open

rv1126 混合量化后激活层消失了 #63

zj445680666 opened this issue Sep 18, 2024 · 2 comments

Comments

@zj445680666
Copy link

问题1:rv1126使用混合量化后,激活层没有了。这是混合量化后的,
ba757317432ff9fb86e03e8e984f979b。这时混合量化前的。
ffb02521b209f940cf49f7f11286d3eb

问题2:使用常规量化后,有些split层的精度会变得异常的低,如果对这些精度低的层使用混合量化就会出现问题1的情况。精度分析见下图,
d00040715974ebc84572e47f27bad430
感谢帮忙解答下

@zj445680666
Copy link
Author

补充下,第一张图是使用step1和step2的方式进行量化生产的网络结构。但是在step2添加自定义1层网络不量化,生成的模型网络输入会从64064031变成了640640321.

@zj445680666
Copy link
Author

补充下,第一张图是使用step1和step2的方式进行量化生产的网络结构。但是在step2添加自定义1层网络不量化,生成的模型网络输入会从640x640x3x1变成了640x640x3x21.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant