[Feature] Support vision module w8a8 inference#2308

Open

AllentDan wants to merge 7 commits intoInternLM:mainfrom AllentDan:vision-w8a8

+892-660

Commits on Aug 7, 2024

WIP
AllentDan
committed

Commits on Aug 8, 2024

add a fused layer norm kernel
AllentDan
committed

Commits on Aug 12, 2024

Tried tp=2, but accelerate can't give triton the correct cuda stream
AllentDan
committed

Commits on Aug 14, 2024

Commits on Aug 15, 2024

fix cli
AllentDan
committed
fix
AllentDan
committed