int8_kv_cache scale

[liquanfeng]

TensorRT-LLM/tensorrt_llm/models/llama/convert.py

Line 757 in 89ba1b1

act_range.get(prefix + 'self_attn.q_proj')["y"],

I'm puzzled as to why the act_range of q_proj is being calculated in the scale for int8_kv_cache? Because the scale is only used to quantify the output of k_proj and v_proj.

[poweiw]

Reassigning to @thorjohnsen