Reverting the TGI image version for LLAMA multiple GPUs in GKE samples#1591

Merged

raushan2016 merged 6 commits intoGoogleCloudPlatform:mainfrom raushan2016:raushan2016/tgi-image-rollback

Jan 17, 2025

+17-5

Commits on Jan 15, 2025

The current image override the HF_HOME to /tmp from /data. Even after changing the mountpath to /tmp there is some regression in the newer TGI image which results into out of GPU memory on L4 and r…
raushan2016
committed

Commits on Jan 16, 2025

Commits on Jan 17, 2025