Llava Data Points Missing

[Ruining0916]

Hi Authors,

Thanks a lot for your amazing work! I wish to confirm with you that is it normal for some of the llava images are missing from zipped datasets from huggingface but required from dataloader in your code?

for example,

• data/llava_data/llava_images/vg/VG_100K_2/214.jpg
• data/llava_data/llava_images/vg/VG_100K/497987.jpg
• data/llava_data/llava_images/vg/VG_100K/285815.jpg
• ...

A lot of images are missing from the llava_images from huggingface, but your script is trying to find them?

Thanks,
Ruining

[lxtGH]

@zhang-tao-whu Check this part.

[bill-hx-liu]

@Ruining0916
Hi Ruining0916 ,

I have encountered the same issue. Could you please share if there is a solution available?

Best regards

[Ruining0916]

No, I haven't found the solution. I wonder if these images are supposed to be missing.

[bill-hx-liu]

ok，thanks！

[bill-hx-liu]

@Ruining0916
Hi Ruining0916 ,

could you tell me, what GPU model and VRAM size do you use for training for the sa2va_4b?

Best regards