is lora work on bit4 model

[al-swaiti]

hi is lora work with 4bit model !

[Enemyx-net]

Only if it is created specifically for the 4bit version.

[al-swaiti]

hhhhh how i can test this now can u ? its for vibevoice-7b my card out of vram its arabic https://huggingface.co/ABDALLALSWAITI/vibevoice-arabic-Z
(i trained it using cloud gpu )
https://wandb.ai/abedalswaity7/huggingface/runs/hqtnkgih/workspace?nw=nwuserabedalswaity7

[PioneerMNDR]

Is there any information on how to train on 4bit?
By the way, fp16 LoRA works with a 4bit model with diffusion_head and acoustic_connector disabled.