lora weight

[Ranking666]

Thank you for your great work.
But lora's weights are not fused with the original weights?

[fabawi]

not by default. You can pass the argument --full_model_checkpointing to the trainer to enable saving all the weights