support layer decay and different lr for text/visual encoder#268

Open

Quan-Sun wants to merge 7 commits intomlfoundations:mainfrom Quan-Sun:feat-layer-decay

Commits on Nov 29, 2022

support layer decay and different lr for text/visual encoder
quansun
committed

Commits on Dec 10, 2022

fix: wrong lr_scale to different layers
Sun Quan
committed
fix: add visual./text. to param name
Sun Quan
committed

Commits on Dec 13, 2022

getting lr_scale_assigner out of main & moving the exponent logic inside the Assigner class
Quan-Sun
committed

Commits on Dec 22, 2022

Commits on Dec 23, 2022

Clean up and fix weight decay assignment
gabrielilharco
committed