Request to share the pretrained heads from unsupervised pretraining #289
Description
Hey,
It is currently not possible to load the pretrained weights in the Dinov3 codebase itself and continue with unsupervised fine-tuning from there, as the pretrained heads of the unsupervised pretraining are not included. There have already been some requests by other users, and it would be a really nice addition to release them :)
Issues with this request: #203, #152, #84, #25, #23
It would be really awesome if the heads could be released, as this is right now a very limiting factor if you intend to do any unsupervised post-training with Dinov3.
Best,
Karol