1、如何学习transformer和理解大模型: 最好的入门课程是https://github.com/rasbt/LLMs-from-scratch,PDF文档我已经放到GitHub中了。 看书敲代码,然后理解代码。
2、用coco caption的数据LoRA微调Qwen2-vl: (1)python coco_2014_caption.py (2)python data2csv.py (3)python csv2json.py (4)python train_qwen_coco_caption.py
3、动手实践DINOv2: (1)python dino_vit_s_14.py
4、动手实践Diffusion policy: (1)python diffusion_policy_state_pusht_demo.py (2)python diffusion_policy_vision_pusht_demo.py
5、ResNet+Qwen2-vl: python train_resnet.py
6、DINOv2+Qwen2-vl: python train_dinov2.py
7、Diffusion policy+DINOv2: python diffusion_policy_vision_pusht_dinov2.py
8、Diffusion+DINOv2+Qwen2-vl: python diffusion_policy_vision_pusht_dinov2_qwen_vl_2B.py