Skip to content

hzm8341/vla_tutorial

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

1、如何学习transformer和理解大模型: 最好的入门课程是https://github.com/rasbt/LLMs-from-scratch,PDF文档我已经放到GitHub中了。 看书敲代码,然后理解代码。

2、用coco caption的数据LoRA微调Qwen2-vl: (1)python coco_2014_caption.py (2)python data2csv.py (3)python csv2json.py (4)python train_qwen_coco_caption.py

3、动手实践DINOv2: (1)python dino_vit_s_14.py

4、动手实践Diffusion policy: (1)python diffusion_policy_state_pusht_demo.py (2)python diffusion_policy_vision_pusht_demo.py

5、ResNet+Qwen2-vl: python train_resnet.py

6、DINOv2+Qwen2-vl: python train_dinov2.py

7、Diffusion policy+DINOv2: python diffusion_policy_vision_pusht_dinov2.py

8、Diffusion+DINOv2+Qwen2-vl: python diffusion_policy_vision_pusht_dinov2_qwen_vl_2B.py

About

how to learn vla

Resources

License

Code of conduct

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages