Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

will to add qwen-vl ? Thanks #182

Closed
FDInSky opened this issue Oct 30, 2023 · 3 comments · Fixed by #196
Closed

will to add qwen-vl ? Thanks #182

FDInSky opened this issue Oct 30, 2023 · 3 comments · Fixed by #196

Comments

@FDInSky
Copy link

FDInSky commented Oct 30, 2023

No description provided.

@LZHgrla
Copy link
Collaborator

LZHgrla commented Oct 30, 2023

Now, we are woking on the reproduction of Llava and minigpt, (including Pre-training and fine-tuning!).
Thus, other multi-modal LLMs have not been considered yet.

However, we greatly welcome any ideas of the designing of Qwen-VL fine-tuning, such as "how to use open-source dataset formats to fine-tune Qwen-VL", "which down-stream datasets can be used to fine-tune Qwen-VL", and so on. If anyone have some thoughts, please let us know!

@FDInSky
Copy link
Author

FDInSky commented Oct 30, 2023

Now, we are woking on the reproduction of Llava and minigpt, (including Pre-training and fine-tuning!). Thus, other multi-modal LLMs have not been considered yet.

However, we greatly welcome any ideas of the designing of Qwen-VL fine-tuning, such as "how to use open-source dataset formats to fine-tune Qwen-VL", "which down-stream datasets can be used to fine-tune Qwen-VL", and so on. If anyone have some thoughts, please let us know!

When will open llava or minigpt4,we can follow them to add qwen-vl.

@LZHgrla
Copy link
Collaborator

LZHgrla commented Oct 30, 2023

@FDInSky The support of Llava is expected within about one week (at most two weeks :)), and as for the minigpt-4, we needs more time.

@LZHgrla LZHgrla closed this as completed Oct 31, 2023
@LZHgrla LZHgrla linked a pull request Nov 2, 2023 that will close this issue
16 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants