-
Notifications
You must be signed in to change notification settings - Fork 31.8k
[GLM-Image] AR Model Support for GLM-Image #43100
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from 130 commits
Commits
Show all changes
155 commits
Select commit
Hold shift + click to select a range
11d759c
only test
zRzRzRzRzRzRzR 10fc39e
Merge branch 'huggingface:main' into cogview
zRzRzRzRzRzRzR 413d2f4
Merge branch 'huggingface:main' into cogview
zRzRzRzRzRzRzR cd9956c
update
zRzRzRzRzRzRzR 8e83ee7
use mrope
zRzRzRzRzRzRzR faaf33d
Merge remote-tracking branch 'upstream/main' into cogview
zRzRzRzRzRzRzR e5bd08e
new kind of impl
zRzRzRzRzRzRzR ba28d91
1
zRzRzRzRzRzRzR a136820
with vision?
zRzRzRzRzRzRzR ea57064
draft projector
zRzRzRzRzRzRzR e9f15a8
2
zRzRzRzRzRzRzR 931c643
change vit shape
zRzRzRzRzRzRzR 5873a98
use new config
zRzRzRzRzRzRzR 58ada24
no tie
zRzRzRzRzRzRzR d3b4108
1
zRzRzRzRzRzRzR d66a0ac
use video token again
zRzRzRzRzRzRzR a39cf88
1
zRzRzRzRzRzRzR 92a2322
remove video
zRzRzRzRzRzRzR 67a59cf
Update modeling_glm_image.py
zRzRzRzRzRzRzR 1da6998
1
zRzRzRzRzRzRzR cac0dc7
update
zRzRzRzRzRzRzR 52aeace
Update modeling_glm_image.py
zRzRzRzRzRzRzR 4e1eed3
update for test working
zRzRzRzRzRzRzR b4613d6
2
zRzRzRzRzRzRzR 724275b
Delete modeling_siglip_tokenizer.py
zRzRzRzRzRzRzR 8eceb91
1
zRzRzRzRzRzRzR da0d493
Delete modeling_siglip_tokenizer.py
zRzRzRzRzRzRzR 67403d2
draft of vq
zRzRzRzRzRzRzR 6f3c0c3
3
zRzRzRzRzRzRzR cff9919
2
zRzRzRzRzRzRzR dd71e05
testing
zRzRzRzRzRzRzR 14db6fc
tes1
zRzRzRzRzRzRzR 087cf3f
2
zRzRzRzRzRzRzR 0b5360d
1
zRzRzRzRzRzRzR dd10578
12
zRzRzRzRzRzRzR bb4276b
using interpolate_pos_encoding
zRzRzRzRzRzRzR 6c75bd3
vit prepare!
zRzRzRzRzRzRzR e0884b8
add processor
zRzRzRzRzRzRzR 3d48d31
Delete modeling_siglip_flux_zh.py
zRzRzRzRzRzRzR fcdfdfc
2
zRzRzRzRzRzRzR 7c34f14
input change
zRzRzRzRzRzRzR feb2bcb
add doc
zRzRzRzRzRzRzR d8823a2
Update glm_image.md
zRzRzRzRzRzRzR 1f13301
bilinear
zRzRzRzRzRzRzR 08a0078
using Qwen processing for multi image
zRzRzRzRzRzRzR 5b2b3d9
update
zRzRzRzRzRzRzR 3566f18
1
zRzRzRzRzRzRzR 34738f5
4
zRzRzRzRzRzRzR 9f4fea8
4
zRzRzRzRzRzRzR 63edc1b
work
zRzRzRzRzRzRzR 4361681
add fast processor
zRzRzRzRzRzRzR a7737b1
Update image_processing_auto.py
zRzRzRzRzRzRzR 19daabf
GlmImageVQVAEResnetBlock
zRzRzRzRzRzRzR 91bbfbb
2
zRzRzRzRzRzRzR 27970c9
2
zRzRzRzRzRzRzR c853d12
using with new position
zRzRzRzRzRzRzR dc8e246
2
zRzRzRzRzRzRzR 4b660e0
update
zRzRzRzRzRzRzR a5db1f0
1
zRzRzRzRzRzRzR d27b79f
preprocessing
zRzRzRzRzRzRzR 1878f3b
2
zRzRzRzRzRzRzR 577b923
for multi image
zRzRzRzRzRzRzR cd8d78f
2
zRzRzRzRzRzRzR a689905
for new decode
zRzRzRzRzRzRzR 6c8b1ee
format
zRzRzRzRzRzRzR 8cc46ed
doc
zRzRzRzRzRzRzR 0bb1610
Merge branch 'main' into cogview
zRzRzRzRzRzRzR 29afb44
1
zRzRzRzRzRzRzR 899c3fc
using right patch_size
zRzRzRzRzRzRzR ea58b59
fix copy?
zRzRzRzRzRzRzR 9e678ed
add para
zRzRzRzRzRzRzR f4ebfec
update
zRzRzRzRzRzRzR e3604b5
image token
zRzRzRzRzRzRzR fb07e1e
not working for fix_and_overwrite
zRzRzRzRzRzRzR 3024962
remove indentation
zRzRzRzRzRzRzR 1c940da
remove resnet
zRzRzRzRzRzRzR e67e0fa
add
zRzRzRzRzRzRzR b179db8
fix
zRzRzRzRzRzRzR 7312ed2
temporal_patch_size remove
zRzRzRzRzRzRzR 31623f9
support processor
zRzRzRzRzRzRzR 042249a
update for some test
zRzRzRzRzRzRzR 93ee4ca
Merge branch 'main' into cogview
zRzRzRzRzRzRzR 7a3b6de
2
zRzRzRzRzRzRzR 8394eb1
Merge branch 'cogview' of github.com:zRzRzRzRzRzRzR/transformers into…
zRzRzRzRzRzRzR 40c9b65
update1
zRzRzRzRzRzRzR 0f5ed53
Update modular_glm_image.py
zRzRzRzRzRzRzR 4e0784e
update2
zRzRzRzRzRzRzR 147daaf
update 2
zRzRzRzRzRzRzR 19fcd6f
3
zRzRzRzRzRzRzR 07d1942
4
zRzRzRzRzRzRzR 58453a7
rebase init weight
zRzRzRzRzRzRzR 13bc79f
check_docstrings
zRzRzRzRzRzRzR 761bd87
fix some generation tests
zucchini-nlp 091c0a0
skip the rest of tests
zucchini-nlp f309dee
add get_image_tokens
zRzRzRzRzRzRzR 6591895
unused code
zucchini-nlp 25ffbd0
Merge branch 'main' into cogview
zRzRzRzRzRzRzR 9ba7540
update for main change?
zRzRzRzRzRzRzR 68e0e15
using main typo
zRzRzRzRzRzRzR ff63ba0
fix FA2
zucchini-nlp 2c1034a
update doc
zRzRzRzRzRzRzR b0393da
push rope index update
zucchini-nlp 31151d3
GlmImageTextRotaryEmbedding
zRzRzRzRzRzRzR 300234b
Delete test.png
zRzRzRzRzRzRzR 941f875
1
zRzRzRzRzRzRzR 3cb5c54
update
zRzRzRzRzRzRzR 1c73033
3
zRzRzRzRzRzRzR 6cf7ebb
Update modular_glm_image.py
zRzRzRzRzRzRzR df6d359
Update modular_glm_image.py
zRzRzRzRzRzRzR 7063523
1
zRzRzRzRzRzRzR 80629be
simply modular
zRzRzRzRzRzRzR 998021a
Update modular_glm_image.py
zRzRzRzRzRzRzR 28baf48
doc update
zRzRzRzRzRzRzR 2b7884b
Update glmasr.md
zRzRzRzRzRzRzR 1b2b63b
Merge branch 'main' into cogview
zRzRzRzRzRzRzR 00a8e12
update attn
zRzRzRzRzRzRzR 16f77aa
make position ids shape correct but needs checking values with mult i…
zucchini-nlp 9ef5286
revert
zRzRzRzRzRzRzR 3405107
revert
zRzRzRzRzRzRzR 8184713
update
zRzRzRzRzRzRzR 8a37eeb
1
zRzRzRzRzRzRzR 526a960
1
zRzRzRzRzRzRzR 53f6a01
2
zRzRzRzRzRzRzR 8092122
must add device change
zRzRzRzRzRzRzR 4b4380e
1
zRzRzRzRzRzRzR 0886080
update
zRzRzRzRzRzRzR 5ec417e
using llama type
zRzRzRzRzRzRzR fa50824
2
zRzRzRzRzRzRzR 4c511ba
Update modular_glm_image.py
zRzRzRzRzRzRzR 4d86dc0
models can't run, fix
zucchini-nlp 33bd7a9
position ids, second try. Should work now
zucchini-nlp 90e7768
Update modular_glm_image.py
zRzRzRzRzRzRzR f334e99
remove
zRzRzRzRzRzRzR b93a714
move prompt expand inside processing
zucchini-nlp f2e9ff4
typos and tiny fixes
zucchini-nlp bf95580
make it runnable with example script
zucchini-nlp c8c723b
nit: let's follow standard API
zucchini-nlp 238d6db
using right
zRzRzRzRzRzRzR d55151e
Merge branch 'cogview' of github.com:zRzRzRzRzRzRzR/transformers into…
zRzRzRzRzRzRzR ac9cee1
update doc
zRzRzRzRzRzRzR 74a467d
update
zRzRzRzRzRzRzR 82c0530
update
zRzRzRzRzRzRzR fe7650d
resolution changed
zRzRzRzRzRzRzR fc582db
udate
zRzRzRzRzRzRzR 9468522
1
zRzRzRzRzRzRzR 34eae52
Merge branch 'main' into cogview
zRzRzRzRzRzRzR e27fd18
2
zRzRzRzRzRzRzR 2d84676
3
zRzRzRzRzRzRzR a137785
Update check_repo.py
zRzRzRzRzRzRzR d750318
skip/overwrite tests
zucchini-nlp ef3af15
Merge branch 'main' into cogview
zucchini-nlp 05510d6
Merge branch 'main' into cogview
sayakpaul 0be1887
swap h and w in position ids!
zucchini-nlp 8b3336f
Merge branch 'main' into cogview
zucchini-nlp d4350b4
require read token does not exist anymore. Wait, why is that not fixe…
zucchini-nlp File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.