Skip to content

[Feature request] ostris / Flex.2-preview. Open Source 8B parameter T2I Diffusion Model with universal control and inpainting support built in. #11394

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
nitinmukesh opened this issue Apr 23, 2025 · 6 comments · May be fixed by #11485
Open

[Feature request] ostris / Flex.2-preview. Open Source 8B parameter T2I Diffusion Model with universal control and inpainting support built in. #11394

nitinmukesh opened this issue Apr 23, 2025 · 6 comments · May be fixed by #11485
Labels
bug Something isn't working contributions-welcome New pipeline/model

Comments

@nitinmukesh
Copy link

nitinmukesh commented Apr 23, 2025 •
edited
Loading

It was not a bug so removed unnecessary information.

The next version of Flex.1-alpha is released.
https://huggingface.co/ostris/Flex.2-preview

The solution is provided using custom pipeline by author of model which is working. Please refer the Model card for code.

However, it will be good to have this integrated in diffusers as core function.
In future other variants of Flux schnell may appear with similar functionality.
@nitinmukesh nitinmukesh added the bug Something isn't working label Apr 23, 2025
@a-r-r-o-w
Copy link
Member

Really cool model but this looks like it'll require a new pipeline implementation to accept canny/depth/openpose and other inputs for concatenation with latents

@nitinmukesh
Copy link
Author

Thanks for the info, @a-r-r-o-w .

Please could you add New pipeline/ Community contribution tags, if someone wants to give it a go.

@nitinmukesh nitinmukesh changed the title RuntimeError: The size of tensor a (196) must match the size of tensor b (64) at non-singleton dimension 2 [Feature request] ostris / Flex.2-preview. Open Source 8B parameter Open Source 8B parameter T2I Diffusion Model with universal control and inpainting support built in. Apr 23, 2025
@nitinmukesh nitinmukesh changed the title [Feature request] ostris / Flex.2-preview. Open Source 8B parameter Open Source 8B parameter T2I Diffusion Model with universal control and inpainting support built in. [Feature request] ostris / Flex.2-preview. Open Source 8B parameter T2I Diffusion Model with universal control and inpainting support built in. Apr 23, 2025
@a-r-r-o-w
Copy link
Member

@nitinmukesh Any reason for closing this FR? We would love to support it once someone on the team has the bandwidth, but until then I think this might be nice for good first contributions, no?

@nitinmukesh
Copy link
Author

nitinmukesh commented Apr 24, 2025 •
edited
Loading

@a-r-r-o-w

My apologies, somehow my comment was not added while closing the issue.

It is working. The author provided custom_pipeline for diffusers. I tested it. It's in Model card.
https://huggingface.co/ostris/Flex.2-preview

@a-r-r-o-w
Copy link
Member

a-r-r-o-w commented Apr 24, 2025 •
edited
Loading

Oh, that's amazing! But it uses a remote pipeline, and I think it'll be an impactful model to support. Is it okay to still keep this issue open so that we can track natively adding support for it?

@nitinmukesh nitinmukesh reopened this Apr 24, 2025
@nitinmukesh
Copy link
Author

Oh absolutely. I reopened it.

@victolee0 victolee0 linked a pull request May 3, 2025 that will close this issue
Open
6 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working contributions-welcome New pipeline/model
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[feat] Add ostris / Flex.2-preview pipeline victolee0/diffusers
2 participants
@nitinmukesh @a-r-r-o-w