Skip to content

Notebook and Scripts that showcase running quantized diffusion models on consumer GPUs

License

Notifications You must be signed in to change notification settings

ariG23498/quantized-diffusion-inference

Repository files navigation

Run diffusion models on a Free Colab Tier

A collection of scripts and notebooks that show how to quantize diffusion models and run them on a free tier colab notebook. We will be using the diffusers library to handle everything diffusion and bitsandbytes for everything quantization.

How to navigate the repository?

You will find notebooks or script starting with [Quant] which signify that they will guide through the quantization model. The scripts with start with [Inf] signify inference only guides.

Description Colab Notebooks
Quantize Text to Video Generation model (CogVideoX) Open In Colab
Inference Text to Video Generation model (CogVideoX) Open In Colab
Quantize Text to Image Generation model (Stable Diffusion 3) Open In Colab
Inference Text to Image Generation model (Stable Diffusion 3) Open In Colab

About

Notebook and Scripts that showcase running quantized diffusion models on consumer GPUs

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published