- Solved ComfyUI-PuLID-Flux model pollution problem.
- Supported use with
TeaCache
(Need use with ComfyUI_Patches_ll). - Supported use with Comfy-WaveSpeed, supported by
Comfy-WaveSpeed
in commit-36ba3c8. - Supported simple use with
First Block Cache
(Can use with ComfyUI_Patches_ll).
Must uninstall or disable ComfyUI-PuLID-Flux
and other PuLID-Flux nodes before install this plugin. Due to certain reasons, I used the same node's name ApplyPulidFlux
.
Need upgrade ComfyUI Version>=0.3.7
- Fix: when selecting a face from multiple faces as a reference, embeddings and alignment features maybe not from the same face.
- Supported selecting a face from multiple faces as a reference. Example workflow.
- Changed the model path of facexlib to
ComfyUI/models/facexlib/
. - When automatically downloading, modify the path of Antelope v2 model to
ComfyUI/models/insightface/models/antelopev2/
. - Changed the model path of EVA_CLIP_L_14_336 to
ComfyUI/models/clip/
.
- Manual
cd custom_nodes
git clone https://github.com/lldacing/ComfyUI_PuLID_Flux_ll.git
cd ComfyUI_PuLID_Flux_ll
pip install -r requirements.txt
# restart ComfyUI
Tips:
- If you use
ComfyUI_windows_portable
and encounter the following error, please see deepinsight/insightface#2576
insightface/thirdparty/face3d/mesh/cython/mesh_core_cython.cpp(36): fatal error C1083: 无法打开包括文件: “Python.h”: No such file or directory
error: command 'd:\\installed\\Microsoft Visual Studio\\2022\\BuildTools\\VC\\Tools\\MSVC\\14.42.34433\\bin\\HostX86\\x64\\cl.exe' failed with exit code 2
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for insightface
Failed to build insightface
- 32bit/16bit (~22GB VRAM): model, encoder
- 8bit gguf (~12GB VRAM): model, encoder
- 8 bit FP8 e5m2 (~12GB VRAM): model, encoder
- 8 bit FP8 e4m3fn (~12GB VRAM): model, encoder
- Clip and VAE (for all models): clip, vae
For GGUF models you will need to install ComfyUI-GGUF
- Download PuLID-Flux =>
ComfyUI/models/pulid/
. - (Support auto-download) Download EVA02-CLIP-L-14-336 =>
ComfyUI/models/clip/
. - (Support auto-download) Download all models like
*.onnx
from AntelopeV2 =>ComfyUI/models/insightface/models/antelopev2/
. - (Support auto-download) Download parsing_bisenet, parsing_parsenet and Resnet50 =>
ComfyUI/models/facexlib/
.
- PulidFluxModelLoader
- See chapter PuLID models
- PulidFluxInsightFaceLoader
- See chapter PuLID models
- PulidFluxEvaClipLoader
- See chapter PuLID models
- ApplyPulidFlux
- Solved the model pollution problem of the original plugin ComfyUI-PuLID-Flux
attn_mask
may not work correctly (I have no idea how to apply it, I have tried multiple methods and the results have been not satisfactory)works now.- If you want use with TeaCache, must put it before node
FluxForwardOverrider
andApplyTeaCachePatch
. - If you want use with Comfy-WaveSpeed, must put it before node
ApplyFBCacheOnModel
.
- FixPulidFluxPatch (Deprecated)
- If you want use with TeaCache, must link it after node
ApplyPulidFlux
, and link nodeFluxForwardOverrider
andApplyTeaCachePatch
after it.
- If you want use with TeaCache, must link it after node
- PulidFluxOptions
input_faces_order
- Sorting rule for detected bboxes.left-right
: Sort the left boundary of bbox by column from left to right.right-left
: Reverse order ofleft-right
(Sort the left boundary of bbox by column from right to left).top-bottom
: Sort the top boundary of bbox by row from top to bottom.bottom-top
: Reverse order oftop-bottom
(Sort the top boundary of bbox by row from bottom to top).small-large
: Sort the area of bbox from small to large.large-small
: Sort the area of bbox from large to small.
input_faces_index
- The target index of the sorted bboxes.input_faces_align_mode
- Choose the detection method for aligning facial features.0
: Old version method, When there is a face in an image, the selected facial embedding amount and alignment features maybe not consistent.1
: Keep the selected facial embedding amount and alignment features consistent.- There is a slight difference between the two mode, with the
align_face
value of1
resulting smaller area than theembed_face
value of0
.
- PulidFluxFaceDetector
- Can check the facial features applied in
ApplyPulidFlux
. - When
input_faces_align_mode = 0
, theembed_face
andalign_face
should be the same face, but they are generated by different detectors, and the number detected may be not consistent, so they may be not the same face. - When
input_faces_align_mode = 1
, theembed_face
andalign_face
are always the same face, they are generated by same detectors. face_bbox_image
- Draw the detected facial bounding box (the result of theembed_face
's detector).
- Can check the facial features applied in