Question about pulid repo

[moreAImore]

Sorry the repo you forked has no issue or discussion tab.
I had to write here.
First of all:

1. WHat are the changes you are implemenign btw? I am curious. I am also making changes but cant make it work corrently.
2. Here are my changes ((https://github.com/moreAImore/ComfyUI-PuLID-Flux-Enhanced-FP8))

The problem is that first generation is very fast (17 seconds for me) then, NEXT generations:

ARE VERY SLOW.

It is caused because it uses even extra GPU , for some reason. (for me it goes to the top usage, max, it slows the machine)
I must be doing something wrong.
Could you look into the code to see if there is a solutions to have?
Maybe I am not releasing things or variables I have no idea. I tried to solve it I could not.

Maybe you can?