App

[valkarias]

Am on the road of creating a comfyui like app for this backend.
The goal is memory control and low-end devices. Because my PC is grumpy and I want Flux-generated goth babes.

The implementation is premature. And am by no means perceptive at optimization or coding oriented toward that.
Welcome to a design or code discussion.

(Two models setup workflow. My VRAM would never fit in 2 models. Basic automatic model release)

[stduhpf]

Is this all using the stable-diffusion.h API?

[valkarias]

No not strictly. The api does not allow for internal tensor manipulation or isolated decoding + encoding or batch processing.
I forked an older version that am tinkering with. As of writing this message, the implementation is quick and dirty. Using a mediator between the frontend and the backend to manage GGML contexts and stuff.

Locally though, I'm refactoring towards an event response system and a restructure of context management & memory.

[stduhpf]

Got it, that makes more sense. It would be neat to develop a proper lower level API to make projects like this one easier.