feat: add configurable residual processing to reduce peak VRAM usage#239

p-e-w merged 8 commits into

p-e-w:masterp-e-w/heretic:masterfrom

magiccodingman:residual-memory-optimizationmagiccodingman/heretic:residual-memory-optimizationCopy head branch name to clipboard