Welcome to Incremental Social! Learn more about this project here! Check out lemmyverse to find more communities to join from here!
miss_brainfarts , 4 months ago I may need to lower it a bit more, yeah. Though when I try to to use offloading, I can see that vram usage doesn't increase at all. When I leave the setting at its default 100 value on the other hand, I see vram usage climb until it stops because there isn't enough of it. So I guess not all models support offloading?
I may need to lower it a bit more, yeah. Though when I try to to use offloading, I can see that vram usage doesn't increase at all.
When I leave the setting at its default 100 value on the other hand, I see vram usage climb until it stops because there isn't enough of it.
So I guess not all models support offloading?