Welcome to Incremental Social! Learn more about this project here!
Check out lemmyverse to find more communities to join from here!

miss_brainfarts ,

I may need to lower it a bit more, yeah. Though when I try to to use offloading, I can see that vram usage doesn't increase at all.

When I leave the setting at its default 100 value on the other hand, I see vram usage climb until it stops because there isn't enough of it.

So I guess not all models support offloading?

  • All
  • Subscribed
  • Moderated
  • Favorites
  • technology@lemmy.world
  • random
  • incremental_games
  • meta
  • All magazines