Welcome to Incremental Social! Learn more about this project here!
Check out lemmyverse to find more communities to join from here!

ichbinjasokreativ ,

Depends on the model. Dolphin-mistral is like 4GB in size and runs on any somewhat modern cpu with reasonable performance. Larger models ofc should be run with higher end gpus at least, but even in hybrid mode (gpu+cpu) models like dolphin-mixtral (26GB) run just fine. For reference, I have a 5800x and a 6900xt, ollama installed in a distrobox container.

  • All
  • Subscribed
  • Moderated
  • Favorites
  • technology@lemmy.world
  • random
  • incremental_games
  • meta
  • All magazines