Welcome to Incremental Social! Learn more about this project here! Check out lemmyverse to find more communities to join from here!
Infiltrated_ad8271 , 4 months ago I tested it with a 16GB model and barely got 1 token per second. I don't want to imagine what it would take if I used 16GB of swap instead, let alone 130GB.
I tested it with a 16GB model and barely got 1 token per second. I don't want to imagine what it would take if I used 16GB of swap instead, let alone 130GB.