Welcome to Incremental Social! Learn more about this project here! Check out lemmyverse to find more communities to join from here!
itslilith , 16 days ago It's static, yes, but the static price is orders of magnitude higher. It still involves loading the whole model into VRAM and performing matrix multiplication on trillions of numbers
It's static, yes, but the static price is orders of magnitude higher. It still involves loading the whole model into VRAM and performing matrix multiplication on trillions of numbers