Welcome to Incremental Social! Learn more about this project here! Check out lemmyverse to find more communities to join from here!
h3ndrik , 4 months ago (edited 4 months ago) kobold.cpp is easy to use, fast and I like it. If you're interested in more relevant Lemmy communities: !fosai !localllama (another option: text-generation-webui has several backends bundled. Maybe one of those works for you.)
kobold.cpp is easy to use, fast and I like it.
If you're interested in more relevant Lemmy communities:
(another option: text-generation-webui has several backends bundled. Maybe one of those works for you.)