Welcome to Incremental Social! Learn more about this project here!
Check out lemmyverse to find more communities to join from here!

@Killer_Tree@sh.itjust.works avatar

Killer_Tree

@Killer_Tree@sh.itjust.works

This profile is from a federated server and may be incomplete. Browse more on the original instance.

Killer_Tree ,
@Killer_Tree@sh.itjust.works avatar

When a car crashes, there's usually a magnitude less people impacted then when a plane crashes. But you know what? Air travel is still much, much safer than car travel. Large but infrequent incidents can be much less dangerous than smaller but more common incidents in the aggregate.

Killer_Tree ,
@Killer_Tree@sh.itjust.works avatar

Any master craftsman will tell you they are nothing without their tools.

Killer_Tree ,
@Killer_Tree@sh.itjust.works avatar

Beautiful take on the Arrogant Worms classic! <3

Killer_Tree ,
@Killer_Tree@sh.itjust.works avatar

You can, and it's easier than you might think! Check out a platform like Oobabooga and find a nice 4-bit quantized LLM of a flavor you prefer. Check out TheBloke on hugging face, they quantized a ton of great LLMs.

Killer_Tree ,
@Killer_Tree@sh.itjust.works avatar

Exactly! If you only want to use a Large Language Model (LLM) to run your own local chatbot, then using a quantized version will dramatically improve speed and performance. It also allows consumer hardware to run larger models which would otherwise be prohibitively resource intensive.

Killer_Tree ,
@Killer_Tree@sh.itjust.works avatar

ICQ... Now there's a name I haven't heard in a long time. I used to use the crap out of that service, but I can't for the life of me recall what killed it anymore than I can recall migrating from AIM.

  • All
  • Subscribed
  • Moderated
  • Favorites
  • random
  • incremental_games
  • meta
  • All magazines