Welcome to Incremental Social! Learn more about this project here!
Check out lemmyverse to find more communities to join from here!

__matthew__

@__matthew__@lemmy.world

This profile is from a federated server and may be incomplete. Browse more on the original instance.

Annoyingly similar buttons with very different functions (lemmy.world)

One of the buttons laps the stopwatch, the other resets the entire session clearing all lap markers and stopping the counter. Better not forget which is which, especially given that you're probably timing something in the physical world not paying much attention to your phone...

__matthew__ OP ,

Yeah I think it's the fact that both are circular icons inside circular buttons of the same color in the same relative position. The reset icon itself is fine.

__matthew__ ,

Sorry but has anyone in this thread actually tried running local LLMs on CPU? You can easily run a 7B model at varying levels of quantization (ie. 5 bit quantization) and get a generalized prompt-able LLM. Yeah, of course it's going to take ~4GB of RAM (which is mem-mapped and paged into memory), but you can easily fine tune smaller more specific models (like the translation one mentioned above) and have surprising intelligence at a fraction of the resources.

Take, for example, phi-2 which performs as well as 13B param models but with 2.7B params. Yeah, that's still going to take 1.5GB RAM which Firefox wouldn't reasonably ship, but many lighter weight specialized tasks could easily use something like a fine tuned 0.3B model with quantization.

__matthew__ ,

Yeah, but that doesn't prevent the author from selling their extension to an untrusted buyer like in the case of Nano Adblocker.

  • All
  • Subscribed
  • Moderated
  • Favorites
  • •
  • incremental_games
  • meta
  • All magazines
    •