Welcome to Incremental Social! Learn more about this project here! Check out lemmyverse to find more communities to join from here!
RichardoC , 1 month ago Jan.ai might be a good starting point or ollama? There's https://tales.fromprod.com/2024/111/using-your-own-hardware-for-llms.html which has some guidance for using jan.ai for both server and client
Jan.ai might be a good starting point or ollama? There's https://tales.fromprod.com/2024/111/using-your-own-hardware-for-llms.html which has some guidance for using jan.ai for both server and client