Welcome to Incremental Social! Learn more about this project here! Check out lemmyverse to find more communities to join from here!
Evotech , 1 month ago There's a few. Very easy if you set it up with Docker. Best is probably just ollama and use danswer as a frontend. Danswer will do all the RAG stuff for you. Like managing / uploading documents and so on Ollama is becoming the standard selfnhosted LLM. And you can add any models you want / can fit. https://ollama.com/blog/ollama-is-now-available-as-an-official-docker-image https://docs.danswer.dev/quickstart
There's a few.
Very easy if you set it up with Docker.
Best is probably just ollama and use danswer as a frontend. Danswer will do all the RAG stuff for you. Like managing / uploading documents and so on
Ollama is becoming the standard selfnhosted LLM. And you can add any models you want / can fit.
https://ollama.com/blog/ollama-is-now-available-as-an-official-docker-image
https://docs.danswer.dev/quickstart