For people self hosting LLMs.. I have a couple docker images I maintain
https://github.com/noneabove1182/text-generation-webui-docker (updated to 1.3.1 and has a fix for gqa to run llama2 70B)...
Welcome to Incremental Social! Learn more about this project here!
Check out lemmyverse to find more communities to join from here!