Welcome to Incremental Social! Learn more about this project here!
Check out lemmyverse to find more communities to join from here!

Sekki ,

While this will get you a selfhosted LLM it is not possible to feed data to them like this.
As far as I know there are a 2 possibilities:

  1. Take an existing model and use the literature data to fine tune the model. The success of this will depend on how much "a lot" means when it comes to the literature

  2. Create a model yourself using only your literature data

Both approaches will require some yrogramming knowledge and understanding of how a llm works. Additionally it will require a preparation of the unstructured literature data to a kind of structured data that can be used to train or fine tune the model.

Im just a CS student so not an expert in this regard ;)

  • All
  • Subscribed
  • Moderated
  • Favorites
  • selfhosted@lemmy.world
  • incremental_games
  • random
  • meta
  • All magazines