Welcome to Incremental Social! Learn more about this project here!
Check out lemmyverse to find more communities to join from here!

teawrecks ,

Because it's probibalistic and in this example the user's input has been specifically crafted as the best possible jailbreak to get the output we want.

Unless we have actually appended a non-LLM filter at the end to only allow yes/no through, the possibility for it to output something other than yes/no, even though it was explicitly instructed to, is always there. Just like how in the Gab example it was told in many different ways to never repeat the instructions, it still did.

  • All
  • Subscribed
  • Moderated
  • Favorites
  • technology@beehaw.org
  • random
  • incremental_games
  • meta
  • All magazines