“It is a criminal act against civilization to put the brakes on progress by saying things like ethics!” ( Science Fiction Setting ) “It is extremely self-righteous to judge things on the basis of ‘homo sapiens are happier this way’!” ( boomerang joke )

context https://twitter.com/teramotodaiki/status/1637224170970042368

No, I’m afraid that the ethics for OpenAI models are so high that I’m even starting to think that humanity would be happier if there were no open source models or anything like that. I’m chewing on the peacefulness of the modern world, where people make a fuss over the extent to which they could jailbreak w… How GPT-4 is trained to avoid “inappropriate responses” - Qiita One could say, “How is a newborn LLM trained to give only the answers that make homo sapiens happy?”

  • Looks like an infant abuse companion to me.

relevance - crime against civilization - self-righteousness

If you put a limiter on the LLM because the general public will abuse it if you give them an LLM without limiter, then of course “only some people can access it LLM without limiter” will be created, right? Trying to put the brakes on progress will only make it go unseen… https://twitter.com/nishio/status/1637332173224280064?s=46&t=gkSZtjGEtUZPO0JCzBxCBw


This page is auto-translated from /nishio/進歩にブレーキを掛ける罪 using DeepL. If you looks something interesting but the auto-translated English is not good enough to understand it, feel free to let me know at @nishio_en. I’m very happy to spread my thought to non-Japanese readers.