2023-10-03
nishio approach to giving AI knowledge with RAG, and how to chunk the knowledge you give it. Scrapbox is a very good possibility, though itâs an open query as far as 1: Many short pages that can be packed multiple times in a prompt page.
nishio 2: Incentive design is in place to create that âshort enriched pageâ Scrapbox is a purifier of ideas
nishio 3: âUnification of expressionsâ will be done to link to other pages, which will increase the similarity of vector searches and make it easier to hit related concepts. it will become easier to hit related concepts With tools that donât have that functionality, shaky expressions remain shaky, and Scrapbox helps you to manually converge expressions on important concepts.
nishio The combination of these things makes the âScrapbox + Vector Search + Generative AIâ system work better than expected, especially for those who aim to verbalize things that are not yet verbalized. Especially for those whose goal is to verbalize what is not yet verbalized, the acceleration effect is better than raw ChatGPT.
nishio from my own research notes vector search serves as a tool for cognitive resolution. Thatâs because the âsimilaritiesâ presented cause us to observe what weâre thinking about > from a slightly different direction.
nishio Many people may not distinguish between the two, but the process of âverbalizationâ includes âincreasing the resolution to describe the worldâ and âre-describing the understanding obtained by high-resolution observation in a form that can be conveyed to others. This is different from âincreasing the resolution to describe the worldâ and âre-describing the understanding obtained by high-resolution observation in a form that can be conveyed to othersâ, which are two different processes.
- Observing what you are thinking about from a slightly different directionâ increases Cognitive Resolution by thinking â[Similarity â What is the difference?
nishio What we talked about this time is that the former has a high acceleration effect. From the latter point of view, it appears to a third party that âyou are piecing together an unfamiliar sentence in an unfamiliar language. Thatâs correct, because by discarding the burden of the latter, we are developing it at a high speed.
nishio I came up with a good metaphor, there is a clone of my intelligence that âuses the vocabulary I write without explanationâ without explanation, and I can argue with it 24/7. This accelerates thinking, doesnât it? The â24 hoursâ is an advantage, but even more important is the fact that I donât have to say âThis word may not be understood, so let me rephrase itâŠâ
nishio How to use Scrapbox as a knowledge brewer, some âartisansâ are creating and acquiring it on their own, and how they do it is not well verbalized. How to link them (how do you link them? How to title it?)
Maybe it would be more conducive to human progress if the LLMs learn this instead of trying to verbalize it?
nishio For example, in my Scrapbox, there are pages that are âScrapbox-likeâ and pages that are ânot Scrapbox-likeâ, and there are âScrapbox-like titlesâ and ânot Scrapbox-like titlesâ. titles that arenâtâ.
This page is auto-translated from /nishio/Scrapboxă§ăźç„èéžé ăLLMă«æăă using DeepL. If you looks something interesting but the auto-translated English is not good enough to understand it, feel free to let me know at @nishio_en. Iâm very happy to spread my thought to non-Japanese readers.