2024-06-01
- The process of creating [Intellectual Production Techniques for Engineers Using LLM (Presentation Material)
- I created the above page and started writing.
- I started while waiting for ramen.
- Initiating is the first step in making progress.
I’ll do one pomodoro. 🍅
LENCHI_Day7 - I had LENCHI_LLM comment from a 2024 perspective. - Do you want to introduce this as it is or change it based on the latter part of the story? - Well, it’s more fun to change things up. - Fitting components is faster if you don’t have time to spare. - There’s room this time.
p.122
If you read too fast and do not understand enough, you can read again, but if you read too slow and waste time, there is no way to recover, so if you do not know the right balance, you should err on the side of fast.
🍅Detailing the second part of the story.
As for the “LENCHI_LLM commented from the perspective of 2024,” it would be more interesting to blend it in as a knowledge network, but as a one-dimensional lecture, it would become a seamless story and the audience would not be able to keep up. - Writing is one-dimensional
2024-06-04
- Inefficient to watch real-time lectures that can only be played back at 1x speed
- I wonder if the management would be confused if I said…
- No double-speed playback, no letting the AI summarize the transcription, no discussion among viewers
🍅
- “What triggered this time?” and “Is the content really valuable in the future?” Fixed the
- By actually generating the lowest level of description, I can see how you feel, even though “this is where it should end up in terms of quantity”.
🍅 cut - The Importance of Practitioner Experience in the Art of Intellectual Production
-
For more information I had LENCHI_LLM comment from a 2024 perspective.
Scrapbox
- Mentioned in a footnote on p. 175.
In the long run, the form in which humans express knowledge will also change as the expressive power of peripheral devices advances. You are in a transitional period. While you are still reading literature in print format, which is much the same as 100 years ago, you are also reading in a way that did not exist 100 years ago, i.e., finding articles that seem relevant to your interests from a large amount of digital data and following hyperlinks from those articles to gather knowledge about the surrounding area. p.107
Below are the presentation materials being prepared. Continue by making a draft draft Continued draft. Intellectual Production Techniques for Engineers Using LLM (Presentation Material) Practicing Intellectual Production with LLM Creating and utilizing custom GPTs Create a custom GPT for ChatGPT to vector search and converse with your own Scrapbox. Attempts to directly connect individuals’ knowledge base with LLM Can use my past knowledge and ideas in my interactions with LLMs New forms of intellectual production that integrate personal knowledge base and LLM Understanding and dealing with LLM constraints Derailment due to context size constraints The problem of forgetting the past when doing repeated searches Importance of giving proper context Need to understand the characteristics of LLM and get along with them Balance between divergent and convergent thinking Accelerated brainstorming with LLM is useful for divergent thinking On the other hand, how to support convergent thinking in LLM is a challenge Context wide LLMs may converge while maintaining purpose and context Combining the KJ method and LLM to support convergent thinking
Toward a New Model of Intellectual Production Possibility of fractal summarization Presenting summaries in different levels of detail allows users the flexibility to obtain the information they need Value as a tool for a “rough-and-ready” approach Summary diversity and information liquefaction Create different variations by keeping some aspects and changing others. Variations that take the form of summary levels, language, and unjargoned state chats. Pivotal transformation of information to create new knowledge Relevance to Asymmetric Reality Shared Axis Legs” and “Individually Optimized Other Legs” Structure Virtual time frame, spatial arrangement, and sentence structure are the axes. Importance of connecting content through the axis leg A new way of intellectual production that uses LLM to create diverse variations
summary The development of LLM is bringing about significant changes in intellectual production The ideas advocated by “The Engineer’s Art of Intellectual Production” continue to have value today It is important to utilize LLM while taking into account the evolution of tools and human creativity The way of learning is changing, and the ability to identify what to learn on one’s own is becoming increasingly important. Practice intellectual production while balancing divergent and convergent thinking using LLM The concepts of fractal summarization and Asymmetric Reality suggest a new paradigm in structuring and utilizing knowledge Important to continue to explore the transformative potential of intellectual production brought about by LLM and the methodologies to take advantage of it
I threw it out there with the hope of making a little progress, but surprisingly, they made it to the final summary.
- Done is better than perfect, but AI will make it Done.
- I feel like I’m overloading the Asymmetrci Reality story, but the effect is that the presentation of a slap in the face encourages the verbalization of how to improve it.
after dinner
- Feeling vaguely unwell.
- Lack of exercise!
- Let’s go walk.
🍅 I was going to let ChatGPT summarize the benefits of the electronic KJ method, but the service is down.
2024-06-05 🍅
I’ve been working on it for about 2h without a timer.
2024-06-06 Let’s go to bed. I’ll have Claude make a summary later. Let Claude organize the Scrapbox place.
(Sleeping/waking up)
Write a summary paragraph text summary
While the development of LLM has brought about significant changes in intellectual production, the ideas advocated by “The Engineer’s Art of Intellectual Production” continue to have value today. The importance of human independent intellectual activities, such as the cycle of learning and the ability to identify subjects to learn on one’s own, is rather increasing.
At the same time, there is a need to leverage LLM while taking into account the evolution of tools and unleashing human creativity. From blogs to Scrapbox, from paper KJ method to Kozaneba, personal intellectual production platforms are evolving, and new possibilities are opening up through fusion with LLM.
LLM can be used to accelerate divergent thinking and expand the knowledge base. At the same time, new models of intellectual production are being explored, including the use of LLM to support convergent thinking and the realization of “broad listening” through the development of summarization technology.
Engineers of the future will be required to use LLM appropriately and advance their own intellectual production. To do so, they will need to flexibly adopt new tools and approaches and put them into practice, while building on the ideas underlying the “Engineer’s Art of Intellectual Production.
I myself would like to continue to be at the forefront of intellectual production, utilizing Scrapbox, Custom Search, Claude 3 Opus, and other tools. I would also like to continue to explore the possibilities of intellectual production using LLM by sharing and discussing the insights gained in the process.
I hope that you, too, will face LLM with your own intellectual curiosity as a driving force and continue to learn. By doing so, we can enhance our collective intelligence and co-create a better future.
LENCHI preface, I thought I might not have enough time, but I spoke and it seemed OK, so I decided to embed it instead of a separate page
Please review the following lecture materials and point out areas that are difficult for the audience to understand and need to be reworded, and suggest what you would like to see supplemented txt. I think it would be better to supplement the wording of the following section, as it may be difficult for viewers to understand.
-
RAG (Retrieval-Augmented Generation, retrieval-enhanced generation)“.
- It would be good to add a brief explanation of the term and concept of RAG.
- E.g., “RAG is a technique for generating more specific, contextualized responses by retrieving and leveraging information from a specific database in addition to the LLM’s general knowledge.”
-
LLM for Commodities.”
- Since the term “commodity” may not be common, an explanation would be a good addition.
- E.g., “A commoditized LLM is one that has not undergone any special adjustments or additional learning with data and is in a universally available state.”
-
Zoom function.”
- It would be good to add an explanation of the specific effects of Kozaneba’s zoom feature.
- Example: “Using the zoom function, you can change the display range at will, for example, to get a bird’s eye view of the whole picture or to focus on a specific part. This makes it easier to explore the relevance of ideas.”
-
Broadcasting” and “Broad Listening.”
- It would be good to add more clarification on these two terms.
- Example: “Broadcasting refers to the one-way dissemination of information, as in broadcasting. Broad listening, on the other hand, is a new form of communication that utilizes LLM’s summarization technology to enable the opinions of many people to be heard efficiently.”
-
Context window.”
- It would be good to add a brief explanation of the term context window.
- Example: “The context window is the maximum amount of text that the LLM can process at one time. The larger this context window, the better the LLM can understand longer sentences and conversational flow and generate consistent responses.”
By adding the above explanations to these sections, the audience will be able to better understand and smoothly follow the content of the lecture. Throughout the entire lecture material, it is a good idea to include brief explanations of technical terms and new concepts.
I still can’t tell you everything in 50 minutes.
How would you add more clarity to the story about the possible changes in the activity of “reading a book”? We suggest the following additions to better explain the potential changes in the activity of “reading a book.”
Overview of traditional “read a book” activities
- He explains that the mainstream reading experience was linear: picking up a paper book and reading through it word by word.
- It presents the challenge that readers were getting the information in the order the author intended, making it difficult for them to tailor their reading to their own pace and interests.
LLMs bring about a change in “reading a book” activity.
- Explain that by using LLM, you can now summarize the content of the book and extract the parts of the book that interest you.
- Readers will be able to explore the book’s content in a non-linear fashion according to their own interests. Example: “With LLM, you can quickly find the information you want to know without having to read through the entire book. It’s as if the experience is one of acquiring knowledge through interacting with a book.”
Case Studies
- Examples of LLM-based reading support tools, such as Fractal Reader, will be presented.
- Be specific about how these tools change the “book reading” experience. For example: “Fractal Reader summarizes and presents the content of a book in different levels of detail. You can read a broad summary first, then read a more detailed summary of the parts you are interested in, and so on, at your own pace.”
Future Possibilities
- Predictions are given as to how the development of LLM will further change the “reading a book” activity.
- Suggest possibilities such as how the reading experience might become optimized for individual interests and purposes. For example: “In the future, LLM may be able to understand the interests and objectives of the reader and reorganize the book content accordingly. The result will be a personalized reading experience, as if it were written for each and every one of us.”
By explaining the changes in the activity of “reading books” in this way, by explaining the challenges of the traditional reading experience, the changes brought about by LLM, case studies, and future possibilities, we believe it will be easier for the audience to understand and have a concrete image of the activity. In addition, by mixing in examples, abstract concepts will be easier to understand.
This page is auto-translated from /nishio/LENCHI_Day8 using DeepL. If you looks something interesting but the auto-translated English is not good enough to understand it, feel free to let me know at @nishio_en. I’m very happy to spread my thought to non-Japanese readers.