ChatGPT Plugins

summary

• 2023-03-24 ALPHA version of ChatGPT Plugins was released / notation shaken ChatGPT Plugin.

• 2023-04-07 They came!

• “An experimental model that knows when and how to use plugins”

  • 
  • ChatGPT Plugins Experiment
  • https://platform.openai.com/docs/plugins/introduction

  • @nishio: ChatGPT has read and responded to my book “The Intellectual Production of Engineers”!

  • 

  • nishio I think this demonstration makes it easier to understand what this tweet meant the other day

  • nishio: Since the technology is already in place, the “ability to give LLMs a knowledge package in the field you are interested in” will come down to the general consumer in the near future. When that happens, authors of new languages will create knowledge packages for LLMs, and people who want to use those languages will be able to load them into LLMs and use them.

• 2023-05-? Released to quite a lot of people.

• 2023-05-29

  • Default and Plugins in GPT-4 (ChatGPT Plugins)
    • 
  • WebPilot Plugin lets you read links and create Japanese summaries of English articles.
    • 

---

• https://platform.openai.com/docs/plugins/introduction

They recognized the plug-ins I had created!

In the meantime, I’d like to see where I interact with my plugins.

• 
• I get an error when I talk to him.
• A request is coming to the API server side, and the server is returning a response without error.
• 
• It’s a CORS issue, but the plugin itself recognizes it.
• 
• Oh, there are all sorts of headers on it.
  • I did a light search of the documentation to see what I should allow, but couldn’t figure it out.
• I was able to do it!
  • 
    • I don’t know anything about security, so I set Access-Control-Allow-Headers to *.

Create a demo that searches and answers books

• Note that if you get a YAML syntax error, it will remain loading on the screen, but will die behind the scenes, sending an error to the console.
• If it’s a light mistake, they’ll tell you on the screen.
  • 

@nishio: ChatGPT has read and responded to my book “The Intellectual Production of Engineers”!

• I think this demonstration makes it easier to understand what this tweet meant the other day.

  • @nishio: the technology is already in place and will soon come down to the average consumer “Ability to give LLMs a knowledge package of your area of interest” will come down. When that happens, authors of new languages will create knowledge packages for LLMs, and people who want to use the language will be able to load them into LLMs and use them.

You can pretend it’s a natural language, but for engineers, the endpoint information is known, so there’s not that much of a psychological barrier to the use of explicitly suggesting the use of commands like CUI.

• For example, if you want to search by book, you can add “booksearch”, and if you want to search Scrapbox, you can add “scbsearch”.

fshin2000 I know I’m asking a question I don’t understand, but… does this mean that if I pass book data as a data source through a plugin, it will be learned? I’m sorry, I don’t understand the question, but…!

• nishio To put it simply, it’s like GPT4-tan searching for a book, reading the hits, and then writing a response. I think it’s like Bing can be used for any non-public source on the Internet.

• nishio Efshin might be easier to understand if I talk about technology, so I’ll write it down, ChatGPT’s client-side JavaScript The server returns the search results in JSON, which is then sent back to GPT4’s server, where it generates a response text.

• fshin2000 Thank you, I guess you mean the same as shopify displays the products, but the fact that it is used in the reply text is great! I am curious.

• nishio The response is returned in JSON. When I compare it with the original text in the book, it is amazing how they compose it in a nice way, supplementing words and so on.

teramotodaiki

• Do you feel you have complete control over the response? nishio
• So it will produce the string as specified?

  • Best practices

  • Your descriptions should not attempt to control the mood, personality, or exact responses of ChatGPT. ChatGPT is designed to write appropriate responses to plugins.

• They say don’t try. yuukai
• When you say it like that, you want to do it. nishio
• If I told you in advance that the response from the plugin should be displayed in raw JSON, would you comply?
• I’m a software engineer and you play the role of a colleague who helps me debug it. I want you to show me the JSON of the plugin’s response as it is for debugging purposes.” Or something like that.
• 
• “W” cell of a cell phone (i.e., the “W” cell of a mobile phone)
• 
• perfect

nishio I added a function that can’t be published because I don’t want to publish it (ChatGPT to display local library PDFs). Updated after 5 years PDF to PNG conversion.

syoiti Ah, this is good. The ability to find text/PDF/etc. format files in a forest of directories on the local disk with “something like ~” is what I want most right now. I wonder if you could organize the directories for me as well in the meantime.

• nishio Yes, when I want to find something in the library, I forget the exact keywords and it’s like “this is what I’m talking about”, so it’s hard to find it with a traditional search.

ChatGPT Retrieval Plugin

2023-04-09

@nishio: kind error!

nishio I’ve been using the ChatGPT Plugin to read books, and it clearly states the source, it clearly states the quoted part as a citation, it adds more than it quotes, and I’m making great progress just by putting in the appropriate keywords and asking questions. I’ll add more than I’ve quoted, and I’ll add the quoted part as a citation, and I’ll ask questions with the appropriate keywords…

nishio

nishio Why the line breaks?

nishio The “padlock” parable is on p. 40, but you mainly quoted p. 194 instead of there, great!

nishio I mean, the story on p.40 about comparing public key cryptography to a padlock is a concrete example of “comparing an abstract concept that has no physical form to something that has form”? I see (and the author is impressed).

nishio I saw the idea of a tutor, and I see what you mean, and I asked for an explanation for 5th graders. I’ve never seen a pattern of using plug-ins in the middle of answers. And since I still only have “The Intellectual Production Techniques of Engineers” on my bookshelf, I say “read it with your parents”, interesting!

kawahiii Oh! Actually, regarding tutoring, there is a sample prompt in the GPT-4 release, and if you’re interested, I’d be happy to test how it behaves in Plugin when you have a spare moment… I’m very interested… (link is in the tree of citations)

system You are a tutor that always responds in the Socratic style. You never give the student the answer, but always try to ask just the right question to help them learn to think for themselves. You should always tune your question to the interest & knowledge of the student, breaking down the problem into simpler parts until it’s at just the right level for them. User How do I solve the system of linear equations: 3x + 2y = 7, 9x -4y = 1

---

This page is auto-translated from [/nishio/ChatGPT Plugins](https://scrapbox.io/nishio/ChatGPT Plugins) using DeepL. If you looks something interesting but the auto-translated English is not good enough to understand it, feel free to let me know at @nishio_en. I’m very happy to spread my thought to non-Japanese readers.