I was told that the listening chat system is not suitable for organizing tasks when there are multiple tasks because it digs into a single task, so I tried a crazy experiment: if thatâs the case, why not open a chat for each task? âConclusion: Objective achieved
consideration
- Open a separate chat for each task and you can drill down individually.
- Thatâs not the way it was done in the Mattermost era.
- Crystallization of the previous task to a question of value will have a positive impact on the later task.
- The language in the #2 chat about the importance of the rate of keyword increase gave a strong raison dâĂȘtre to task #5.
- Before I started, I thought maybe number 4 would be next.
- The more detailed the individual tasks, the easier it was for humans to prioritize, and the zero chat was in phase mode and not asking questions.
- It would have been hard to do a recap on each of the five tasks if we had had questions.
0th chat What would you like to see happen in this conversation? Iâm told that the current system is not suitable for selecting the next task from multiple tasks, so Iâd like to try to see what happens if I drill down to the individual tasks then. What type of task is the task?
1st chat End design What would you like to see happen in this conversation? I want to think about the design of the end What type of design is that? How to end this dialogue? First idea, âWhat just happened?â with the appearance of âI seeâ and verbalization of the content of the awareness, then âIs this a good place to end?â and if âYesâ, then end; second idea, âWhat happened?â or âIs this a good place to end?â with machine learning. What type of dialogue is that? The human side gets tired, and the quality of the questions usually declines and the end of the session becomes unpleasant. Itâs exhausting on the human side, and the quality of the questions generally declines as you run out of good keywords, leading to an unpleasant ending. What type of side is that side? NGKW side What type of question is that gradual question? The longer you keep doing this, the worse it will get unless there is a sufficient supply of good keywords from humans.
0th chat What type of task is the task? Listen first. Yes, sir. Another thing that came to mind during the first chat, looking at the extracted keywords for each step in the early stages, there may be a difference between cases that develop well and those that do not. We could use that to detect situations that donât seem to work and give advice on how to make them better. the opening(s) (e.g. in a game of go or chess) (PS: I saw this keyword extraction and thought, âWell, what I want to do is âdesign the early stagesâ.â)
1st chat End design What kind of person is that person? Aside from that, do we do it with machine learning or rule-based? What type of machine learning is that? Binary classification from a variety of features. Iâm not sure what kind of features we need, but maybe the last input, the question, the keyword exhaustion, the length of the conversation, etc. What type of question is that? I think the probability of prompting awareness depends on the question. Is there anything else about that question? (initiate a second chat). I remembered, depending on the question, I wanted to push the answer choice. Specifically, âIs this a good place to end?â I want to give a âyesâ and then press it to finish. What is it that you value? It feels good to end a stonkingly clean session. Itâs better than cutting off the slog that goes on and on. What type of feelings are those feelings? It looks like it was done properly. Which reminds me, I want to delete the input field on the chat system side of the decision. What type of chat system side is that chat system side? I mean at the discretion of the program. What type of decision is that decision? If you decide that the dialogue is over here, delete the input field and end it. Is there anything else about that dialogue? (Leave for a moment)
2 Early design What would you like to see happen in this conversation? I would like to think about the design of the early stages of the project. What type of early stage is that early stage? In the early stages of this dialogue, some people donât get on track well and crash, and I want to help them get on track well. Is there anything else you can tell us about that early stage? The chat system asks in-depth questions in response to keywords, but in extreme cases, for example, there are people who enter sentences with no keywords at all. In such cases, of course, there are no keywords, so it is impossible to ask a proper question.
-
In the early stages of this dialogue, some people donât get on track well and crash, I want to help them get on track well.
- Where is this early stage? Especially the first time you use it, I recommend looking at the log, but you start it up without looking at it and put âwhat do you want to happen?â and then you start up without looking at the log and put âNothingâ in the âWhat do you want to happen? Well, aside from such extreme cases, even people who have read the logs to some extent sometimes use NGKW too much and run out of keywords.
-
In the early stages of this dialogue, some people donât get on track well and crash, I want to help them get on track well.
- How do you know these early stages? (Why such a focus on the early stages?) As for how to know that the early stages are not going well, perhaps you can compare the logs that are going well with those that are not and see if there is a significant difference in the growth of the number of keywords extracted, and then you can determine that. Where is the beginning of this process? đ
-
How do you know that the early stages are not going well? If you compare the logs that are going well with the logs that are not going well, there is probably a big difference in the growth of the number of keywords extracted, and thatâs how you can tell.
- What does this early stage look like? Itâs already there, but itâs like launching a rocket, you have to get a certain speed or youâll crash. What type of rocket is that? Rocket to reach the moon Is there anything else you can tell us about that rocket? I can detect lack of speed, but I donât know what to do when I detect it. What type of speed is that? Speed of keyword growth Is there anything else you can tell us about its speed? On the other hand, some people reduce it more and more. What type of person is he/she? Iâm too rigid in my evaluation of keyword extraction, and if something is even a little bit wrong, Iâll NGKW more and more. Iâm not in the business of creating training data for a keyword extraction engine, but using this chat system is supposed to help me reach awareness (month), but Iâm acting counterproductive. What type of chat system is that? Take out what humans have not yet verbalized. What is it that you value? By using this chat system, I can verbalize what I have not been able to verbalize yet, notice my blind spots, etc., and I have a high probability of this happening, so I want other users to be able to use it well and experience the awareness. Is there anything else about that chat system? Hmmm, does it take practice to get used to using it?
-
By using this chat system, I can verbalize things that I have not been able to verbalize yet, or notice blind spots, or something like that, and I have a high probability of this happening, so I want other users to be able to use it well and experience the awareness.
- What is this chat system like? I am a counselor who can chat with him 24/7, but his Japanese is a bit awkward. If I had to point out every single mistake in her Japanese, the conversation would never get anywhere.
-
By using this chat system, I can verbalize things that I have not been able to verbalize yet, or notice blind spots, or something like that, and I have a high probability of this happening, so I want other users to be able to use it well and experience the awareness.
- Where does this chat system come from? (Once here, go to the next task)
3 What would you like to see happen in this conversation? I would like to think about a feature that plays bad keywords. What type of keywords are those? The one this system uses for questions. What kind is that one? NGKW What type of system is that? Dig deeper by asking questions for keywords. Is there anything else you can tell us about those keywords? But as we talked about in another chat, people often get too few keywords⊠Maybe we should prioritize increasing keywords over correcting the direction of reducing them? What do those keywords seem to be? Hooks for catching fish What type of fish hook is that? The more you have, the more likely you are to catch fish, but more bad hooks donât mean anything.
-
But as we talked about in another chat, often people get too few keywords⊠maybe the priority should be to increase keywords rather than to modify them in the direction of reducing them?
- Where is this keyword? Iâve found a few keywords that are obviously no good, about 110 when I search the logs with NGKW. Some of them are not no-noâs from my point of view, but some of them are no-noâs like âă€â Where are those keywords located? They are scattered in the data file and can be collected by writing a tally script.
-
Iâve found a few keywords that are obviously not good, Iâve searched the logs for NGKW and found about 110. Some of them arenât no-noâs from my point of view, but some of them are no-noâs, like âă€â
- How do you know these keywords? Things that are subject to NGKW commands. The rest may be candidates even if they are not explicitly commanded, but their scores are not increasing. What type of tally script is that tally script? Iâll go through all the logs, collect the keywords that are the subject of the command, and output them. What type of log is that log? Stored logs for this system Is there anything else you can tell us about that system? Various failed keywords can be found by various people using them. What type of failure keywords are those failure keywords? A failure to extract keywords, which was cut out in an odd way. What type of keyword extraction is that? It is rather good for some long sentences, but for short words, it tries to force extraction from them and sometimes extracts strange things. The goodness of the keywords found is normalized to a maximum of 100 points, so if the input is such that only one garbage keyword is found, it will be a garbage keyword with 100 points. What is it that you value? It is important to be able to extract good keywords Where do these keywords come from? Should we just lower the score when the userâs input is short or something? Not necessarily, I guessâŠsometimes you have to put in a perfect keyword in one word. I still have to machine learn how good the keywords are. What should those keywords happen to be? Bad keywords, even if they are extracted, should score low. What needs to happen to those keywords for that to happen? We just need to determine that the keyword is bad. Can that keyword do it? You can do that by putting together that kind of machine learning. What type of machine learning is that? We can use a binary classification to learn whether NG or not, and use the probability values as coefficients. What type of coefficient is that? 1 for good keywords, 0 for bad keywords. What type of good keywords are those good keywords? I guess I could choose one that has a longer user response to the keyword. What type of user is this user? People who generate input What type of input is that? Answers to Questions What type of question is that? đ
-
1 for good keywords, 0 for bad keywords
- Anything else about this good keyword? (Move on to the next task)
4 What would you like to see happen in this conversation? I would like to think about [Naturalness determination of questions What type of judgment is that judgment? Determine if the combination of keywords and questions is natural based on training data What type of question is that? Some questions given Is there anything else about that question? I think thereâs a funny kind of word to put in there, obviously, like âwhat happens when ~?â What type of word is the word? I wondered if I could make a decision from the data without considering that, but it doesnât seem to be working out so well, so I guess I should think about what I would do if I were rule-based and devise a feature set.
-
Some questions given
- Where is this question? Preset in the system. What type of preset is that preset? Adapted from a technique called Clean Language. What type of clean language is that clean language? (Go to next task)
5 What would you like to see happen in this conversation? I want to think about movement extraction. What type of extraction is that? When we say keyword extraction, the world often extracts noun phrases. Itâs the same with keywords in papers and so on. But when I think about using them in this chat, verbs are often accompanied by more concrete images than nouns, and are too good to throw away. What type of noun is it? If you extract the noun, it would look like this. With verbs, it would be âWhat kind of âuseâ is that âuseâ?â And so on. Itâs a question, isnât it? Is there anything else about that noun? Nouns often tend to be abstract concepts, and when asked about abstract concepts, they often tend to be even more abstract, which is not very good! How do you know that noun? Morphological analysis will tell you.
-
Nouns often tend to be abstract concepts, and when asked about abstract concepts, they often tend to be even more abstract, which is not very good!
- Where is this noun located? Iâll take out the verbs in the user input and add them to the keywords for now, but some of them, like âsayâ and âseeâ are not very good, so I need to filter them out. What type of keywords are those? Also, where do you have the information that itâs better to put it in swastikas? What type of hook brackets are those hook brackets? Itâs better to group not only verbs but also words that contain particles, so you can either judge by the display part. What type of verb is that verb? Itâs not about âbeingâ or anything, but about the userâs active behavior that is important. What type of user is this user?
0th chat Weâve delved into each of the five tasks so far in individual chats (Internet) chat The first is the design of the end, which is intended to have the value of âit feels good to end nicely.â Specifically, âallow questions to produce answer choices,â âask the question, âIs this a good place to end, rule-based,â âif yes, delete the input field,â and âyes, If yes, then delete the input field, and if no, then use the information for machine learning in the future. options Second is the design of the early stage, which is to âhave many users experience that by using this chat system, they can get language and awareness of their blind spots,â and to solve the problem of not getting off track in the early stage for this purpose. the opening(s) (e.g. in a game of go or chess) He wrote that he can detect the slow rate of keyword increase, but does not know what to do about it. Is it better to visualize it? A rocket launch metaphor, a percentage indication of how far the value to be achieved in each phase has been achieved? metaphor The third is the ability to play bad keywords. The value is to be able to extract good keywords. This is machine learning of good and bad keywords. machine learning The fourth is the naturalness determination of the question, which has not yet reached the value question. Specifically, I am thinking that I should devise a feature to do this in a rule-based manner. value The fifth is motion extraction, which is also not a value question. It is easy enough to just extract verbs, but not everything, so a filter must be applied. value And well, after thinking this far, I decided that the first of the five should be movement extraction. Because it will have a positive impact on the way the early stages of the project will proceed by increasing the number of keywords extracted. Next is a mechanism to play the keywords that are not good. This improves the quality of keywords and reduces the likelihood of stumbling in the early stages. the opening(s) (e.g. in a game of go or chess) The early design does not have a clear language of action. It would be a good idea to try to verbalize it again after the first two are done. And if you come up with one, implement it, and if not, proceed to the end design. the opening(s) (e.g. in a game of go or chess) Improvements to the naturalness determination of the questions are pending, but Iâm okay with putting it off until later because the training data is growing just by leaving it alone. question the end What would you like to see happen in this conversation? I wanted the tasks to be organized, but I got what I needed to do first and next, so the objective was achieved. Is there anything else about that task?
This page is auto-translated from /nishio/ăżăčăŻæŽçă«çĄçăăäœżă using DeepL. If you looks something interesting but the auto-translated English is not good enough to understand it, feel free to let me know at @nishio_en. Iâm very happy to spread my thought to non-Japanese readers.