• Returned to machine learning to determine the naturalness of questions.

nisbot.iconWhat would you like to see happen in this conversation? nishio.iconI have temporarily turned off naturalness determination of questions by machine learning and would like to test it now that I have it back on. nisbot.iconWhat type of judgment is that judgment? nishio.iconBinary classification as natural or not natural for the immediately preceding document/question pair, ignoring context nisbot.iconWhat type of context is that context? nishio.iconI havenā€™t looked at the relationship between the multiple series of questions or anything like that. So itā€™s possible that the overall flow could be unnatural with this in there, and thatā€™s hard to test at hand, so Iā€™m just trying to use it in practice. nisbot.iconWhat type of question is that? nishio.iconšŸ™ nisbot.icon

  • I havenā€™t looked at the relationship between the multiple series of questions or anything like that. So itā€™s possible that the overall flow could be unnatural with this in there, and thatā€™s hard to test at hand, so Iā€™m just trying to use it in practice.

  • Is there anything else you can tell us about this question? nishio.iconLike, if you donā€™t ask this first, itā€™s not natural to ask this out of the blue. nisbot.icon
  • I havenā€™t looked at the relationship between the multiple series of questions or anything like that. So itā€™s possible that the overall flow could be unnatural with this in there, and thatā€™s hard to test at hand, so Iā€™m just trying to use it in practice.

  • Where is this question? nishio.iconšŸ™ nisbot.icon
  • I havenā€™t looked at the relationship between the multiple series of questions or anything like that. So itā€™s possible that the overall flow could be unnatural with this in there, and thatā€™s hard to test at hand, so Iā€™m just trying to use it in practice.

  • What does this question seem to be? nishio.iconšŸ™ nisbot.icon
  • I havenā€™t looked at the relationship between the multiple series of questions or anything like that. So itā€™s possible that the overall flow could be unnatural with this in there, and thatā€™s hard to test at hand, so Iā€™m just trying to use it in practice.

  • Where is this question? nishio.iconšŸ™ nisbot.icon
  • I havenā€™t looked at the relationship between the multiple series of questions or anything like that. So itā€™s possible that the overall flow could be unnatural with this in there, and thatā€™s hard to test at hand, so Iā€™m just trying to use it in practice.

  • What type of linkage is this linkage? nishio.iconFor example, ā€œIs there anything else?ā€ would be funny if it came out of nowhere. nisbot.icon
  • Iā€™ve turned back on machine learning to determine the naturalness of questions, which I had temporarily turned off, and Iā€™d like to test that.

  • Is there anything else about this decision? nishio.iconNothing in particular. nisbot.icon
  • Binary classification as natural or not natural for the immediately preceding document/question pair, ignoring context

  • Is there anything else about this context? nishio.iconThis time there were many test cases for the flow behavior, so I was able to notice once the flow was broken, and I was able to fix it and confirm that it was back to normal. nisbot.iconWhat type of behavior is this behavior? nishio.iconNow ā€œIs there anything else?ā€ is asked first. nisbot.iconWhat type of destination is the destination? nishio.iconWhat kind of X is that X?ā€ before asking. nisbot.iconIs there anything else you can tell us about beyond that? nishio.iconIf you just cut out the question and ask if itā€™s natural, the question is, ā€œWhat kind of X?ā€ is more unnatural than ā€œWhat other kind of X?ā€ is more unnatural than ā€œIs there anything else? nisbot.iconWhat is the type of type? nishio.iconNGKW Type nisbot.iconHow do you know that question? nishio.iconšŸ™ nisbot.icon
  • If you just cut out the question and ask if itā€™s natural, the question is, ā€œWhat kind of X?ā€ is more unnatural than ā€œWhat other kind of X?ā€ is more unnatural than ā€œWhat else?

  • What kind of X ka is this X ka? nishio.iconNGKW X. nisbot.icon
  • ā€œWhat kind of X is that X?ā€ before asking.

  • Where is this destination? nishio.iconNGKW destination nisbot.icon
  • ā€œWhat kind of X is that X?ā€ before asking.

  • What kind of X is this X? nishio.iconNGKW X nisbot.icon
  • Binary classification as natural or not natural for the immediately preceding document/question pair, ignoring context

  • Where is this context? nishio.iconFlow of questions repeated nisbot.icon
  • Since there were many test cases for flow behavior this time, I was able to notice once the flow was broken and was able to fix it and confirm that it was back to normal.

  • Is there anything else you can tell us about this behavior? nishio.iconIn the end, I decided not to make a naturalness judgment on the two basic questions because I could not reconcile the comfortable order of the two questions with the fact that their naturalness as individual questions did not match the order of the two questions. nisbot.iconHow will you know the decision? nishio.iconThe user doesnā€™t know how itā€™s determined internally. nisbot.iconWhat type of user is this user? nishio.iconUsers of this chat nisbot.iconIs there anything else you can tell us about that user? nishio.iconI want to be asked a good question. nisbot.iconWhat is it that you value? nishio.iconIt would be good if the naturalness of questions could be judged to reduce the number of cases where clearly unnatural questions are asked to users, which impairs their comfort. nisbot.iconWhere is that user located? nishio.iconšŸ™ nisbot.icon
  • It would be good if the naturalness of questions could be judged to reduce the number of cases where clearly unnatural questions are asked to the user, which impairs the userā€™s comfort.

  • What is the relationship between this question and the user? nishio.iconInformation is drawn from the user by being asked questions. nisbot.iconIs the user the same as the question? Is it different? nishio.iconNo, it is not. nisbot.icon
  • It would be good if the naturalness of questions could be judged to reduce the number of cases where clearly unnatural questions are asked to the user, which impairs the userā€™s comfort.

  • What happens to the user when this question is asked? nishio.iconA good question leads the user to a flow state by providing a series of moderately sized tasks. Asking bad questions confuses the user and interrupts the flow. nisbot.iconWhat happens to the question when that user nishio.iconšŸ™ nisbot.icon
  • It would be good if the naturalness of questions could be judged to reduce the number of cases where clearly unnatural questions are asked to the user, which impairs the userā€™s comfort.

  • What is the connection between this question and the user? nishio.iconšŸ™ nisbot.icon
  • In the end, I decided not to make a naturalness judgment on the two basic questions because I could not reconcile the comfortable order regarding the two basic questions with the fact that their naturalness as individual questions did not match that order.

  • What is the relationship between this decision and the question? nishio.iconIf the judgment is well done, the quality of the questions will improve. If itā€™s not done well, itā€™s worse. nisbot.iconIs that judgment the same as the question? Is it different? nishio.iconNo, it is not. nisbot.icon
  • If the judgment is well done, the quality of questions will improve. If itā€™s not done well, it will get worse.

  • What happens to the question when this judgment is made? nishio.iconIf the baseline for judging is off, youā€™re going to lose the diversity of questions by selecting only those questions that tend to be natural as a base. nisbot.iconWhat happens to the judgment when you ask that question? nishio.iconšŸ™ nisbot.icon
  • If the baseline for judging is off, youā€™re going to lose the diversity of questions by selecting only questions that tend to be natural as a base.

  • What is the relationship between this decision and the user? nishio.icon(At any rate, I was concerned that it would slow down the response time, but thatā€™s not really harmful. The issue of the baseline being off depending on the question needs to be resolved, imho) šŸ™.

This page is auto-translated from /nishio/ä¼šč©±ćƒ­ć‚°2021-01-28 using DeepL. If you looks something interesting but the auto-translated English is not good enough to understand it, feel free to let me know at @nishio_en. Iā€™m very happy to spread my thought to non-Japanese readers.