- Neural nets are often treated inhumanly, being forced to learn the same data over and over again, regardless of their intentions. - Neural Net Abuse
- For humans, boredom is, I’m bored, and I’m going to lower the weights. - Are you avoiding overlearning by getting tired of?
- Conversely, when something unfamiliar or an unexpected phenomenon occurs, interest and concentration are high curiosity.
- Automatically decrease the learning factor for data with high predictability and increase the learning factor when a different phenomenon occurs than predicted.
- It may be related to acclimation described on p.84 and adaptive boosting described on p.88 in The Intellectual Production of Engineers.
- Automatically decrease the learning factor for data with high predictability and increase the learning factor when a different phenomenon occurs than predicted.
This page is auto-translated from /nishio/飽きることと過学習 using DeepL. If you looks something interesting but the auto-translated English is not good enough to understand it, feel free to let me know at @nishio_en. I’m very happy to spread my thought to non-Japanese readers.