-
Suppose there are two methods: method X, which requires few resources and achieves fair accuracy, and method Y, which improves accuracy by investing more resources.
- Method Y is written as NN in the figure because a neural net is considered here as an example
-
Method Y is a method with trade-off between resource consumption and accuracy, so it is triangulated in the figure.
- We will refer to this diagonal line here as the technology constraint. ref: budget constraint.
-
When Method Y first appeared, it was a âuseless methodâ that consumed more resources and was less accurate than Method X.
-
Method Y research is progressing and the technology constraint line is going up.
-
As a result, the top of this triangle, the leading edge of the accuracy competition, exceeds the accuracy in method X
-
Papers and other publications begin to write that method Y is more accurate than method X, and the topic becomes a hot topic.
-
However, it is not reasonable to say that method Y is the method of choice for business applications at this point
-
This is because when customers evaluate the value of a method, they take into account not only the accuracy but also the resources consumed.
-
In the figure below, Method Y has overtaken Method X in terms of accuracy, but Method X is still far better in customer evaluations
-
At this point, in reality, it is unlikely to lead to customer satisfaction, but attention is drawn and investment is made.
- see hype curve
-
It is not irrational to invest for the long term with the expectation of future growth.
- Allow employees time to learn in case they will need knowledge in this domain in the future
- Anticipate that Method Y will be widely used and hold down what will be needed for its use.
- Strategies equivalent to âseize the upstream of the supply chainâ in industry
- A specific example is the investment in the computational infrastructure of Method Y
- Typical example is Googleâs TPU development
-
Short-term investments for the purpose of application at this point in time, well, of course they fail at a high rate.
- Itâs being done by sucking nutrients out of people and companies that donât understand it and putting them into the long-term investments mentioned above.
-
This long-term investment, especially in the computing infrastructure, will reduce the resources consumed by the same code.
-
The contribution of the amount of resources consumed to the value found by the customer is reduced.
- There are two interpretations.
- Interpreted as overall higher speeds reducing the amount of resources consumed.
- Interpretation that even if the difference in consumption resources does not change, it is because the mapping to that money changes.
- There are two interpretations.
-
The customerâs evaluation axis becomes more of a âstandingâ line, and the âgoodness to the customerâ of methods X and Y is reversed. x - price elasticity
-
In this major trend, the domain of âknowledge that helps reduce consumption resourcesâ is no longer valued by customers and shrinks
-
I am annoyed when people talk about AI using neural nets for things that âjust use linear regression,â but when I think about it, the world has wasted CPU time and memory using scripting languages for things that âjust use C to write it,â and eventually CPU and memory performance has improved to the point where scripting languages are fine. Eventually, the performance of CPU and memory improved, and it became OK to use script language. Now we are in a transitional period, so we are using neural nets for things that âdonât need to be done with neural nets,â but this boom will never end, and the number of people who can only do neural nets will probably increase⊠And just as people who only know scripting languages say, âWhat is malloc? people who only understand neural nets will start saying âWhat is linear regression? And people who understand only neural nets will start saying, âWhat is linear regression?
-
I am a resident of the old generation, the one who thinks âlinear regression is the way to go,â but just as happened in the relationship between C and scripting languages, a new generation will emerge that does not know the knowledge of the old generation, and will be able to create customer value without knowing it.
This page is auto-translated from /nishio/ă·ă„ăȘăłăŻăăç„èăăĄă€ăł using DeepL. If you looks something interesting but the auto-translated English is not good enough to understand it, feel free to let me know at @nishio_en. Iâm very happy to spread my thought to non-Japanese readers.