Boxes can collapse while being stacked. Math knowledge is a square block. In mathematics, knowledge is square blocks, whereas blocks in other fields are a bit awkward. In mathematics, the blocks are stacked so precisely that you can build very tall towers. You get to a very high level of abstraction. But in other fields, if you try to stack them in the same way as in mathematics, they collapse. So you have to collect a lot of information and stack it in a pyramid, with many boxes supporting it. image - The Intellectual Production of Engineers p.4

@hrjn: it’s not limited to ChatGPT, but machine learning just returns random answers based on a nice biased probability distribution. So, there is no concept of right and wrong. So there is no concept of right/wrong in the first place. In principle, I doubt that the concept of logic exists there. It’s just the result of a chain of probabilities that results in a somewhat logical answer.

In the case of mathematical logic, the chain of logical steps is very long, and the validity of the inference “does not diminish in the slightest. In contrast, the chain of logical steps in the logic of the world is short, and the validity of inferences always decreases at each step. The validity of logic is a function of the situation. Due to the indeterminacy of the situation, the validity of inferences rapidly decreases as the chain of logical steps gets longer. - Introduction to Mathematical Politics


This page is auto-translated from /nishio/真四角のブロック using DeepL. If you looks something interesting but the auto-translated English is not good enough to understand it, feel free to let me know at @nishio_en. I’m very happy to spread my thought to non-Japanese readers.