- Multiple Vectors way of putting together.
- naively average.
- RNN-like method
- The Problem of Distant Objects Being Forgotten
- LSTM-like solution
- attention mechanism
- The question is what to do with the query
- The Problem of Distant Objects Being Forgotten
This page is auto-translated from /nishio/č¤ę°ć®ććÆćć«ć®ć¾ćØććć using DeepL. If you looks something interesting but the auto-translated English is not good enough to understand it, feel free to let me know at @nishio_en. Iām very happy to spread my thought to non-Japanese readers.