Subword Regularization: Improving Neural Network Translation Models with Multiple Subword Candidates https://arxiv.org/pdf/1804.10959.pdf
- Byte-Pair-Encoding (BPE)
- Unigram language model
Subword Regularization: Improving Neural Network Translation Models with Multiple Subword Candidates https://arxiv.org/pdf/1804.10959.pdf