Do we really need `<unk>` tokens?

datascience.stackexchange https://datascience.stackexchange.com/questions/33444

質問

I am wondering, do we really need <unk> tokens? Why do we limit our vocabulary?

Is it for speed? Accuracy?

If we disable all limitations, what do you predict happens?

正しい解決策はありません

ライセンス： CC-BY-SA と 帰属
所属していません datascience.stackexchange
scroll top