Can BERT do the next-word-predict task?

https://datascience.stackexchange.com/questions/46377

neural-network
transformer
deep-learning
attention-mechanism
bert

01-11-2019
|

Question

As BERT is bidirectional (uses bi-directional transformer), is it possible to use it for the next-word-predict task? If yes, what needs to be tweaked?

No correct solution

Licensed under: CC-BY-SA with attribution

Not affiliated with datascience.stackexchange