I made a process which reads a file, then makes document of it, then tokenizes it by regular expressions. Preview mode of tokenizer highlights found patterns correctly.

Now can I just get a list of found patterns on my screen?

enter image description here

有帮助吗?

解决方案

Replace the Tokenize operator with Process Documents and place the Tokenize operator inside it. The word list output of this represents the tokens.

许可以下: CC-BY-SA归因
不隶属于 StackOverflow
scroll top