Question

I made a process which reads a file, then makes document of it, then tokenizes it by regular expressions. Preview mode of tokenizer highlights found patterns correctly.

Now can I just get a list of found patterns on my screen?

enter image description here

Was it helpful?

Solution

Replace the Tokenize operator with Process Documents and place the Tokenize operator inside it. The word list output of this represents the tokens.

Licensed under: CC-BY-SA with attribution
Not affiliated with StackOverflow
scroll top